I have never ever seen this. In tonight's World Series Game One, Umpire Dana Demuth totally Magooed a call at second when Cardinals shortstop Pete Kozma inexplicably let an easy toss from second baseman Matt Carpenter slide through his mitt. Maybe Demuth's arm was going up to call Dustin Pedroia out even before Kozma booted the ball and he couldn't stop it. But seriously, this call was so bad that Demuth must have been looking for a way out--remember this was barely 20 minutes into a World Series game. Almost immediately the other umpires began to move towards Demuth--circling the wagons
Red Sox manager John Farrell came out and asked Demuth to get a second opinion. Then, crew chief John Hisrchbeck joined the other five umpires in the infield. Hirschbeck and four other umpires (minus Demuth) agreed that the call was wrong and reversed it. We know this because Fox sports had a mic on Hirschbeck and we (later) heard Hirschbeck tell Cardinals manager Mike Matheny that all five umpires had agreed that Demuth blew the call and had overruled him. Here's one of probably one thousand links where you'll be able to find to a .gif of the play.
I've watched a few games over the years and I have never, ever, not even once, seen this happen. I am really, really impressed with both Hirschbeck and Demuth. Bravo.