I would be surprised if they did. I suppose it would depend on how interesting the first game was. If it was a snooze-fest in which no one was scoring, I'd probably leave to go to the second match.
Or I could just aparate back and forth every five minutes.