I'm imaging the intensity the conductor would still have to display if it was an ensemble piece. "You have to *play* the rests." Then after all that intensity, the arms go down, the audience applauds.
And someone's stupid cell phone is likely to off during that moment.