What’s With “Push” Email?

Steve said at the Keynote that Yahoo would be providing a free push email account with every iPhone.

But I don’t understand. Why is push email better than simply automatically checking the server every five seconds? Or, for that matter, every two minutes? Does it really matter if you get email, and then have to wait a whole two minutes before you get to see it?