Agreed on both points, but we need to find someone willing to fix the 3.4 installer (I'm completely focused on the 3.5 installer, which won't suffer from the first point).
There's a separate issue tracker for pip which would be the place to get their developers to handle the exception in their code. We should be fixing mimetypes.
I've attached a proposed patch for mimetypes for 3.4 and default. Any concerns/do we know who owns it?