Have you thought about getting a Dremel with a metal cutting bit and reshaping the inside rubber section?
There looks like enough thickness there you could cut it down, reshape it or maybe remove it...