I didn't have a punch that small so I used a 3/32 allen wrench and needed to beat the hell out of it with a hammer the first time, but it is getting easier each time I take it out. By the time I get the push-pin tool it should be able to push right out with the palm of my hand.

Keep in mind you do not want the roll pin loose, the tighter the better. It's tight for a reason don't ya think. Like VA said you don't want to mangle the roll pin or the hole in which it goes. The more you punch out roll pins the looser they get, especially if you don't have the option of staking the pin.

The oil worked great. I still couldn't push it out with the punch, It took a few light taps with a 5oz hammer to get it out. I am 100% sure it will not fall out. but just to check I'll go to the range tomorrow and run 50 rounds through it just to check