Chesham United's match against Redditch United was abandoned after a player allegedly punched the referee. Photograph: Reuters

Redditch United have cancelled the registration of their striker Josh McKenzie after he allegedly punched the referee during the club's Evo-stik Southern League game against Chesham United.

The match was called off in the 52nd minute when McKenzie reacted to a penalty decision against him. Police were subsequently called to the ground.

A Redditch statement said the club were "outraged by the incident" and cancelled the player's registration "within minutes". "He will never play for the club again. We pride ourselves on fair play and will not tolerate this."

Chesham's chairman, Alan Calder, told the Bucks Free Press: "A player who was already on a yellow card gave away a penalty and got a red card. He went over, struck the referee who went down. He got up straight away and blew the full-time whistle, which caused pandemonium. We were disappointed it was abandoned [but the referee] said he wasn't in the right state to carry on, which I can understand."