These people quite often try to bad mouth gamers or call them lifeless, as they fail to grasp a game and must assume that it takes years to get as good a 'gamer'.
The fear can show itself in extremes were people react to the fear by screaming and or posting anti-gamer rhetoric.
Gamerphobes have created an array of names for people that are capable of playing them.

Gamer: "That's five wins in a row"

Gamerphobe: " You're just lifeless and live with your mom and play this game 24/7, that's the only reason you won!"