Then you must live in a really crappy place. There`s a difference between knowing racial stereotypes and buying into them or actively disliking another race. As for saying it`s only viewed as racism when it comes from a white person you`re simply misinformed or are attempting to misrepresent reality to make a point. Maybe that`s how it works in the states but in Canada racism is racism.

tl;dr You`re a racist, not everyone is and everyone knows anyone can be racist