originally comes from the idea that the white man can not see the black man's struggle, or perhaps chooses not to see his struggle.
The phrase has been adapted as a statement of toughness to indicate superiority.