Attorney General Eric Holder finally got fed up Tuesday with claims that the Justice Department went easy in a voting rights case against members of the New Black Panther Party because they are African American.

Holder’s frustration over the criticism became evident during a House Appropriations subcommittee hearing as Rep. John Culberson (R-Texas) accused the Justice Department of failing to cooperate with a Civil Rights Commission investigation into the handling of the 2008 incident in which Black Panthers in intimidating outfits and wielding a club stood outside a polling place in Philadelphia.

The Attorney General seemed to take personal offense at a comment Culberson read in which former Democratic activist Bartle Bull called the incident the most serious act of voter intimidation he had witnessed in his career.

“Think about that,” Holder said. “When you compare what people endured in the South in the 60s to try to get the right to vote for African Americans, and to compare what people were subjected to there to what happened in Philadelphia—which was inappropriate, certainly that…to describe it in those terms I think does a great disservice to people who put their lives on the line, who risked all, for my people,” said Holder, who is black.

My people? If he was the Attorney General of the United States, shouldn’t all Americans have been his people?