ALBANY – Famed celebrity lawyer Raoul Felder should resign or be ousted as head of the powerful state Commission on Judicial Conduct because his new book “invokes racial, ethnic and religious invective,” commission members unanimously declared yesterday.

The unprecedented action by nine members of the 33-year-old commission – which has the power to recommend judges be kicked off the bench – came in the wake of Felder’s publication with co-author and famed comedian Jackie Mason of “Schmucks: Our Favorite Fakes, Frauds, Lowlifes, Liars, the Armed and Dangerous and Good Guys Gone Bad.”

Commission members said they were “exploring our options in terms of removing him as chair.”

Reached by The Post, a defiant Felder declared, “I’m not Imus” and vowed to fight to hold his unpaid job.

“This will have to be tested in the courts,” said Felder, who was appointed to the commission by former Gov. George Pataki in 2003 and elected chairman by its members two years ago.

“I’m not going to go gently into the night,” said Felder, who disclosed that several commission members had privately asked him to resign.

Felder’s term expires next year.

The commission members, in a later afternoon statement, declared they “hereby express a loss of confidence in the judgment and leadership of the chair of the commission, Raoul Felder.”

“Except for Mr. Felder himself, who did not participate, the decision is unanimous,” the members said.

They contended that “much of the material” in the book “undermine[s] the appearance of impartiality and the dignity and probity that is required of the commission chair.

“Although the book purports to be a work of humor, much of it is crude, biased, vulgar and otherwise demeaning,” the statement continued.

The commission members contended the book “repeatedly” used racial, ethnic and religious invective, claims “nothing in our country is more insidious than affirmative action,” and argues that whenever the word “allegedly” is used in legal matters “you can bet it’s true.”

Felder insisted the members were seeking to restrict his right to free speech.

“I thought this was America. I wrote a book. If people don’t like it they shouldn’t buy the book,” he said.

Felder also said “lots of judges are not happy” with his decisions on the commission and suggested there were “some moving forces here” seeking his ouster.