Palin wrote in an op-ed last week that the president should be removed from office for his use of executive orders, arguing his unilateral actions had led to crises like the surge of immigrant children on the U.S.-Mexico border.

"President Obama's rewarding of lawlessness, including his own, is the foundational problem here," Palin wrote in an essay on Breitbart.

But Holder blasted Republicans for preventing the president from accomplishing progress legislatively.

“For whatever reason, Republicans decided early on that this was a president they were just simply not going to cooperate with,” Holder told ABC News. "And over the past five-and-a-half years, we have seen demonstrations of that, where the president has reached out his hand, offered compromises that have simply not been met [in the way] they have been in the past by a Republican Party willing to do the appropriate things."

Holder also criticized Speaker John Boehner’s (R-Ohio) lawsuit against President Obama, challenging Obama’s decision to delay the employer mandate in ObamaCare. The attorney general said he doesn’t think “that lawsuit's going to have legs.”

“It's a more, I think, a political gesture than a truly legal one,” he said. “Filing a lawsuit against the president that has no basis is not going to improve the quality of life for the American people.”

And the attorney general dismissed GOP calls for his removal for declining to appoint a special prosecutor to investigate allegations of illegal political targeting of conservative groups at the Internal Revenue Service. Holder said the FBI and “career people” within the Justice Department were “doing a good, professional job” examining the case.