Former Secretary of Defense Robert Gates is taking Congress and the White House to task, calling them the “greatest threat to American national security.”

“People ask me, ‘What’s the greatest threat to American national security today?’ I say it’s encompassed within the two square miles that involve the Capitol and the White House,” Gates said Wednesday on Fox News’s “Fox & Friends.”

Gates, whose memoir was released this week, has been making the media rounds and echoing the criticisms in his book of the Obama administration and legislature.

Gates said he “would like to see less micromanagement from the White House,” but emphasized that he hopes that his book serves more as a message to Congress.