The 46-year-old actor told Jimmy that the former President “talked trash” about his golfing game the whole time. “Obama talked trash all day. Five and a half hours. He talked trash all day, and took all of our money,” Anthony revealed.

“He took $700 from Phelps, he took $600 from Chris Paul, and he took $300 from me,” Anthony revealed, prompting Jimmy to shout, “The president?!” “Yeah. I said, ‘man, is this even right? Can you take money from civilians?’ And [Obama] said, ‘I’m a civilian now, so yes I can take it.’”

Anthony also played a super fun game of Password with NPR host Terry Gross and musical guest Kesha – Watch after the cut!