The two ran into each other when the A&E star attended the State of the Union and caught up after first meeting at last year's White House Correspondents' Dinner, Robertson explained on Thursday's Jimmy Kimmel Live!

"The last time I met him, at the Correspondents' Dinner, I had a tux on," Robertson explains. "He's like, 'Where's the tux?' I'm like, 'This is my State of the Union attire.'"

Robertson also recounted how he was invited to the State of the Union in the first place, something that had left a number of political pundits scratching their heads.

"So, my buddy, Vance McAllister wins this special election," Robertson begins, laughing as he starts his story. "He's only in for a year and then he has to run again, so he calls me up and he says, 'Willie, State of the Union man. I may only be here for a year, you want to roll?' I said 'Let's go, man, let's do it.' We're literally high-fiving in the back of it like, 'Can you believe it? We're here!'"

Robertson and his wife Korie, who joined him on the ABC late-night show, also said that the politicians mostly asked them about Uncle Si and whether he's really like he is on the show.

Although Phil Robertson's controversial anti-gay comments in GQ didn't come up during the interview, Korie did reveal that when she first met Willie, in fifth grade, Phil told her that his sons would make good husbands, adding that they're good providers.