10/14/13 12:27 PM EDT

“What really happened was that the briefing went on for about 40 minutes and I didn’t get a question, for whatever reason," Henry said on the Kilmeade & Friends radio program Monday. "I guess Jay Carney will have to answer that. I don’t know why... maybe he was upset. I wasn’t.”

Henry, who look visibly perturbed before his exit on Friday, also said he was going to be late for an appearance on Fox News's "The Five," and noted that the briefing started hours past schedule and ran long.

“I would have stayed longer if Jay had called on me, but he didn’t. I had work to do," Henry said.