The swimming legend told USA Today this week that son Boomer Phelps’ last name could have caused a travel hiccup en route to the Olympics for his mother, Nicole Johnson, who was engaged to Phelps at the time. Jetting to Rio as the Phelps party of three was the easiest option.

“It was small,” he shared. “It was our closest friends and family there. It was perfect.”

While Phelps has embraced fatherhood, he’s also adjusted to life as a newlywed and, officially, a retiree. The 23-time Olympic gold medalist ruled out a chance of a comeback by removing his name from the drug-testing pool, in which athletes can be tested at any time and place. Of course, Phelps can un-retire by re-entering the program at a later date.

“I said to Peter [Carlisle, his longtime agent], I was like, ‘Get the papers, can we just sign these things, so I don’t have to do the daily updates and everything?'” Phelps explained.

“It’s good. I’m still in the pool [for fun]. I’m still not coming back.”