"It's not easy. There's parts that you wish you could hold him and see him," he said. "I'm lucky for the time we had together; I appreciate the time we did have together, and I know it's just a part of life."