Earlier this month, Kardashian’s sister Kim Kardashian opened up about the scandal, admitting the situation was a first for the famous family.

“It was definitely new territory for us when you have a new baby coming into the world,” she said. “I think ultimately, we always want her to be happy, but it gets all clouded when there’s a baby, you know?”

“The whole family had to deal with the public’s perception of him and his relationship with Khloé changing dramatically,” said the source. “He also doesn’t fully ‘get’ that she’s been through this before [with ex-husband Lamar Odom], except that this time there’s a child involved.”

“When he got with Khloé, he tried to adapt to the best of his ability, but he struggled with being part of such a high-profile family and crossed lines he shouldn’t have,” added the source. “He wasn’t expecting such major backlash from the public and it’s been a lot for him to handle.”

Nevertheless, the source said everyone just wants the best for the couple and their baby girl.

“The whole family is there to support both him and Khloé through everything,” said the source. “But they also need his commitment in order for the relationship to succeed. All of them are really hoping for a positive outcome for Khloé’s sake.”