Now in the second season of their E! reality series, Khloe Kardashian and Lamar Odom are in desperate need of some time off. Which is why, late last month, the couple revealed their decision to "pull the plug" on the series in an effort to put their family first.

Though the network is trying to persuade the couple to re-up for a third season, Kardashian, 27, and Odom, 32, are hesitant. In fact, the new Us Weeklyreports that the pair blame the show for distracting NBA star Odom, who was so off his game this season that the Dallas Mavericks dropped him from the team in April.

"They have decided he should spend his off-season focused on training," says a source close to the couple, who hope that Odom's renewed drive will get him re-signed with the L.A. Lakers or get him a spot on the Clippers' squad.

More important, they're anxious to shift the spotlight from their public struggle to start a family. "They really want to have a baby and are trying everything," confirms the insider. "But it's so personal to them. Now that they're back home in L.A., they can work on that more. Privately."