"I mean, I don't want to brag about it," James said. "I don't know how that got out."

According to James, he felt like Lindsay's personal troubles would have gotten in the way.

"[She] was having issues even then, so you feel weird," he said of the actress, who is headed to rehab for a 90 day stint. "Honestly, she was a friend. I've met a lot of people that are troubled and sometimes you don't want to do that."