A rep for Life Time tells TMZ Sports, "Upon our immediate review of the matter, this is not an issue of discrimination, as has been alleged."

"In fact, on both April 18 and 19, Life Time extended guest access to Mr. Jermall Charlo and Mr. Jermell Charlo, along with their group. As this matter escalated, staff felt unsafe given an ensuing verbal altercation."

"To be clear, we apologize for what appears to be a misunderstanding concerning our guest policy. Ultimately, we always welcome all individuals and the opportunity to serve them in a safe and respectful manner."

For his part, Jermell is not buying Life Time's explanation and told us,"I'm a black man and they didn't let me in."