Sterling, the owner of the Los Angeles Clippers, is alleged to be the voice on an audio recording posted on TMZ Sports criticizing a woman for posting online about bringing black friends to games. The man is also heard chastising the woman for posting a photo on Instagram with Johnson.

"I'm disappointed, I'm hurt, I'm outraged, I'm everything," Johnson said at a news conference. "First, my name being associated, he singled me out personally. Then he singled out African-Americans. Again, I'm always gonna fight for myself as well as my people."

Johnson reiterated his statements that Sterling should not be allowed to continue as an owner. The NBA is expected to hold a press conference Tuesday on its investigation involving Sterling's alleged remarks.

"It was a sad day for all owners, of every sports team, but especially in the NBA, and hopefully our commissioner Silver will act quickly and resolve this situation," Johnson said. "I think that there's no room, so he has to lose the team, hopefully, and if that doesn't happen, then the commissioners and his partners have to decide his fate."

Johnson said he agrees with the Clippers players' decision to continue playing in the playoffs. The players held a silent protest before Sunday's game, wearing their warmup outfits inside-out with black socks.

"If nothing happens, then you can boycott in the off season, and not just the Clippers, the whole league has to, because if he's not thrown out, then you have to do something," Johnson said.

Johnson said emphatically that he has no interest in buying the Clippers himself, despite rumors to the contrary.

"When he came out against us and he said those things, and said about me personally that he didn't want me to come to his games, then everyone says that if he sells it, then Magic should buy it. I never said that, so that's not the case," Johnson said.

NBC News has not been able to authenticate the audio tapes posted on TMZSports.com or extended clips posted by Deadspin.

Clippers president Andy Roeser released a statement, saying: "Mr. Sterling is emphatic that what is reflected on that recording is not consistent with, nor does it reflect his views, beliefs or feelings. It is the antithesis of who he is, what he believes and how he has lived his life."