Kelly initially defended Porter in a Daily Mail story that revealed allegations that Porter physically and emotionally abused his two ex-wives. The White House chief of staff issued a second statement Wednesday saying he was "shocked" by the allegations.

“I was shocked by the new allegations released today against Rob Porter,” Kelly said. “There is no place for domestic violence in our society.” But he added: “I stand by my previous comments of the Rob Porter that I have come to know since becoming chief of staff and believe every individual deserves the right to defend their reputation.”

Kelly's initial support for Porter has been criticized by lawmakers on both sides of the aisle, including Republican Sen. John KennedyJohn Neely KennedyMORE (La.), who said Thursday that Kelly made a "bad decision."

“I think Gen. Kelly has done an extraordinary job as chief of staff to President Trump. I think he’s a good man, and sometimes good people make bad decisions,” Kennedy said.

Porter denied the claims in a statement announcing his resignation from the White House on Wednesday, calling them part of a "coordinated smear campaign."