RICHMOND, Va. (AP) — A Virginia lawmaker on Monday backed off his plans to swiftly introduce an impeachment bill seeking the ouster of the state’s leading black elected official as Democrats struggled to address revelations of past racist behavior and allegations of sexual assault roiling its highest levels of office.

The effort to impeach Democratic Lt. Gov. Justin Fairfax was prompted by the emergence of two women who accused him of sexual assault in the 2000s. Fairfax has vehemently denied the claims and called for authorities, including the FBI, to investigate.

Democratic Del. Patrick Hope tweeted early Monday that he got “an enormous amount of sincere and thoughtful feedback” from colleagues after circulating a draft of his impeachment bill, and that he sees that “additional conversations … need to take place before anything is filed.”

Yesterday I sent draft language to my colleagues on the first step of an impeachment action regarding the Lt. Governor. There has been an enormous amount of sincere and thoughtful feedback which has led to additional conversations that need to take place before anything is filed.

There’s been little sign of broad appetite for impeachment, with lawmakers set to finish this year’s session by the month’s end. But the Legislature is swirling with questions about lines of succession and the political fallout for Democrats should their governor, lieutenant governor or attorney general leave office, willingly or not.

Gov. Ralph Northam and Attorney General Mark Herring are still trying to regain their political standing after awkwardly acknowledging that they each once wore blackface as young men in the 1980s . Calls for Northam’s resignation raised the prospect of Fairfax taking over, which prompted his accusers to come forward.

All three scandals involve events that happened long before these leaders took office, but they’ve become a full-blown crisis for Democrats. The party counts on the support of black voters and has taken an almost zero-tolerance approach to sexual misconduct in the #MeToo era. A housecleaning could be costly: If all three Democrats resign, Republican state House Speaker Kirk Cox would become Virginia’s governor.

Northam, a pediatric neurologist, said that he considered quitting, but has decided he’s “not going anywhere” because the state “needs someone that can heal” it.

Northam said on CBS’ “Face the Nation” that it’s been a difficult week since a racist photo in his 1984 medical school yearbook surfaced, showing a person wearing blackface next to another person in a Ku Klux Klan hood and robe. Northam initially said he was in the photo, then denied it the next day, while acknowledging he did wear blackface to a dance party that same year.

“Virginia needs someone that can heal. There’s no better person to do that than a doctor,” Northam said. “Virginia also needs someone who is strong, who has empathy, who has courage and who has a moral compass. And that’s why I’m not going anywhere.”

Political considerations will be key to what comes next. Virginia is among a handful of states electing lawmakers this year, and Democrats had hoped to flip the Republican-controlled General Assembly.

Democratic Del. Patrick Hope said he wants to introduce articles of impeachment Monday against Fairfax, who is black. Meredith Watson and Vanessa Tyson have accused him of sexual assault and offered to testify at any impeachment hearing.

The Associated Press generally does not name people who say they are victims of sexual assault, but both women have come forward voluntarily.

Watson alleges Fairfax raped her while they were students at Duke University in 2000, her attorney said in a statement. Tyson, a California college professor, accused Fairfax of forcing her to perform oral sex on him at a Boston hotel in 2004.

The lieutenant governor issued a statement Saturday again denying he ever sexually assaulted anyone and making clear he does not intend to immediately step down. Instead, he urged authorities to investigate.

“Frankly, we really want any entity with comprehensive investigative power to thoroughly look into these accusations,” Fairfax spokeswoman Lauren Burke said. “There needs to be verification of basic facts about these allegations. It feels like something bigger is going on here.”

Some political observers noted that the threshold to start an impeachment process is remarkably high in the House of Delegates. The lawmakers are set to leave town before February ends, and have limited time and resources to immediately take on the complicated issue.

Still, “a clear sign of the depth of LG Fairfax’s political crisis is the near-absence of voices in Virginia politics this weekend publicly urging him to remain in office,” University of Mary Washington political science professor Stephen Farnsworth said in an email.

If the Legislature is in session, the House would need a simple majority to vote to impeach Fairfax, said A.E. Dick Howard, a University of Virginia law professor. The Senate would then review evidence and hear testimony. That chamber would need a two-thirds vote to convict among senators who are present.

Another possibility: Fairfax simply hangs on as he disputes the allegations.

“Before Donald Trump, I would say with this kind of stuff, it’s impossible for a person to just hang on, put their head down and ignore it,” said Quentin Kidd, a political science professor at Christopher Newport University. “Post-Donald Trump, I think what elected officials are willing to do has changed in some ways. So can he hang on? Certainly he can hang on.”

If Fairfax were to leave, it’s unclear who could replace him. Northam may try to appoint a Democrat, while Republicans could mount a legal challenge with the goal of getting Senate Pro Tem Steve Newman to serve as both a voting senator and temporary lieutenant governor.

The attorney general’s future also remains in question. Herring, who would become governor if both Northam and Fairfax leave office, initially made a forceful call for Northam to step down, but then he too acknowledged wearing blackface at a party in 1980. Herring has apologized but has not indicated he would resign.

Asked Sunday for his opinion on his subordinates, Northam told CBS it’s up to them to decide whether they want to stay. He said he supports Fairfax’s call for an investigation into the sexual assault allegations. Of Herring, he said that “just like me, he has grown.”

Northam’s pledge Sunday to work on healing Virginia’s racial divide was his second in as many days. In his first interview since the scandal erupted, he told The Washington Post on Saturday that the uproar has pushed him to confront the state’s deep and lingering divisions, as well as his own insensitivity. But he said that reflection has convinced him that, by remaining in office, he can work to resolve them.

“It’s obvious from what happened this week that we still have a lot of work to do,” Northam said. “There are still some very deep wounds in Virginia, and especially in the area of equity.”

Finley reported from Norfolk, Virginia. Contributing to this report were Associated Press reporters Steve Helber in Chilhowie, Virginia; David McFadden in Baltimore; and Julie Pace and Michael Biesecker in Washington.