The peer at the centre of the Liberal Democrat sexual harassment storm has been suspended from the party.

But Lord Rennard refused to apologise to his accusers and threatened his party with legal action.

The Lib Dems will now investigate whether he has brought the party into disrepute by refusing to apologise.

‘Nick Clegg made clear last week, and again this morning, that it would be inappropriate for Lord Rennard to resume the Liberal Democrat whip unless he apologises,’ a spokesman said.

‘Lord Rennard has refused to do so… as such, he cannot return to the Liberal Democrat group in the House of Lords.’

After being suspended Lord Rennard, 53, addressed the allegations in public for the first time.

In a 2,600-word statement detailing his ‘enormous distress’, he told how he and his wife, Ann, were forced ‘into hiding’ as he endured a ‘humiliating trial by media’ amid a ‘lynch mob mentality’.

The peer, who ran the party for many years, described his turmoil when ‘personal’ allegations arose during the 2010 election campaign.

He wrote: ‘The depth of depression that I felt and the consideration of self harm is difficult to describe so I will not do so.

‘If ever I have hurt, embarrassed or upset anyone, then it would never have been my intention and, of course, I regret they may have felt any hurt, embarrassment or upset. But for the reasons given, I will not offer an apology to the four women complainants.’

Lord Rennard will still be able to attend parliament and vote in Lords debates as an independent peer.