"The party has taken one-sided action against me and other MPs without giving them an opportunity to explain their position. This is against the party's rules. As per the party's constitution, it should serve the member a showcause notice before taking a decision to expel him," Singh said.

"It seems after losing the confidence vote, the party has lost its cool and taking ex-party actions against its own MPs," Singh said, while informing that he would join Uma Bharti's Bhartiya Janshakti Party soon.

He also alleged that Madhya Pradesh Chief Minister Shivraj Singh Chouhan was overlooking his area's genuine demands and revealed that he had resigned from the party two months ago by submitting his papers to the Leader of Opposition in Lok Sabha, L K Advani, in protest.

However, Advani assured him that the matter would be discussed with Chouhan and asked him to continue, but nothing happened even after that, Singh said.

"The chief minister has not even bothered to respond to my letters highlighting the problems of the state," alleged the MP.

He also said that he would contact other expelled MPs and ask them to join the Bhartiya Janshakti Party.

Earlier, activists allegedly belonging to the BJP on Thursday went on a rampage at Singh's residence in Delhi.

Over 100 people stormed into the North Avenue residence of the Lok Sabha member from Damoh (Madhya Pradesh) around 11 am, when Singh was present at the house.