In a statement, the hospital called the incident, which occurred after doctors declared one of the twins stillborn, "rare."

"We are shaken and concerned at this rare incident. We have initiated a detailed inquiry, pending which, the concerned doctor has been asked to proceed on leave immediately. We are in constant touch with the parents and are providing all the support needed," the statement said.

Family members said it was unclear whether the baby would survive.

Meanwhile, State Health Minister Satyendar Jain called the incident "unacceptable" on Twitter and told reporters the hospital's license would be revoked should a probe find them liable in the mistake.