Snyder's move closes the door to certain benefits reserved solely for married couples. The American Civil Liberties Union said more than 1,000 Michigan laws are tied to marriage. On the federal level, the Justice Department has said it is monitoring the situation.

Four counties - Oakland, Muskegon, Ingham and Washtenaw - took the extraordinary step of granting licenses Saturday before the 6th U.S. Circuit Court of Appeals ordered a temporary halt. The stay was extended indefinitely on Tuesday.

Snyder acknowledged "they had a legal marriage." But because of the court's stay, he added, the gay marriage ban has been restored.

In this March 5, 2013, file photo, April DeBoer, second from left, sits with her adopted daughter Ryanne, 3, left, and Jayne Rowse, fourth from left, and her adopted sons Jacob, 3, middle, and Nolan, 4, right, at their home in Hazel Park, Mich. The two nurses who've been partners for eight years claimed the state's ban on same-sex marriage violated their rights under the U.S. Constitution.

Paul Sancya, AP

The women who brought the 2012 lawsuit, Jayne Rowse and April DeBoer, are raising three adopted children with special needs at their Hazel Park home. But they can't jointly adopt each other's children because that is tied exclusively to marriage in Michigan.

Dana Nessel, an attorney for the two Detroit-area nurses who successfully challenged the ban, said Snyder's position is "really an outrage."

"I think each one of those couples should be furious right now, and I'm very hopeful that those couples will petition the court on their own behalf," Nessel said.

Snyder, a Republican who keeps mostly silent on social issues, had said very little since Friedman made his historic decision last week. Snyder said in a 2010 debate that he supported marriage as "between a man and a woman."

Another Republican, Attorney General Bill Schuette, has aggressively defended the gay marriage ban, which was approved by 59 percent of voters. He said it's his job to oppose challenges to the state constitution.

Snyder said he hasn't had a role in Schuette's legal strategy.

"The attorney general is a separate constitutional officer in our state, and he has the prerogative to make his decisions on that particular issue on his own," the governor said.

Lisa Ulrey and Donna DeMarco were married Saturday at the Oakland County clerk's office.

"I'm shocked, but not surprised," Ulrey said of Snyder's decision.

"Everyone was on such an emotional high on Saturday," she said. "We felt we were on top of the world. I guess we were naive in thinking the government would be on our side."