George Takei Obtains a Marriage License

The 71-year-old actor and longtime partner Brad Altman, 54, received a marriage license from the City of West Hollywood on Tuesday morning, becoming one of the first gay Californians to obtain a license since the state Supreme Court overturned a ban on same-sex marriages last month.

"We are first and foremost beyond delighted!" an ecstatic Takei told PEOPLE minutes after he obtained the license. "It's a landmark day."

Immediately after obtaining their marriage license, "I started singing 'One Singular Sensation,'" Takei said. "(Brad) said 'I love you' and I looked at him and said, 'I love you.'"

Takei and Altman were the first couple to receive a marriage license from West Hollywood, a city that previously did not issue licenses to gay or straight couples. The wedding will take place at the Japanese American National Museum in Los Angeles.