The congregation worshipped in a building at the intersection of Congress and St. Antoine streets in Detroit from its founding until 1877, when on the same site, it erected an elaborate Moorish Revival edifice with tall, twin towers topped with Onion domes. It was the first purpose-built synagogue in the Detroit area and the first of no fewer than five synagogue buildings that the congregation would build within the space of a century. In 1903, the members having moved to a more fashionable neighborhood northeast of downtown, the congregation erected a new structure topped with an octagonal dome at the intersection of Winder and Brush streets. In 1913, Shaarey Zedek again followed its increasingly prosperous congregants north and moved into a spacious, new, domed Neo-classical synagogue building at Willis and Brush street where it would remain until 1930, when it moved to rented quarters. In 1932, the congregation again followed the movement of the congregants to a more suburban location on the city's northwest side, completed yet another new building. It was a Romanesque Revival sanctuary at 2900 West Chicago Boulevard at Lawton Street, designed by the noted architect Albert Kahn.[2][5] The building is now the home of the Clinton Street Greater Bethlehem Temple Church. The congregation moved to its present building on Bell Road in suburban Southfield in 1962.[1][4]

The congregation's present, Southfield building was designed by Percival Goodman. Henry Stoltzman writes that it "embod(ies) Goodman's work at the peak of his career."[4] The San Francisco Examiner named the building one of the "top 10 breathtaking places of worship" in the United States. Jamie Sperti, a writer on The Examiner website called the congregation's dramatic concrete building a "phenomenal example of 1960’s futuristic architecture" in her survey of The United States' top 10 breathtaking places of workship published April 9, 2009. New York Times architecture critic Philip Nobel described it as a "roadside attraction" that "parlays a skyscraping Ark and an erupting eternal flame into a concrete Sinai on the shoulder of Interstate 696".[6]

In the early 1990s, Congregation Shaarey Zedek merged with Congregation B'nai Israel of West Bloomfield, the combined congregations worship in both locations.[2]