After World War II, several government departments used the building as offices, including the Rating and Valuation Department, starting in 1965. The building was believed to be haunted and was officially exorcised twice by the government.

In 1982, the historical landmark was dismantled to yield to the new Bank of China Tower. Over 3,000 building blocks were labelled and catalogued for future restoration. In 1990, the Housing Department proposed the resurrection of the building in Stanley. The building was restored in 2001 and reopened in 2002.