Many people living near the abandoned site said they’d rather leave the eyesore standing, which has become a refuge for vandals and squatters, than the city sell the property over fears of more traffic and people.