You mentioned three
The other three are when it was destroyed in Ragnarok from the collision of multiple Uru weapons, when Molecule Man vaporized it, and when it was destroyed from the powerful blast Thor used on a celestial

The Destroyer has actually broken it twice. He created cracks with his force-bolts, then broke it over Thor's chest.