What might affect a magnet’s strength?

The factors can affect a magnet’s strength:

Heat

Radiation

Strong electrical currents in close proximity to the magnet

Other magnets in close proximity to the magnet

(Neo magnets will corrode in high humidity environments unless they have a protective coating.)
Shock and vibration do not affect modern magnet materials, unless sufficient to physically damage the material.