Maybe have it installed, but restrict it from the browsers using it? Seems some of those add-ons for browsers can be set to never run, or run only if you OK it.

I think the chances of malware hitting your machine thru LibreOffice or OpenOffice are far less than something your browser gets tangled up with. Just be careful what you open as an attachment in emails!