Which tele-zoom: VR vs f/4

Just got a 70-300VR for travelling, but the more I think about it maybe I should take my old lens (Nikon 70-200mm f/4). My old lens is shorter (obviously) and doesn't have VR, but on the other hand it's quicker over the whole range.

Taking a tripod is not really an option, although I could be persuaded to take a monopod maybe. I'd appreciate any input or advice you guys have for me