They do, I lost all the air in my shock once because it didnt have a valve cap and some gritty mud got in there and somehow opened the valve.
Just screw the valve tight when you've finished with the pump!