Hidden removes the caption and the line used by the caption below pictures. That’s when the caption is text on a separate line.

However, when the caption is in a text box (for Shapes, WordArt etc.) the caption isn’t visible but the space used by the caption text box is still used. The result is a blank space above/below the object.