The outputs are different because geometry updates the layout (stock margins) in addition to the page size. In contrast, loading a document class like article with a4paper only changes the paper dimensions. See Default margins for geometry package.