He became interested in physics at an early age. In 1883 the Aurora borealis happened to be visible in the Netherlands. Zeeman, then a student at the high school in Zierikzee, made a drawing and description of the phenomenon and submitted it to Nature, where it was published. The editor praised "the careful observations of Professor Zeeman from his observatory in Zonnemaire".

After finishing high school in 1883 he went to Delft for supplementary education in classical languages, then a requirement for admission to University. He stayed at the home of Dr J.W. Lely, co-principal of the gymnasium and brother of Cornelis Lely, who was responsible for the concept and realization of the Zuiderzee Works. While in Delft, he first met Heike Kamerlingh Onnes, who was to become his thesis adviser.

After Zeeman passed the qualification exams in 1885, he studied physics at the University of Leiden under Kamerlingh Onnes and Hendrik Lorentz. In 1890, even before finishing his thesis, he became Lorentz's assistant. This allowed him to participate in a research programme on the Kerr effect. In 1893 he submitted his doctoral thesis on the Kerr effect,[8] the reflection of polarized light on a magnetized surface. After obtaining his doctorate he went for half a year to Friedrich Kohlrausch's institute in Strasbourg. In 1895, after returning from Strasbourg, Zeeman became Privatdozent in mathematics and physics in Leiden. The same year he married Johanna Elisabeth Lebret (1873–1962); they had three daughters and one son.[9][10][11][12]

In 1896, three years after submitting his thesis on the Kerr effect, he disobeyed the direct orders of his supervisor and used laboratory equipment to measure the splitting of spectral lines by a strong magnetic field. He was fired for his efforts,[14][verification needed] but he was later vindicated: he won the 1902 Nobel Prize in Physics for the discovery of what has now become known as the Zeeman effect. As an extension of his thesis research, he began investigating the effect of magnetic fields on a light source. He discovered that a spectral line is split into several components in the presence of a magnetic field. Lorentz first heard about Zeeman's observations on Saturday 31 October 1896 at the meeting of the Royal Netherlands Academy of Arts and Sciences in Amsterdam, where these results were communicated by Kamerlingh Onnes. The next Monday, Lorentz called Zeeman into his office and presented him with an explanation of his observations, based on Lorentz's theory of electromagnetic radiation.

The importance of Zeeman's discovery soon became apparent. It confirmed Lorentz's prediction about the polarization of light emitted in the presence of a magnetic field. Thanks to Zeeman's work it became clear that the oscillating particles that according to Lorentz were the source of light emission were negatively charged, and were a thousandfold lighter than the hydrogen atom. This conclusion was reached well before Thomson's discovery of the electron. The Zeeman effect thus became an important tool for elucidating the structure of the atom.

Because of his discovery, Zeeman was offered a position as lecturer in Amsterdam in 1897. In 1900 this was followed by his promotion to professor of physics at the University of Amsterdam. In 1902, together with his former mentor Lorentz, he received the Nobel Prize for Physics for the discovery of the Zeeman effect. Five years later, in 1908, he succeeded Van der Waals as full professor and Director of the Physics Institute in Amsterdam.

In 1918 he published "Some experiments on gravitation: The ratio of mass to weight for crystals and radioactive substances" in the Proceedings of the Koninklijke Nederlandse Akademie van Wetenschappen, experimentally confirming the equivalence principle with regard to gravitational and inertial mass.

A new laboratory built in Amsterdam in 1923 was renamed the Zeeman Laboratory in 1940. This new facility allowed Zeeman to pursue refined investigation of the Zeeman effect. For the remainder of his career he remained interested in research in Magneto-Optics. He also investigated the propagation of light in moving media. This subject became the focus of a renewed interest because of special relativity, and enjoyed keen interest from Lorentz and Einstein. Later in his career he became interested in Mass spectrometry.