In 1969, Low helped found the Union of Concerned Scientists, and briefly served as its chairman. He stepped down after a disagreement with other members, who refused to consider studying whether nuclear reactors could be made safe and reliable.

In 1980, Low was appointed provost of MIT. During his five-year tenure, he was instrumental in bringing the Whitehead Institute to MIT, and expanded humanities education at the Institute.