With the exception of George Washington's first term, Inauguration Day has always been on March 4. That date was changed when Amendment 20 was added to the Constitution. Franklin D. Roosevelt was the first President to be sworn-in on January 20.