May 10 (1877, 1878, or 1879: sources vary)
First White House phone
President Rutherford B. Hayes had the first telephone installed in the White House on May 10. His first call was to Alexander Graham Bell. The only other direct phone line to the White House was at the Greasury Department.
http://www.funtrivia.com/askft/Question1167.html