Jane was the daughter of Herbert Hamilton (1895-1967) and Willie Mae Leatherwood Hamilton (1894-1983). In June 1940, she married Carl Atwood Elliott, Sr., who would later become a U.S. Congressman. The couple had 4 children.