A native of Iuka, Mississippi, Davis relocated to Hamilton, Alabama in 1890 in order to practice law after years of teaching public school in Mississippi. Two years after moving his law practice to Jasper, Alabama, Davis was elected to the Alabama House of Representatives in 1891. In addition to his time in the House, Davis served as a Solicitor of the 14th Judicial Circuit, a Chairman of the Congressional Committee, and a member of the Alabama State Committee.