Joshua married Elizabeth Cleaver, daughter of Peter Cleaver and Miriam Frazer, on 25 Apr 1782 in Warrington Meeeting House, Warrington, Washington Township, York County, Pennsylvania. (Elizabeth Cleaver was born on 1 Apr 1757 in Upper Dublin, Philadelphia County, Pennsylvania, United States, died on 11 Feb 1841 in Warrington, York, Pennsylvania, United States and was buried in Warrington Friends Meeting House Cemetery, Wellsville, York County, Pennsylvania.)