Richard James was born in Woolwich, England in 1796. He joined the British Army and served in England and India. While in India, Richard was assigned to the Benevolent Orphan’s Society, an organization run by the British Army.

Around 1829, Richard married Mary Lomax, the daughter of a merchant in the London, England area.

Thomas James, Richard’s older brother and a retired military officer, settled in the Bridgetown area. Around 1834, Richard and his family also moved to this area. Richard and Mary had eight children. In 1835 James built a house on Queen Street on land purchased from Thomas Quirk.

After his wife’s passing in 1846, Richard brought his sister, Eliza, from England to assist with his family. Angelina, the James’ youngest daughter, and Eliza continued to live in the James House. Angelina died in 1922.