He married Polly Colyer-Fergusson, daughter of Sir Thomas Colyer-Fergusson,the family who owned Ightham Mote, Sevenoaks. In 1947, he married, secondly, to Bridget, the former Countess of Carlisle (CBE), the wartime head of the ATS counterpart in India, the Women's Army Corps (India), and also of the Women's Royal Indian Naval Service (WRINS). The Viscountess was already a peer in her right, as the 11th Lady Ruthven of Freeland. Her title passed to her son by her previous marriage, the Earl of Carlisle, and not to her stepson, Viscount Monckton.