Caesar was born on September 8, 1922 in Yonkers, New York. He was of Polish-Russian-Jewish descent.[2][3] Caesar was married to Florence Levy from 1943 until her death in 2010. They had three children.