Segal has been married to Marion Segal Freed from 1956 until they divorced in 1981. He later married Linda Rogoff from 1983 until her death in 1996. He is now married to Sonia Schultz Greenbaum since 1996. He has 2 children with Freed.