He was born to Thomas and Edith Brennan in Stockton. He and his brothers, Jack and Tom, grew up in the cities of Eugene, Oakland, Stockton, and Sonora with their mother after their father's passing in 1933.