"If Trump were ever elected, we'd have to build a wall around California to defend ourselves from the rest of this country," Brown told organizers at a dinner in Sacramento, according to the Sacramento Bee.