The healthy baby, who was born in Cedars Sinai Medical Center in Los Angeles, has a 5-year-old sister, Nahla, Berry's daughter with ex-boyfriend Gabriel Aubry.

A source at the hospital told PEOPLE on Saturday night, "Olivier hasn't left Halle's side. Nahla visited her baby brother earlier today." On Sunday, the big sister was seen happily skipping and prancing in the corridor of the maternity floor.