I keep hearing New Haven has a bad ...

I keep hearing New Haven has a bad rep for crimes which surprises me. Is that only in certain neighborhood's? I'm starting my residency at the hospital here and want to find a apartment either walking distance or access to public transportation. I'm also a female and worried about my safety.