Ok, so I am not a milk drinker - never have been and VERY rarely will have a lgass of chocolate milk. I do like ice cream, chese and occasionally yougurt. So my question is - since these items are processed do I need to worry about them as much? Or do I even need to worry about them if my baby doesn't show signs of milk allergy?

I'll second the pp and will say no need to worry unless baby shows signs of being intolerant. With DS I had a ton of dairy while nursing and it never bothered him, DD though is dairy intolerant and was in pain (screaming pretty much nonstop) until I cut it out of my diet. She was showing other signs too like mucousy poop, constant runny nose and diaper rashes. All of those signs are now gone but it did take a few weeks.