Goggles for regular rides

I did an enduro race a little while back and I wore my mx goggles, I really liked it alot and was wondering if it would be weird wearing them for everyday riding(AM). Basically I would wear sunglasses on everything but down hill sections, that's where I would just pull out my goggles from my camel pack. Would that look pretty goofy?Should I just stick to sunglasses and only use goggles for races?