My guess about the hat is that its something from Africa, hes a doctor and would often go to Africa months at a time to help tribes out and sometimes they gave him gifts. So maybe that's where the hat is from.

My deleted comment is me replying the same thing to myself because I'm an idiot.