Leaving Judo

I broke my neck a couple years ago, and it just can't take the constant throwing. So I'm thinking about making the move to BJJ. The thing is, I love Judo. My ego is telling me not to move, it says that it doesn't matter that I can't move my neck for two days after practice. My mind is telling me that I'm being ridiculous and that I'm going to be sorry when I'm older.

I think your ego will be plenty satisfied by the no blows to it, it will take doing BJJ.
Honestly if you like Ne Waza you will be fine except on days where you are working the clock or bow and arrow choke those days will suck for your neck big time.

Understand just how you feel. Damaged my C6 and C7 in a tournament as a Yellow Belt. Various other injuries and surgeries have interupted training, but I still roll today at 61. The neck is worse and I have to take precautions, but it works for me. If you really love judo, stick with it, with precautions.