Wii Pointer Going Crazy!

Right guys, I have my Wii remote and everything like a normal person. Now on the odd day or so the pointer goes really spazzy and flies all over the place when I point at the screen on CoD:WaW but on the Wii Menu it'll be fine.

A few days will probably pass and it'll be working fine again, does anyone know why it does this?