how to avoid audio clicks for fast sample playback changes ?

I made a very simple samplerLooper for max4live.
it uses [grooveduck] to play loop with a nice crossfade, so I don’t get looping clicks but I do have some click when I change the loop start or end point via a wiimote or just with a fast mouse move.
I don’t think it is Live’s fault but something wrong in my MSP flow.