You should set the GPU client cores to High priority to make sure they don't get starved for CPU cycles. You can follow the guide I linked you to in an earlier post of mine in order to set up a program that will automatically assign the priorities.