I would not expect much difference, but that may also depend on other users of GPU memory. For example, Premiere may also use GPU to accelerate its processing, and in that case it is best to have more memory, because shortage of available GPU memory may cause a slowdown.