We study a stochastic spatial model of biological competition in which two species have the same birth and death rates, but different diffusion constants. In the absence of this difference, the model can be considered as an off-lattice version of the voter model and presents similar coarsening properties. We show that even a relative difference in diffusivity on the order of a few percent may lead to a strong bias in the coarsening process favoring the more agile species. We theoretically quantify this selective advantage and present analytical formulas for the average growth of the fastest species and its fixation probability.