Can't keep apps turned off

There are preinstalled apps I know I can't get rid of altogether, but even when I clear cache and data, turn them off, and remove the auto update they keep turning back on and installing updates. How do I stop this infuriating behavior?