Why do wide apertures reduce quality

Here is a real beginner question. We all know that in some cases, wider apertures reduce image quality but exactly why does this happen. Is it because there is a more spread of light being defracted around the lens?