.
Have a look at the Circle of confusion diagram near the top of Understanding Depth of Field. If the lens were larger the light rays would be converging even more strongly and so the focus error represented by the circle of confusion would be reached even more quickly for objects not at the plane of optimal focus.