With the schematic you posted, the output never will be "smooth". Ever. It always will have some ripple. Increasing the size of the capacitor will decrease the ripple amplitude, but it will not - cannot - eliminate it.

your circuit is of a simple "brute force " filter. more capacitance is need for this type. even with a regulator, more filter cap would be needed to prevent the regulator fromj dropping out under load.