Late Blooming Limes

I have a lime tree with 6 ready to pick limes. Just recently the tree has filled up with new limes about the size of a quarter. Is this common? Should I let them take their course? Should I fertilize now for next year or wait?