Moffat loves the mindfuck timey wimey wibbly wobbly paradoxy stuff. I'm sure he could come up with a way to explain the presence of the previous Doctors and their aged appearance if he was so inclined. I think a lot of us would be prepared to meet him half way were he to try.