That sounds like a great idea! There will not be any residual config files to waste the desktop! The last two KDE editions were fine until I removed the residual config files,(I lost the whole Mint configured desktop both times.)

Starting with the Ubuntu minimal install should make for a very stable system!