P. Diddy's former right-hand man ... the guy who worked closely with Danity Kane back in the "Making the Band" days ... says their careers were unfairly cut short -- and he LOVES the idea of a rogue reunion.