Fresh Debian Install w/o Exim?

I haven't used Debian in about a year or so. I have been so busy with Arch Linux and finally installed it today. I got everything up and working fine however I had an issue with installing useless packages by default on my server.

For starters I did a 'netinst' to make sure I only get the latest package versions from the start. I don't want to have to do a long upgrade after installing. Secondly, I de-delected every package option during the install. It defaults to install two options in the installer menu, "Desktop Environment" & "Standard System". Both were de-selected from installing so pretty much I would get the most minimalistic install possible.

Once my system booted up fine, I noticed that Exim4 was starting in the services start up section. I then said I would simply remove it.

Code:

apt-get remove --purge exim4

Now this removes it however I am left with tons of orphaned config files, user / group accounts, and everything else from Exim on my new clean system. I don't want to have to remove applications I didn't want or need from a newly installed system.