I don't use a turret press, mostly because I'm doing fairly low volume reloading. I started with a Lee anniversary starter kit with a Breechlock press, and then upgraded to an RCBS Rock Chucker and have been very happy with it. Make sure your bench is solid. A lube pad is a good investment that doesn't necessarily come with a kit. Not a bad idea to keep some spare decapping pins around.

Are you looking for accuracy or to save money? I'm reloading mainly to get obsolete caliber guns shooting so I tend not to be too picky about dies given the low selection available but generally use full length dies when possible since I usually own more than one gun per caliber. If you want serious rifle accuracy think about neck sizing dies, they'll also extend your brass life but the case will then be specific to the rifle.