This depends on what difficulty level you have set to play the game at. The harder levels allow for fewer elite workers (priests, scribes, overseers, commanders) in total. I forget the exact numbers but I believe the easier levels allow for a prestige rating of 35 or more. I haven't played the game at the easier levels in a very long time so I don't recall the numbers for them.