First: Which settler Version?
Second: Most maps in S4/S3 are singleplayer. The number of players refers to the number of parties in the map and all but your own party are controlled by the computer. Thus you play against numerous parties of the computer.