I think they go with practically anything, but look best with some nicely fitted trousers/chinos. Really these can be dressed up or down: wear a shirt and blazer for a more formal look, or a printed shirt or polo for something slightly more casual.

They look great with all the items you mentioned. A striped tee-shirt (preferably crew neck) would also look great for a casual look. Perhaps wear a printed shirt with your blue chinos, roll the hems, and go sockless for a laid back Italian Riviera look.