I love that dress!! Did you try belting it over the sweater? I love a good patriotic combo but I also love navy and kelly green or yellow, a bit more unexpected but still classic! Really, navy is a neutral, pair it with any color you want and it will look great.