We actually took the bus from New London (it also stopped in Bridgeport)...very easy and the parking there was about half what it would have been in NY. Left New London at 11:30...at the pier by 2:30. It was just as easy coming home...and there were 4 of us and the bus was included.
Have fun!