The Connecticut shoreline is fabulous in the warmer weather for many things. It has fishing, hunting, sailing and views.
We had a cottage there on the water and also boats. I have been out for strippers and caught the blue crabs and cooked them right on our boat.
You can sail to the islands. Fishers Island was always a favorite of ours being remote and unspoiled.