Took a walk at Bluff Point State Park recently - a great place to ride a bike, too.
You can walk all the way out to the wonderful beach, but be careful swimming, because there are no lifeguards.
You can see the awesome New London lighthouse from the point, one of the few 'high points' along the Connecticut coast.