James Merrill, one of the 20th centuries great poets, lived in Stonington, Connecticut for forty years. His wonderful two-story apartment was gifted to the town, and now is open on select occasions for the public. Go here to find out more about it.
They also sponsor a writer-in-residence program in which you get to live in the amazing place for a season. Amy thought about applying, but then realized she would have to live away from me (and the cats) for several months. That is not happening. But for those young, unattached writers out there, I can't think of a more inspiring place to work.