People aren’t buying the iconic, sprawling mansions in one of America’s richest cities, a haven for Wall Street types an hour from NYC. I spent a day there — here’s what it was like.