My youngest daughter and I visited St. Mary's By the Sea in Cape May Point earlier this summer. We attended daily Mass on a Monday morning, and I recommend that you too visit for Mass if you have the time. The Mass schedule is not online but I believe they have daily Mass at 8am for the public during the summer (please call and doublecheck). This retirement home reminds me of the Chalfonte in the way it reflects a building from another time in Cape May's history, before modern amenities took over the tourism industry. Definitely worth a visit.
Just be respectful and quiet!