We recently learned that the US Coast Guard Training Center in Cape May, NJ has a small campground and recreation area. Only tents and pop-up campers are allowed, but the location is on the coast. We've added the information on the TRACEN Cape May Campground to the website.

You can see information, maps, and photos here.