Didn't go there on my honeymoon, but Sandyground Estates in the BVI was fantastic. There are 9 houses that are rented out. 30 minute boat ride to Virgin Gorda and St. Thomas. Secluded, it's on a very small island. Power goes out at 11 PM. Rain water used for the shower, etc. Showers are open aired, just walls. Private beach. Very, very romantic.
Bob