We went to the finger lakes. (Central NY) There are little parks for every gorge and waterfall leading into the lakes, boating and swimming, a great historic mansion with gardens (Sonnenberg Gardens) and it's also wine country if that interestests you.
If you go there, you definately want to tackle Watkins Glen early, before your hiking muscles get sore. It's a beautiful, romantic glen, but there is alot of climing to do. Many of the other good places have scenic overlooks so you don't have to wear yourself out to see the sights.
I don't see the point of starting out marriage with a big debt load from an extravagant honeymoon. Unless someone is giving you the trip as a gift, stick to something simple. Each other is the main attraction after all, and that's free!