UH OH,
Your last sentence may be your problem!! We saltwataer folks cannot put off our water changes. Replenishing minerals, removing 'gunk' best are handled through regular water changes. I actually do 20% a week. If i have to skip a weekend because I am out of town, I dont worry too much, but my tank always sparkles. Of course the skimmer, powerheads, light feeding and daily attention to what ishappening inside all contribute to that. Siphoning, scrubbing items that can safely be removed from the tank and scrubbed clean, skimming, aeration, and if necessary, chemical fixes after all the rest has been done work well.
When my tank was newer, it went through the brown diatom stage, then green hair algae started. I immediately started larger water changes (with distilled water) added another power head, backed off on feeding. removed all 'dead' items from the tank and scrbbued them clean, then added a phosphate sponge which cleared it all up in a matter of days. oh, I also added 15 turbo grazers and some nassarius snails which helped immensley. I dont know what they live on now as there is not a pice of hair algae or brown stuff in sight. I do have several other 'good' plants growing and thriving in there as well.
Good luck-you may need to put in a late night to do that water change!