Like most things, the sooner you treat the better but I think you will be ok. Don't worry about the palys causing chaos in the tank.
In December, I had a tank totally full of the palys, litterally ripped the live rock out (all covered in the palys) stuffed it into totes, moved the tank, readded the rock trying to get as much as I could back into the same positions, and refilled the tank. I added back the fish and ran carbon and had zero issues.
When I say tear stuff out of the tank, I mean it, I had them growing and connecting the live rock, all over the glass, overflows, powerheads, everything. I was in a hurry because of the weather so this was a pretty barberic move. I ran carbon (I always do) and had zero issues and zero losses. This tank is already back to it's previous state. They grow incredibly fast. I can't believe how many I ripped off the glass and equipment and threw away and the tank is again filled.