Its not bad, just may be unsightly for you. A single Mexican turbo snail will help you would with that. Don't get more because they will likely starve.
You mention anemones popping up? Are these aiptasia ? If so, these are not good to have in the tank.
