anemones are not for noobs. i'm not saying you are one, but if you think you might be then don't get one as it will die.
You need strong lighting and perfect water to keep them happy.
unless your clown starts gasping for air at the surface, or stops eating or attacks other fish then i would not be concerned. it sounds like he wants to redecorate his home and does not like a home invader sticking his hand in the tank.