Clownfish can host a number of organisms. Mushrooms, to GSP, to alot of things. Clowns host aggressively sometimes, and might hurt the coral. For the most part, clowns choose what they want to host. And generally speaking, the host usually is larger than the fish.
Plenty of people have clowns that have chosen to host things other than anemones, and have had no problems at all.