Leather corals are not mobile as anemones. At my LFS, a toadstool in their reef tank has grown to easily 18 inches tall, and a few months ago a maroon clown was very happy swimming in it.
My clowns fell in love with my bubble coral, actually, pretty surprising. The bubble did not exhibit any signs of disturbance either.