I have a nice rock with only about 12 worms. As I have experienced and read, the key is giving the coral enough light and giving the filter feeding worms enough phytoplankton or whatever you feed your filter feeders. Mine has done very well. My coral has expanded covering even more of the rock and I have a new worms growing.
Good luck!
Connie