It could be a few things. Need a pic to really identify it.
It could be hydroids which are like mini jellyfish
It could be copepods that are moving around everywhere
It could be fan worm tubes if they are hard and calcareous
A pic would be best for identification, or maybe even a really good description...