I've seen my emerald right smack in the middle of the GSP before and knocked him off with a stick! I don't think he was eating them, but wasn't going to take any chances. I think he may have been cleaning out the crap that was in between the polyps.
The hermits have been on there also, but I haven't seen any damage or loss of polyps.