With out pics it is hard to tell, but I had something similar from you description and it never became a problem, I actually think my fish ate the stuff, it is no longer present in my tank. If you are concerned about it, I would do as earlybird suggested with scrubbing and rinsing with salt water, you may have to do that more than once though. Try and post some pics, maybe we can help you more.