As long as the clam seems to be "adapting" to it, then I wouldn't be concerned. If the clam seems bothered by it, then it might be time to take out the clownfish. But I constantly see gobies sit directly on clam mantles and the clams couldn't seem to care less. If it is bothered, it will constantly be trying to flip the fish away or open and closing really quick.