Next time when you feed him, put a couple grass shrimp in and let him take them. Then skewer one and see if he will take it. If he does then offer a small piece of krill or squid. This way you can condition him to it and he may take off from there.
I have heard that you can use a small net to feed them, but I am not sure how this works.
I don't see it as a bad thing, your feeding him and that is going to keep him healthy. Also try a little garlic, never hurts to keep tring