If his fins are down then something is wrong. Actually, now that I think about it, his fins would be up if he was being harassed. They have a blade and are not afraid to use it. Is he the only fish that has clamped fins? Have you checked him over for white spots or any redness?