What exactly is the nitrite reading? It is reading past 5.0 (the highest reading on the nitrite card)? They would show signs at that point, actually long before. Nitrite is not as toxic as ammonia, some will argue that it isn't at all, but it does stress them. I had a nitrite issue when my tank was new. That was when I joined this site. No one could figure out why. I did a lot of research on it. Nitrite does effect the fish. It makes their blood flow faster and puts the fish into fight or flight mode. They can get different symptoms from heavy breathing to heart failure or brain damage. Take a water sample to your LFS and have it checked.
How long has this tank been set up? How long was it set up before you added fish? How did you cycle it? My nitrite issue was the result of a soft cycle and then adding too many fish too quickly. My ammonia had been at zero for months before the nitrite spike occurred. When it did, I battled it for a couple of months. I was doing daily water changes and using large amounts of Amquel plus to reduce it. It hovered at 1ppm for the longest time. I lost several fish. It finally cycled through. The bacteria that breaks down nitrite takes time to establish. If you bought live sand in a sealed bag, such as what you may find at a *****, then it was only live in bacteria cultures. It would not be able to break down nitrite. That bacteria has to colonize in the tank. It takes time.
Take a sample to your LFS, see if your reading is accurate. Post how long this tank has been set up, how it was cycled, and when you added fish.