I would very much like to get a picture of velvet, or oodinium as it is more commonly referred to in the marine hobby, but apparently pictures are scarce.
However, from your discription, I can assure you that it is not oodinium. oodinium does not come and go, and when it becomes visible fish die shortly thereafter.
Could it be ich?