Minor to major sickness up to death. That said I continue to read that true palytoxin does not come on the coral we have available from the trade. The bigger risk is the various and many bacteria that are part of the closed systems we keep.
Gloves are definitely recommended whenever going into the tank. When fragging gloves, dust masks, goggles are also the safest bet.