How long can you hold your breath?
J/K
MY rule of thumb is that die off begins after I cannot hold my breath any longer from the point I took it out of water.
Quickly.
Sponges can die as soon as they are exposed to air (well, the air dooms them anyway).
There is no rule of thumb, but I'd seriously worry after 30 minutes or so and prepare to cure it.