Detritus takes a long time to break down, but it does break down eventually in sand or CC beds. Critter eat some types of detritus, then just turn around and poop the rest out. Worms are pretty good at consuming a lot of it, but they poop too.
Most say that CC traps detritus, and it does. But...