IMO, no matter how much you clean off the debris/pebbles off of your DSB, it will always be there eventually. Especially if you have a cleaner crew.
They will break off pieces from LR trying to find food and such.
I tried picking them up at first but I became lazy and basically accepted it.
But, its your choice.