Clean BioFluff/Ball/Beads????


Do you have to clean or rinse BioFLuff/BioBeads/BioBalls every so often?
I understand the premise of using these materials is to increase surface area for good bacteria to grow. SOme like it, some don't.
However, eventually algea or debris will build up in the filter or skimmer and need to be removed.
Will rinsing off the material to get rid of the obvious debris, defeat the purpose of getting bacteria to grow on the this bacteria firmly attached to the media so that simple rinsing will not kill it?
Also, should rinsing be done with tank water or quickly with tap water to clean material of observed debris?
Thanks for the info.