Well, you are right, those fish shouldn't be in there yet. How far through the cycle are you? How long have the fish been in there? It may be best to leave it be until fully cycled, don't add anything else and then do it, unless you have a safe place for the fish. 20lbs of lr is not much for cycling but maybe the fish helped out with the cycle. Did your ammonia peak? What are your water readings on amm, nitrites and nitrates?