The only other theory I can think of is that my pot scrubbers aren't suitable for aquarium use? I saw two different packages at the store one specifically said not for aquarium use and the one I bought didn't mention it. Even then I have a whole tray filled with bioballs and ceramic rings.
Replace those with seachem matrix and add the crush coral