So is all your media submerged media with small pores plus the spongey stuff you added?
If so, my guess is your actual problem is that most of the media isn't getting much water flow - the water will be making contact with the outside layers of media but barely getting to the innermost...