I would think that taking out the sponges would be fine, I personally would add a piece of Enkamat pre cut to fit in place of the sponges top and bottom. The Enkamat would work perfectly to stop the pellets from flowing out with the flow but at the same time not plugging up!
