Yes, you're probably right. You could either take it out, which would suck after you've done some work to get it in there, or just keep cleaning it off -- eventually, it'll stop. Keep an eye on Ammonia and Nitrite levels for any spike above zero, and on the Nitrate level -- if it starts rising, and you're still doing the same work you used to do to keep it low, then the wood might be rotting.