What kind of filter. If it's a wet/dry and the growth is developing above the water line, chances are it's mold. Wipe it off and spray the area with a spray bottle filled with water and a heavy dose of salt. The salt will dry everything out overnight and you can wipe the crystalline salt off with a damp paper towel the following day. It won't stop mold completely since spores will be in the room's air. But, it will slow down its return.
A more permanent solution would be to spray the affected area with aqueous copper sulfate or chelated copper sulfate. But, unless you're well aquainted with its use, Don't do it. It can harm fish, herps, all inverts, and some people sensitive to copper solutions.