I always scrubbed and washed mine.
Most rocks are ok. Avoid loose or crumbly sedimentary rocks. They can deteriorate and change ph
Sparkly rocks like pyrite aren't good.
Rust or iron oxide is fairly harmless, however any iron in the rock that has the potential to go through the oxidation process while in the tank is bad.
Sent from my SCH-R950 using MonsterAquariaNetwork App