That will cause all the particles to stick to each other, and possibly slow the flow of your filter sooner. I personally don't use that.
What water conditioner are you using? Sometimes the reaction of a certain brand of water conditioner will react with the tap water, causing haziness.