I did this on Tuesday. Took out all my fish except 7 large feeder goldfish. Clouded up the tank really badly, but the feeders all lived. Threw the other fish back in there last night and all is well.
I did the same about 2 months ago. Mine actually didn't cloud up that badly at all. I put the fish back in after it had time to settle for maybe an hour.