Had the same thing happen to me a month ago...lost my Africans at 96 degrees. I did the water changes, frozen milk jugs (in plastic bags to avoid any contamination from any labels on the jugs), Alternate the frozen jugs every 3-4 hours. Turn out the lights and take off the top, LOTS OF AIR as the water will hold less oxygen as the temp goes higher. Most fish will die due to lack of oxygen before the heat kills them.....surface agitation and a fan blowing over the surface of the tank.
If you have external canister filters like the Filstar Xp series with the motor at the top, put one in a cooler, fill the cooler about 1/4 -1/3 up with cold water, add crushed ice and frozen 500ml plastic bottles that you get water in. Keep changing this as they melt. This rig will act as a home made "chiller", cooling the water as it goes through the filter.You will need plenty of space in a freezer to constantly rotate all these bottles. I wouldn't put ice directly into the tank unless it was contained in something as it will change your water chemistry.
Whatever you do, don't change the temp too quickly as this will lead to an opening for disease in your fish. Do temp changes slowly. Also, I would not unplug the heater....it will save you if you get the temp too low. Make sure it is set at the correct temp and leave it. It won't come on until it is needed anyhow.
This is what I learned from my experience. All my Africans died while I was at work...but with the above steps I was able to save the Pleco's and Clown Loaches.
Good Luck, and let us know how it all turns out.
Tim