You've got a cycling problem given those nitrite and ammonia readings. Any disturbance to the bacteria in your tank should be avoided. DO NOT remove the gravel. Ammonia and nitrite essentially block your fish from being able to breathe... you want to put as much oxygen into the water as possible, which I can see you are doing. This will promote both the fish getting the oxygen it needs and the bacteria in the tank getting the oxygen they need. Prime and time is the solution after that.
Good job
tlindsey