Prime is all you should be adding. Some people do have ammonia in their tap water, which is difficult to deal with. I would recommend looking into an RO filter.
In the mean time, if it's 5.0 in the tank and 1.0 in the tap, there is another problem. 4.0 ammonia in one week is a huge jump. How heavily is this tank stocked?