Nitrite (NO2) is toxic to fish, along with ammonia. While your ammonia certainly isn't off the charts, that is still high IMO, and is bad for your fish. It can quickly lead to things like gill curl, fin rot, etc.
It is clear that your tank is not cycled. With both nitrite and ammonia levels being high, I would be worried about this. If you can get your hands on some filter media from an established tank, or anything from an established tank for that matter, it would help to accelerate the cycle.
EDIT: If you are unsure what I mean by "cycled," I am referring to the nitrogen cycle. There are stickies on cycling tanks if you need more info.