Deckard, in your situation you ARE probably better off leaving your water conditions where they are. Your fish have obviously acclimatised to it, and because your water quality is otherwise good and you must be doing everything right maintaining your tanks. So your fish are doing well, inspite of one parameter not being ideal.
I agree with you that the stable pH and hardness that you maintain is better than trying unsuccessfully to change it and having it crash and rollercoaster all over the scale. Trying to maintain a tank at Amazon conditions with your tap water would be difficult, and unless you got it EXACTLY right, your fish would be far worse off than what they have now.
But in my tank I have VERY soft water and a big piece of lime would play havoc with the pH. I just do large water changes to keep my tanks near tap water parameters and so keep the water conditions stable that way. The 'books' say guppys prefer pH 7-8, medium hardness and a bit of salt. Yet I'm overrun with them in my 'wrong' water

But thats because they have acclimitised to it and everything else is good.
So yes it does depend on where in the world you are.
But there are 2 scenarios. The OP has hard alkaline water - in which case the limetone has no effect. OR the OP has soft acid water, and it will affect his parameters, and not in a good way.
Safest to get an inert rock that has no effect on either tank
Cheers
Ian