Plain and simple - the pump that's going down has the benefit of a little friend called gravity helping out and depending on plunbing and the pump itself will probably move close to twice the water it's rated to because of this.
The other pump is pushing uphill, fighting the pressure on the pump as the height increases.
Any 90° bends or changes in direction add friction and head loss on the pump which hurts flow.
Even if somehow you were able to engineer a set of return and drain plumbing that were sized to accommodate the vast differences in flow rates (which is basically impossible) you'd still have the uncontrolled variable that you're most likely dealing with some Chinese made pump and regardless of the brand no two pumps are the same. No matter who makes it, you'll never get two pumps that have an identical output. Things like slime buildup on the impeller, debris on the strainer, even age of the pump will have a significant effect on output.
They'll never balance out. One pump will move more water than the other. In less than an hour the water will overfill either the sump or the display and eventually the system will drain the entire contents of your tank onto the floor, in this case your display will drain more water than the sump can return and you'll lose all of the water in the display until the pump runs dry.
Is there a particular reason you can't drill it? It's really easy. The hardest part would be emptying the tank and laying it on it's side.
I don't like the idea of hang on overflow boxes. There's no substitute for a hole and a bulkhead. I'm sure others will disagree. But I will never use one. Too many things to go wrong.
And lastly if you can't have anything larger than a 10g underneath I'd probably hold off. Conventional HOB filters or cansiters are the way to go. The amount of flow for a 120g would turn a 10g sump into a hurricane. It would almost be too small to really do anything with, and you'd have an almost zero margin for error resulting in water on the floor. When the power is shut off a small amount of water will drain back into the tank, usually from the return pump plumbing. A 10g simply won't be able to accommodate it.
Sorry for the long writeup lol
Sent from my SCH-R950 using MonsterAquariaNetwork App