Well, this is my theory given a lot of the water parameters weren't tested before and only one or two afterwards.
First, when you say "some" bio media, I'm going to assume a little.
Second, given that it was a little, then, I would guess that is what you did wrong. Mature media is the BB on the bio balls, not the bio balls, and when it's moved, a lot of BB comes loose.
When you move the bio balls in the filter or water, a lot of the BB sloughs off into the water or back into the old filter. The BB are useless at that point because they only become active once they have an established surface, not when floating in the water.
The reason seeding with mature media works is because one allows the residual BB on the media to begin growing and expanding onto new media before adding fish. Alternatively one can add an entire mature filter to the new tank which keeps most of the BB in place. Either works. But taking a smaller amount and then tossing a fish in immediately is probably too much too ask.
In short, optimally, either add more BB at the start or allow the BB more time to grow. Imo, what happened is you lost most of the BB off "some" of the transferred media during the handling. Not enough BB was available to handle the bioload.
Glad it eventually worked out, but that's my theory fwiw.