It varies between crossbreeds.
What happens during any sort of breeding, is that each parent donates a set of chromosomes to the child. In closely related parents (i.e. individuals of a species), the chromosomes align pretty much perfectly.
In interspecies breeding, you can imagine that of course the parents will have very different genomes, and so when you crossbreed you'll get two (possibly very) different sets of chromosomes aligning together. It's all up to chance, and how well the two sets happen to align.
In most cases there will be sections of one set that does not align at all to the other set, and vice versa.
Basically this, imagine one set is ABCDEFGH, whilst the other is ABCGH. Obviously there's a huge chunk in the former set that is not present in the latter set, and what occurs depends on what genes this section represents specifically.
Especially for sex chromosomes, this have a huge effect as a male relies heavily on its Y (or the equivalent in fish) chromosome working, and so just a small discordance and the function would be completely off, rendering the male infertile. In the female it has XX (or the equivalent), so even though it's two different X from two different species, if anythig does go wrong for one X there is a higher chance that fertility is 'rescued' by the other X.
Back-crossing 'saves' sterility because of this:
So say one species is T, the other is H. Let's call the female sex chromosomes of the offspring XT/XH. And let the father be the H and the mother be the T.
When you backcross the offspring to the father, there's a chance of maintaining the XH and also obtaining a XH or YH fromthe father, and the XH/XH or XH/YH offspring will have (almost) perfectly aligned chromosomes, as these chromosomes now are 'from the same species'. Same with the opposite backcross.
Hence that's why sterility can be 'saved' by backcrossing.
Sorry if that didn't make too much sense, writing on phone whilst Im really hungry. >.<" But yeah, more or less as above.