It's a big risk I agree. I have removed 2 silvers out of there and so far the big red doesnt seen to be bothered by the silver in there anymore. The smaller red suffered abit of split fin but not much biggy since she's very willing to take some worms I throw in moments ago.
As for the gigas, they will be shifted to a much bigger pond soon.