Update.
I never was able to completely remove this problem. It did get really small after some time but once I gave him food on Sundays it came back out... I had to remove him back to his 100g tank for the holiday's. Im not sure what I should do next. Longer no feeding time and maybe soak his food in Epson salt?