First of all you should give us a little better info on the Goldfishs' Environment his tank.
Like: PH
Temperature
What Do u Feed
Size Tank
Other inhabitants
All the other answers are good, your problem could be from temperature, feed, diseases or a tumor to which goldfish are common for.
Give us more info.