Goldfish are serious pigs and will try to eat anything even if it isn't food. I don't even use substrate in my tank since they like to forage and it wasn't uncommon for them to get rocks stuck in their mouths that I would have to pluck out using tweezers.