I really doubt that many fishkeepers have never had a goldfish. They are the quintessential fish of childhood. Most people, once getting more interested in the finer details of aquaria, happen upon the fancy goldfish varieties and give them a go. And, as in your case, one may survive as a feeder. Not a pet fish, but kept nonetheless.
You might find a few people who had parents into fish that knew better, so never got their kid a goldfish. I'd think maybe one in ten thousand fishkeepers have never kept a goldfish. Just a guess.