I do. Not as a staple diet. It's loaded with too much fats and proteins. It's good though once in awhile. Be careful where you source it. As long as it is not riddled with pesticides, it's fine.
I used to feed my fish earthworms. They loved them. Just make sure that your souce dont have any pesticides. I would see them crawling across the ground at my apartment but never used those because I'm not sure if the gardeners used pesticides. I would use ones I purchased from a bait shop. They are pretty easy to grow in a colony and it dont take much maintenance or space. Google it.