It won't necessarily kill them, it's just that feeding nothing but meaty foods isn't a very balanced diet for a fish that is naturally omnivorous. Depends what kind of fish you're talking about.
Feed small varied meals. That's the key. Too much proteins and less fiber will certainly cause bloating that can damage your fish's digestive system. The shrimps though may not be an issue as it helps push out the excess foods clogging the system similarly what the peas do.
What are the fibre food that can be fed to fish? Is pea one of it?
What if I feed a mixed variety of pellets & include shrimps & bloodworms in their daily diet? Does this work out?