As long as you dont have "heavy diggers" like myself (Reddevil/Midevils)and you use prefilters you should be fine. I have actually SEEN my devils/Midas/Bleekeri take sand & gravel straight to the intake of a filter they don't particularly seem to "like" and spit it RIGHT IN THE INTAKE!!!
Some fish are just EVIL!!! My fix (before I switched back to gravel 2 years ago) was prefilters, and even with gravel I still use prefilters on all my intakes as gravel can also make it to the impeller sometimes.
My fish STILL have a habit of piling gravel on top of the prefilters(even my Geophagus Brassilianis) to this day! They are honestly trying to WRECK my filters.
Heck, they even sometimes bite chunks out of the prefilter sponges, or pull them off (my 8' black diamond/bleekeri is the WORST) no matter whether reticulated foam or fine foam. Ughhhh, sometimes this dang hobby...LOL