Too fast is a rate which rips BB from the media. Too slow is a rate where fish suffer harm from the presence of nitrogen (ammonia, nitrite.)
The calculations of this are far too complex for most people to be worried about.
For example, you would want take into account:
1) temperature and oxygen levels
2) the peak amount of protein fed per volume of water over a 6-8 hour interval (to derive short term ammonia peaks)
3) the amount of ammonia per volume of water over a long term (4 or more days)
4) the pH level
5) the size and efficacy of the bio filter
6) the specific species and it's resistance to nitrogen poisoning, including it's size and age
7) other medical conditions of the inhabitants
8) other mitigating protein reducing conditions (e.g., plants, skimmers, drip or continuous water replacement systems)
On a practical basis, people have kept fish in planted tanks with total turnover rates below 1 gallon per hour. Most tanks are too crowded to permit such low rates. People with relatively large bio loads that feed large amounts of high protein foods infrequently (every few days) are more likely to need rapid turnovers than people with relatively low bio loads that feed small amounts of low protein foods on a daily basis. But still, that's quite a generalization.