Sometimes sand and fine gravel get clumped into the heavy solids making them heavy to siphon. Also a larger gravel vac with a bigger diameter hose will have more siphoning power
x2 that was what I was going to suggest how wide is the hose your useing?... sounds like you should go wider. Syphoning is a fine art... practice practice practice..