yeah you'll end up seeing a lot of crap. you can prevent all if not most of the sand from getting into the filter though.
first add water to the tank all the way to the top. Then use a big bowl and scoop up the sand and gently submerge the bowl to the bottom of the tank and gently tip the bowl and let the sand slowly fall out. It is a bit time consuming but worth it.
I've always loved the look of pbass in a tank with black sand and a black background. but thats just me.