A GFCI is a must especially if you are using a groud probe. Once you install a ground probe you have provided a definite path to ground, which increases the chance of electrocution.
everything is left on. and i reach in just to mess with the hermit crabs in my saltwater puffer tank... which by the way is also my biggest stocking risk iv ever taken. and it was successful.