Surprised it took so long for someone to bring up a GFCI....
As many have said, the effects of stray voltage are speculative. I do know that if you have stray voltage and you connect a grounding probe it will turn into stray current, and in general currents are more harmful than voltages.
Re: Randy's post, bad side of having the probe to conduct is that it may well trip while you're gone, leaving the tank and equipment off. Any GFCI you use for a tank should trip at 5 mA, Far below the current needed to injure. The one case where they won't help is if you have an isolation transformer, such as a ballast for fluorescent lights.
Of the two, I would argue a GFCI is more important. If you have a grounding probe and no GFCI, you could be running a couple amps through the probe and never know it until the probe gets pulled out of the water while your hand is in.