IMO the cause of the stray voltage (whether inducted or otherwise) should be investigated and solved. And every electrical outlet anywhere near water should be GFCI protected. I'm not an electrician or GC, but I'm pretty sure that's probably according to code. I personally prefer GFCI outlets as opposed to GFCI circuit breaker. I used to have the breaker setup, but it tripped one day due to faulty powerhead (for which I am thankful)....but it also shut off everything on that circuit, what happened to be a dedicated circuit for my whole tank. Not good.....lesson learned. So I went thru and replaced that with GFCI outlets instead.
Not only for your personal protection (and protection of any family member who might stick a hand in your tank....like a child), but I also remember reading somewhere that stray current in your tank can stress fish and that can lead to various diseases. I believe a couple of diseases mentioned were hole-in-head and lateral-line disease. How accurate that is, I can't say. I just remember reading it somewhere.
Okay, added my last $.02. I'm done also....