that's what it is supposed to do.
It's keeping your tank cool. If you are tired of pouring water in, look into an auto-top off. If you have space for a resevoir, they certainly make life easier.
I have seen plastic float valves at ACE and Atwoods for less than $20.