Pretty much every time I use it, unless I get lazy (but then I don't know how much to trust the result - it will be close, but probably not bang on). It's not too bad though, it takes about 30 seconds to calibrate, and since a test kit usually takes a few minutes, it's in the same ballpark.
It seems to sometimes take a long time to settle on a reading. I'll notice it settle on a number, like say, 13ppm, and I'll think "Oh ok, 13ppm, I'll write that down in my log." Then as soon as I have, it drops to 12 or goes up to 14. I don't know if you need to do this, but I swirl the test vial, probe and all, to try to get to settle down quicker.
One thing I've found, it has two ranges, 0 to 10, and 10 to 100, you have to calibrate for each range, and if you have nitrates right around the 10.0 mark it's a little awkward. Ie., it will read over-range if you have it in the low range setting, and read under-range if you have it in the high range setting. That might be a function of using old calibration fluids though - I'm not sure.
Otherwise though, I must say it sure beats trying to decide if fuscia is a hue of pink, and stuff like wondering if the tank halides are throwing off my perception of a colour, or the darkness of the colour, and so on. I don't really like colour comparison tests at all - if you could get a nitrate or phosphate test kit that was a titration based kit - ie., count the number of drops until you see a colour *change* - I'd be all over those, there's just something a little less subjective about volumetric versus colour comparing.