One of mine has the same thing - they came and went, and I was worried he had a fungus or something. After a lot of observation, I determined that he's getting stung by zooanthids, and sometimes the frogspawn. The stings cause the spots; when he makes my xenia his host, the spots disappear. I wish he'd hang out there more =)
Nothing to worry about, most likely.