No one really knows, although a big grant just got shelled out to try and find out the answer..
IMO, it has nothing to do with the slime coat.. And it is all about the behavior.. there are many fishes that can go into anemones, from wrasses, triggerfish, damsels, etc.. I really think its all about how the fishes approach the anemone, more than any sort of chemical cues..