Well, my first thought when I saw the pic was that it's an ovulid, but I'm kind of confused by the descriptions.
You said you can't cut them off with a razor. Does that mean that it's got a solid attachment to the rock or that it just had a strong grip? Have you seen it move? Does it move like a snail? What do you mean it has a stalk of Xenia on top of it? Did it just crawl under a mat of Xenia or is the Xenia actually growing on it?
What does it feel like if you touch it? Does it feel like a soft layer over a hard shell?