My gess that if a fish had nipped at it, it would be your coral beauty. But I don't know if it necessarily was a fish.
Xenia are one of those corals that are hit and miss. Some people grow them like a weed, while others will crash instantly.
Keep up the water params, as well as iodine, strontium/calcium, as well as trace elements