Not enough room around it. Torches like to open up, and if their flesh hits rocks it will tear and they'll close up. Eventually the whole colony recedes from not being able to open if it doesn't catch an infection and die first.
Never place fleshy LPS in a spot where the flesh will open into rocks.