I wouldn't peel it. Try to slice it cleanly off of one rock. The possibility of the small stump growing into a second leather is much greater with a clean slice than a tear, and the trauma to the larger colony is much less.
And for sure, don't touch it with bare hands! Always wear gloves for this kinda stuff.