Sponge growing in Caulastrea

[Toxic Slurpee]

I have a green Caulastrea that I noticed had a small sponge growing in between some of it's heads. The sponge has been growing and looks like it is going to start covering some of the heads.

Is it safe to remove it? And what's the best method for getting it off?

Thanks!