It sounds like you only have two that you know of. I would like to see a photo because I have never heard them described as looking like polyps. Anyway I would remove the rock and scrub them off with a toothbrush, making sure there is no trace left on the rock. Then I would purchase a few peppermint shrimp to control any that may pop up in the future, they usually only eat the small ones.