Algae will not grow on a healthy coral. It could be a protective slime, it could be expelling zoanthellae, be dead or the base layer of hard corals are brown. The colors come from a reaction to light. Changes in light, like from a new arrival, will often cause a coral to turn brown. As the coral acclimates, and if it has proper lighting, it will color back up.