You don't want to rub the skin, you will stress your horses and possibly injure the skin.
If you want to remove the algae, you can take something like a soft artist brush, makeup brush (never used) and gently brush it off. Another way is to take a turkey baster and gently squirt some water across the horse to loosen the algae.