When they're starving they will eat who knows what, but they cannot survive on anything but sponges. Their specialization is not just a matter of taste, but of physiology. They do not have the gut anatomy of herbivores and cannot get nutrition from algae.