1 single hermit will do. Mine is trouble-in-a-shell, he goes around knowing the Gorgonia over every night, and likes to pick the red macro algae off the tunicates.
That said, I have only fed him once, perhaps I should feed more, but this is easier said than done. Mine likes to hang out in the caves during light on, and comes out after the lights are off.