As long as they've got enough to eat, you could probably stock one to a gallon. Otherwise, you're asking for them to start harassing snails and coral. I don't know how much algae/detritus you've got for them to eat, so I couldn't say if that was too many or not. For example: I have a variety of hermits (12 total) in a 14G Biocube, and they've absolutely destroyed every bit of algae in there. I actually keep a large mass of chaeto for them to graze on now, and they get pellets and shrimp, and everyone's peaceful and happy.
Sorry, I actually rather like hermits and I don't like the idea of using them as CUC. They're scavengers and omnivores, and it bothers me when they get blamed for being underfed/housed and acting on it.