Unlike the gallon per inch of fish used in FW tanks there is no true formula for SW tanks. How many fish a tank will hold depends not only on size but temperament (territoriality), activity and feeding habits. For instance, you can house a pretty large Moray eel in a fairly small tank as they tend to hide in the rockwork and not actively swim. On the other hand a fairly small Tang will demand quite a bit of space as they are very active and graze continuously.
Your best bet is to look at some of the tanks shown on RC and see what people are stocking in similar size tanks. Then so some reading on the specific fish you choose to make sure you can accommodate them.