Yeah, I would check your states DEC website for fish regulations. I can only speak to the NYDEC regs. All game fish will have regulations on them (Bluefish, Bass, Tautaug, Porgy, Flounder...)
But you can get a lot of cool stuff that has no regs. I was able to get my puffer with no size reg., and you can get schooling fish like killifish, mummichugs, silversides (although they die easily), sticklebacks (3, 4, and rarely 9 spine) and sheepshead minnows. Those are all very easy to get by simply seining near shore. I was also able to get my cunner with no regulations, its in the wrasse family and also closely related to blackfish (tautaug) while staying smaller. Everytime people come over and see that this is what exists in our local waters they are always amazed by it. It's very cool to know that we are blessed to have such beautiful stuff up here too.