Yes , there is a loophole in the way the DEC regs are written. Before I kept them I spoke with the DEC and they said I could keep as captive. However, if I was to attempt stocking a body of water somewhere I would then have to go through the permit application process. I f you purchase them from a dealer you will also have to have a permit. So I would recommend go fishing
If the fish you are considering are trout then you are going to need a chiller and fairly strong water movement. Darters, Sculpins, Dace/minnows will also need the cooler strong water movement but with a spot to get out of the flow. They can also handle somewhat higher temps than trout.
Bass can handle quite high temps and do not care about strong water movement. Pretty much any of the gamefish you will end up with just 1 and it will be the most dominant. Most of cannot afford a tank that will deal with the territory requirements needed by these fish. Sunfish are gorgeous especially in breeding dress, however they are nasty little buggers that will incessantly chase and attack other competitors.Bas and trout are the same way you will end up with one.
The southern sunfish or pygmy type sunfish are a bit of an exception to the rule , they are still somewhat aggressive but can be easily kept in smaller tanks, and in my opinion are very nice to look at. Fundulus are top minnows and very adaptable to aquarium life.
For my money I would do the Sculpin/Dace/Darter/minnow type tank much easier to collect and maintain. This is how I started out in the aquarium hobby, most of the foods that were available to me at the time were foods that I collected from the creeks the fish were collected in, frozen brine and flake. There is so much available now that it is fairly easy to keep the smaller guys in a tank of reasonable size.
Here is a pic of a native NYS rainbow darter ..enjoy..and you are close to some prime collection areas..