Opinions on "fishless" cycling vary greatly as per what to do with adding decomposing matter. On the one hand, you need it to jump start things. On the other hand, it add unnecessary wastes to the tank. Personally, I don't do fishless cycling for that reason, and I don't really recommend it when they're always some cheap hermits or damsels you can toss in (*and by toss- I mean approrpiate acclimate, of course! XD), or stuff like TLC. However, I do know many people who have had fishless cycling work awesome for them, so I can't discredit it as an effective technique.
You could, if you wanted, leave the shrimp and ride out the ammonia and nitrite spikes. However, after the nitrite spike, once the nitrates start to rise, you're going to need to do a good water change to pull them back down. You'll especially need to do this if the tank in question is the 24G aquapod listed under your signature. In a larger tank, you might get away with more as per fishless cycling, but just keep the nitrates in mind before you add fish, whatever the size of the tank if you leave the shrimp in for the whole run.
In a smaller tank, I would lean to the side of caution and remove most of the shrimp shortly after the ammonia spike. Shrimp and krill take longer to decompose fully than other matter (as I recall, TFH actually rated it one time as taking 4 to 8 hours to just *start* decomposing), so it could continue to throw ammonia levels up for a little while. Personally, if the tank in question is the Aquapod, I would remove most, if not all, of the shrimp after the ammonia spike, perhaps leaving only a tiny piece to keep things moving along.