+1 to it's all about what you want.
You're not going to get off cheap no matter what size you go.
On some levels, bigger does cost more (more lighting, more flow requirements, bigger water changes) but those are not the only factors.
The real questions to ask before you go any further are: do I want coral or fish only? what are the fish that I like most?
Go to a fish store or two and look around. Check out tanks online that get your heart pumping.
If you find that a pair of clowns and a few soft coral are the look you like, smaller is going to be just fine for you. On the other hand, if you're going into this saying, "A Blonde Naso Tang is my dream fish," then it wont matter how much money you've saved because you're just going to be wishing for your next tank.
I started with a 90 that seemed HUGE to me. My first algae outbreak almost drove me out of the hobby because changing half of the water in the tank every week was a MAJOR undertaking. I was new and it was all very intimidating.
But remember that dream fish thing? A year in and we were upgrading to a 300 gallon because I could not fit the fish I wanted into the 90.
Having said that, if I'd had issues with the 300 early on, I would have given up for sure.
We all want different things from our tanks and we all have different experiences. If a nano/small tank is what seems feasible to you right now, go for it! There are awesome nano tanks out there and plenty to read, learn and do.
Just set some goals for yourself and your first tank. You can always go bigger later if that makes the most sense to you, but don't make the mistake of thinking that you'll get a budget 29 gallon because no matter what it will end up costing more than you planned.
Good luck!