Canon g11 if you don't want to go SLR.
Or an older G series.... The extension tubes were a good idea too, depending.
Having been at this a while I can tell you my experience has shown me a few things. First off, glass is where it is at. It's been said, but the lens is the most important part of the package. I'd take great glass with a cheep body any day over the opposite. It doesn't matter how low the noise, how good the AF system is, the ergonomics, weatherproofing, or how many MP's if the lens can't resolve the information and detail your sending to the body.
Okay, now for the kicker...you can buy once (big) or many times and then end up there anyway

.
Over the years I worked my way thru a lot of gear. I used to look at the pro's images and wonder how they got such sharp images. Some of it is in technique, but some of it is the gear...and most people I think will agree it is the quality of the lenses. Once you choose a system (ie. Canon, Nikon) your glass will likely last you forever if you buy good stuff now. You'll change you bodies several times though.
I didn't have the money early on, so I bought what I could. As I got more into the hobby and got more money I upgraded and upgraded again. Knowing what I know now in the end I would have actually saved money if I bought better lenses early on. I also would have been happier with my results (sharper pictures due to the quality of the glass of larger F stop giving me faster shutter speeds). Now I have the good lenses, plus the cheaper ones I bought early on. I spent more than if I just bought the good stuff first.
Hey, that is the road I took. I'm sure other did too. If you think this is gonna be your thing get a good lens right up front. The other benefit to that route is if you don't like it you'll be able to sell it and recoupe a good chunk of your money. If you can't afford it get a good P&S with manual settings (like a G series) and start working on the basics and your technique until you can afford something better.
That's just MYO and thoughts. Take what you like and leave the rest. Good luck any way you go. This can be a pretty rewarding hobby. It can also get expensive, so put the money where you'll get the most out of it.