You don't mention all the purposes you want to use it for. Only target shooting, or do you also want one for self defense?
If you're only interested in target shooting, I recommend either the Ruger MK II pistol (these would be on the used market), the Ruger MK III (which are available new), or the Browning Buckmark. All these use .22 LR, and that makes them cheap to shoot. Cheap thrills! I would try to get the MK II over the MK III, as the latter has, IMHO, features such as a trigger lock and a "loaded chamber indicator" that are useless and unneeded. Either Ruger will probably be the most reliable, but the Buckmark is more ergonomic. The Buckmark is decently reliable but MUST be regularly and thoroughly cleaned every 3000 rounds or so. Otherwise you WILL get stoppages. The Rugers are less finicky about cleaning (although you should still clean them!). In my experience, both are equally accurate but the ergonomics of the Buckmark make it easier to aim and hold on target for me. As I said, they're cheap to shoot. You should be able to get one of these for roughly $300 to $350 or so new, less if used.
If you also want one for self defense, you will need something with more pizzazz than .22 LR. There's a wide range of choices out there. Do you want a revolver or semi-automatic? If a revolver, the bare minimum caliber to consider is .38 Special. .357 Magnum would be better (and it can also fire .38 Special). Smith and Wessons are great revolvers, but there are many others, including Taurus, Ruger, etc. Take your pick!
If you want a semi-auto, I would say the minimum caliber for self defense is 9 mm. Lots of folks swear by .45 cal, and I won't argue with that!
It's a very powerful cartridge but it can be intimidating to shoot for a new shooter. .40 cal is also good. There are too many makes and if I recommend one, someone else will protest! I personally like Glocks but that's just me. Most semi-auto manufacturers make guns in a large variety of calibers. YMMV!
Whatever gun you decide to get, make sure you get some training. Find a local shooting range, indoor or outdoor, and take an introductory class (the NRA is good about offering these) on handgun safety and marksmanship. Such classes are quite inexpensive and you'll learn a lot, believe me. There are also more serious classes out there that teach you markmanship and tactics for self defense over an entire day or two. But take the intro class first.
Check out this website. Yes, it is geared towards women (I'm assuming you're a guy!), but the principles in there are the same and there's a lot of good advice there. Good luck, and I think you're making a good choice getting into handgun shooting!
http://corneredcat.com/TOC.aspx