I was not a big dog person for a LONG time... severe allergies made it pretty impossible. About 2 years ago, I started taking allergy shots. They have been remarkably effective, and a year ago in August, we adopted our Scott (my wife found pictures on him on the KC Humane Society website and we fell in love).
It's changed my life. My blood pressure has gone down 10 points since we got him. I chalk this up to working from home and having him around to calm me down periodically (nothing like getting off the phone after yelling at someone and being able to turn around, pet my dog, and relax for 5 minutes).
He went through a lot of trauma early on - he was found on the streets of Joplin after the tornado, and one of his eyes was infected/messed up - but you wouldn't know it from his demeanor. He's incredibly sweet, cuddly, and LOVES people. They ended up bringing him to KC, where they had to remove his eye. This handicap kept him from being adopted (because he's otherwise just a handsome guy).
Here's a pic (he's the one on the left)
FAX, I think if you find the RIGHT shelter and the RIGHT dog, it's not an problem. Most of them will give you a chance to meet/play with a dog before you adopt it, so that helps a lot.
As a fellow former "I don't need a dog" guy, what you said touched me. Hope you find another little guy or gal who can fill that spot in your life.