Go for it! There are alot of us tinkerers out there. The books mentioned will help. You will need some basic tools. Nothing real fancy, but do buy tools entended for gun work such as hollow ground screwdrivers. Some stuff you can get at the local hardware include pin punches, light hammers and common files. But be sure to buy good quality tools. This is no place to pinch pennies.
I suggest you check out
www.brownells.com . Brownell's specializes im gunsmithing tools, parts and supplies. Their catalog is well worth the cost, BTW: you get that cost back on the first order.
You don't have to go crazy or spend a fortune. Decide just what you want to do and buy just the stuff you need for that job. Later, when time and money permit, you can decide on the next improvement you want to make. Go easy, one step at a time.