Check out the Bear Archery bows, or some Diamond archery bows too. Most important to me is finding a bow that "feels right" when I hold it, pull it back, and shoot it.
I have a diamond I got a couple years ago, its not the nicest bow there is, compared to say, a mathews, but it just fits me perfectly. You've gotta be comfortable with what you've got.
As for arrows, the nicest wal mart arrows they have will do fine. Get them cut to the correct length at the local archery shop though.
You really don't have to have anything too fancy to get started. Good luck, practice, and have fun with it!
Savage Mark II F .22
H&R ultra slug hunter 20 ga
1942 Mosin Nagant "Natalia"