A very affordable choice as far as platform AND ammunition for a first time full power bolt action rifle with decent open sight is a surplus Mosin Nagant. Loads of fun with very inexpensive ammunition still available in quantity. A Finn M39 Mosin will set you back a few more dollars, but has an improved trigger, sights, and greatly improved accuracy. That being said, I have seen groups fired by rack grade refurbed 91/30's that were surprisingly tight.
"A Liberal is someone who doesn't care what you do, as long as it's mandatory". - Charles Krauthammer