I hunt in a county where you have to be 10 feet up to use a rifle. But even if I did hunt my way back to the truck I would drop the first round back onto the follower and lower the bolt on an empty chamber. I can load a round if I need one.
Every accident I can remember hearing of took place at the "truck", or crossing a fence of falling down while walking or at the house. Hunting is safe, but walking in dark woods with a loaded hair triggered rifle is not safe IMHO.