A three yr old may load a magazine. To ease your wife's fears, get a safe for the gun while you're debating, and then man up and confess what you've done. Bring the safe up after she expresses her fear of the gun and the childrens' curiosity.
It's not easy, but you gotta do it