Don't think that buying better glass will shrink your groups because if you're getting roughly 1MOA, it probably will not.
If you can afford better glass and mount/rings, give it a try. It worked for me. My T/C Venture with cheap weaver rings and a leupold rifleman scope was upgraded to Burris Signature Zee rings and Zeiss Conquest scope and the group shrank from 1-1.5" to .55-.75" with same handloads. Not a big deal for a hunting rifle, but it does make a difference IMO.