What's important is that there is reliability for the first shot's point of impact to match the point of aim. If that's the case, group size is pretty much irrelevant.
So if that first shot is always about two inches high at a hundred yards when you check it at the benchrest, Wily has a problem.