From your specifics it appears your rifle is sound. And you have proven with a higher recoil rifle much better accuracy.
Other things to consider:
- variations in case weight (easy enough to weigh and sort)
- neck runout due to your sizing die
- bullet runout due to neck runout or seating die
- Some rifles are very sensitive to bullet seating depth as mentioned