I'd suspect one of two problems....
Bullet lube build up in the seating stem area...I clean this out periodically with WD40 or brake cleaner.
Your cast bullet's ogive is varying. Cast bullets vary in length more than jacketed and this could be your problem. Tho it shouldn't change actual seating depth much if at all.
I find that jacketed bullets vary far less than the cast variety, but in reality, in my experience, it doesn't seem to matter much in my groups shot from rest. But you're experiencing upwards of .030"+ seems a bit much....
Our Flag does not fly because the wind blows against it,
It proudly waves because a soldier's dying breath blows upon it.
USAF Forward Air Controller, 5th Spl Forces,
An Loc, lll Corps, RVN, 69-70, Vietnam Vet '69-'73