You make it sound feasible, but have you checked your load manuals to see if they support your theory?
Edited to add, I see it goes both ways in the manual. with different loadings and powders. I must just be used to certain loads which support my theory. I stand partially corrected!