I think you are on the right track with the case walls thinning after many uses. every time you trim a case you are obviously loosing brass so even cases only trimmed a few times are thinning out. Even the act of opening and closing the case mouth is slowly forcing the brass down.
"If a man does his best, what else is there?"
- General George S. Patton Jr