My top break H&R 999 is vastly more accurate than I am, and it is 73 years old.
The ejector rod is spring loaded. With a speed loader I would guess that it is as quick as reloading an auto magazine.
Granted the .22LR is pretty low pressure but the general design hasn't hurt the accuracy at all. If it was going to loosen up it would have happened in 75 years or so.