Drop the weight of that bullet. That will reduce the recoil. I find that the 530 grain in 45-120 is quite stout. The 405 grain is more pleasant to shoot. You may want to drop to 300 grain.
No such thing as a stupid question. What is stupid is not asking it.