I would take the scope off as mentioned above. Also if the mount is loose at all your groups will be large. One time I thought I could get away without using loctite on some mounts. So much for that idea.
My Super Blackhawk shoots 1.5" groups at 25 yards using 240 swc over 9 grains of Unique. I'm sure glad my gun never had any problems like some of yours.