Many moons ago I had a Remington clone and a pair of Ruger Old Army's. Shot the snot out of them, then got out of BP for years.
I recently picked up a pair of 2nd series Colts, a 61 Navy and a Walker, both are excellent shooters. You can find the used Colts for about the same cost as new imports. I recently picked up a TC Hawken 50 to make more smoke with.
I don't think you could put enough powder in the 61 to damage it, small chambers. The Walker is a hand cannon for sure, 50gr of bp makes a lot of smoke.