Friend of mine has shot both whitetail and muleys with both calibers. Probably 3-4 of each over the years. He says You can not see the difference between the two. But for choice of components alone has chosen the .44.
My experience is recoil, not much difference. Noise, .41 seems sharper, more like .30 Carbine. Weight, no difference. Sex appeal, .44 hands down. And besides that, Skeeter says it's so. So there. Neener, neener!