I'll admit to being one of them. However, it's generally just squirrels, and they get skinned and thrown in the freezer (when in season, otherwise I just swear at them for tormenting me).
Woodchucks don't get a pass because of the damage they cause. My aunt and uncle have horses, and the 'chuck's holes can break their legs. Same at my brother-in-law's family's farm. They've got cows, and can easily break their legs. The tunnels can also cause severe damage to the tractors in the fields (broken axles and such).