If I was defending my property this wouldnt be an issue. Firstly, I live in a fully detached 250 year old cottage. If I fired a bullet at a wall in my house, it would probably do damage to the stone work. If I fired a gun at the several wooden doors on my premises it might be a different issue.
Basically. I dont think if I were protecting my home and a bullet went through a door etc it wouldnt be a problem.