Am I using lead free primers? No, but I shoot cast bullets by the lb and that lead can be difficult to remove.
Shooting normal primers in an enclosed space can expose you to a lot of lead styphenate, which is readily absorbed. Not too big a deal for us oldsters but it should be avoided by young people.
You may consider slugging your bore and having your boolits cast to that size to reduce or even prevent leading your barrel.
Good tip about the plastic bullets, btw.