Load with confidence, use data that is geared towards lead bullets and you won't have any problems with leading your bore. I've never worn gloves while loading lead bullets but I don't spose it's a bad idea if you are concerned about absorbing heavy metals. I've loaded tens of thousands of lead projectiles in 9mm, .45ACP, .38Special, .357Mag, and .44Mag and have never had a problem. The difference in muzzle velocity is negligable in your autos.
Other than the slight spittle drool on the left side of your lips -
Tell me if you can, why are cast bullets smokier when you shoot them?