Poke, pick, prick, and prod a pimple, and you can force the debris and bacteria even deeper into your skin. You may also introduce new kinds of bacteria from your finger into the zit. That can cause the pimple to become more red, inflamed, swollen and infected, and may even lead to permanent scarring.