Acetaminophen is one of the most widely used medicines for fever and pain, commonly found in drugs like in Tylenol. On Thursday, the Food and Drug Administration (FDA) announced that acetaminophen is causing rare, but dangerous skin reactions in some people.

The popular pain-killing medication is linked to three skin diseases with symptoms that range from rash and blisters to more extensive damage to tissues under the skin. The two most serious skin conditions are Stevens-Johnson Syndrome (SJS) and toxic epidermal necrolysis (TEN), which will typically require hospitalization and can be fatal. The less dangerous skin disease is acute generalized exanthematous pustulosis (AGEP), which usually resolves itself within two weeks once acetaminophen is stopped.

Many of the reactions start with flu-like symptoms of fever and muscle aches, which are followed by rash, blistering and sloughing off of the outside of the skin, which can expose patients to potentially fatal infections. It’s possible for victims to experience scarring, skin pigment changes, blindness and organ damage. The recovery can take weeks or months. The FDA says anyone who is taking acetaminophen and is experiencing skin symptoms, should stop taking it immediately.

“This new information is not intended to worry consumers or health care professionals, nor is it meant to encourage them to choose other medications. However, it is extremely important that people recognize and react quickly to the initial symptoms of these rare but serious, side effects, which are potentially fatal,” said Dr. Sharon Hertz, the deputy director of FDA’s Division of Anesthesia, Analgesia and Addiction in a statement.

The FDA says it will require manufacturers to add warning labels to all prescription medications that contain acetaminophen and will work with makers of the over-the-counter drugs to do the same. The FDA discovered the risk of skin diseases while reviewing adverse events reported in its database between 1969 and 2012, during which 107 cases of significant skin reactions were reported, 67 people were hospitalized and 12 people died.

It’s not clear why the skin conditions have not emerged as a health concern sooner, given how many people take the pain-killing medication. Health officials say it’s too soon to determine whether does is an issue, or whether the combination of acetaminophen with other ingredients or medications causes the adverse events. Often, such side effects only become apparent once a drug reaches market and is used by millions of patients, since manufacturers cannot anticipate every potential interaction between their product and others. For example, some statins, which lower cholesterol and reduce inflammation, were discovered to raise the risk of diabetes and other painkillers known as Cox-2 inhibitors were linked to an increased risk of heart attack and stroke.

The announcement isn’t the first to alert users to the potential harms of acetaminophen. Two years ago, the FDA limited prescription acetaminophen doses to 325 milligrams per tablet or capsule to prevent liver injury. For now, the FDA says people using the drug should not stop the medication unless they develop skin symptoms. The side effects are rare, and for most users, the agency says the benefits of the drug outweigh its risks.