Featured Research

With a push to make hospitals and doctors more accountable for health care quality, more attention must be paid to the accuracy and reliability of measures used to evaluate caregivers, says a prominent patient safety expert.

Share This

With a push to make hospitals and doctors more accountable for health care quality, more attention must be paid to the accuracy and reliability of measures used to evaluate caregivers, says a prominent Johns Hopkins patient safety expert.

Related Articles

Writing in the April issue of the journal Health Affairs, Peter J. Pronovost, M.D., Ph.D., a professor of anesthesiology and critical care medicine at the Johns Hopkins University School of Medicine, argues that as the desire to evaluate and improve health care intensifies, there remains little consensus as to which measures are scientifically valid and accurate assessments of quality. This risks misinforming patients who may make decisions based on metrics that poorly reflect the state of health care provided by hospitals and may ultimately lead to a failure to make improvements in hospitals where quality is judged to be better than it is, he says.

"There is bipartisan support behind efforts to start paying for value rather than volume," Pronovost says. "This is great, but we act as if there's a whole library of reliable outcome measures for us to use and the fact is that serious work needs to be done to create them. We can't shrink from doing this science. We need to be guided by it."

Acknowledging that substantial shortcomings in the quality of care persist, causing needless patient harm and increasing health care costs, Pronovost says fixes can't be put in place until rigorous scientific data show exactly where systems are broken and until hard comparative evidence points to what types of repairs work best.

In the absence of such safety and efficacy science, he says, there will remain little consensus among hospitals and physicians about the best methods to judge quality or improvement. For example, he notes that overall hospital death rates are an imperfect reflection of quality of care, but in some cases they are the only measures used.

Pronovost, writing with Richard Lilford, Ph.D., an epidemiologist at University of Birmingham in England, points also to research that compared four different measurement services used to assess the same data from the same hospitals to determine in-hospital mortality. Forty-three percent of hospitals that showed higher-than-expected mortality by one commercially available metric showed lower-than-expected mortality by another.

Pronovost and Lilford call for the creation of an independent agency, the equivalent of a Securities and Exchange Commission for health care, to create rational and standardized outcome measures similar to the accounting rules the SEC creates for businesses. "The goal is to make the process of determining quality standard and transparent, and make data meaningful for consumers and usable by clinicians, ultimately improving patient outcomes," Pronovost says.

Doctors support the use of outcome measures if they are valid and reliable enough to enable conclusions to be drawn about the quality of care, Pronovost says. Too often, he says, they aren't. Hospitals, he notes, once were being fined for hospital bloodstream infections after government regulators screened billing claims for codes signifying infections to calculate infection rates. "That measurement gets it right only one in four times -- 25 percent of the time," he says. "Clinicians have never used that data because they thought that it was useless, because it was useless."

Now, government regulators make judgments based on Centers for Disease Control and Prevention data, which include lab tests, temperature readings and other signs and symptoms of infection -- far more accurate measures, he says.

Meanwhile, Pronovost says some states penalize institutions for what they deem are preventable complications contracted by patients during their hospital stays. But, he says, hospitals don't know exactly what they are being judged on because those states use a proprietary algorithm created by a private company to determine which hospitals are "successful" and which ones should be sanctioned. Clinicians and the public neither know how accurate the measures are nor how they were calculated.

"The process should be transparent and reproducible; instead it's a black box," he says. "We don't know if it gets it 5 percent right or 95 percent. We ought to know how imperfect it is."

In a second article also published in Health Affairs, Pronovost, along with Jill A. Marsteller, Ph.D., of the Johns Hopkins Bloomberg School of Public Health, and Christine A. Goeschel, Sc.D., R.N., M.P.A., M.P.S., in the Department of Anesthesiology and Critical Care Medicine, present a case study of a success story in measuring outcomes: central line-associated bloodstream infections.

The group outlines the Hopkins-led effort to virtually eliminate bloodstream infections in intensive-care units throughout Michigan, which is now in nearly every state and has reduced the number of deaths. Infection rates have fallen dramatically in ICUs where Pronovost's cockpit-like checklist and culture-of-safety program were implemented. This is one of the few, perhaps only, national success stories documenting measurable improvements in patient outcomes. The Hopkins program is now being implemented across the United States. Data from the first 22 states that have participated in the program for over a year suggests infections have been reduced by approximately 40 percent.

"There are precious few outcome measures deemed valid by clinicians," he says. "This is one of them."

More From ScienceDaily

More Health & Medicine News

Featured Research

Mar. 31, 2015  Researchers have recorded the first direct observations of the micro-scale mechanisms behind the ability of skin to resist tearing. The results could be applied to the improvement of artificial skin, ... full story

Mar. 31, 2015  Fewer than half of the physicians trained in the United States in 2013 received formal education or training on the subject of exercise, according to new research. "There are immense medical benefits ... full story

Mar. 31, 2015  Memory and as well as connections between brain cells were restored in mice with a model of Alzheimer's given an experimental cancer drug, researchers report. "With this treatment, cells under ... full story

Mar. 31, 2015  Increasing state alcohol taxes could prevent thousands of deaths a year from car crashes, say researchers, who found alcohol-related motor vehicle crashes decreased after taxes on beer, wine and ... full story

Mar. 31, 2015  Alcoholism takes a toll on every aspect of a person's life, including skin problems. Now, a new research report helps explain why this happens and what might be done to address it. "The clinical ... full story

Mar. 31, 2015  A new population of 'memory' immune cells has been discovered by scientists, throwing light on what the body does when it sees a microbe for the second time. This insight, and others like it, will ... full story

Mar. 31, 2015  Coronary heart disease and stroke, two of the leading causes of death in the United States, are diseases associated with heightened platelet reactivity. A new study in humans suggests an underlying ... full story

Mar. 31, 2015  A new study had researchers seeking answers to why the therapeutic benefit afforded by SSRIs was so limited in children and teenagers. If researchers can uncover the biological mechanisms preventing ... full story

Mar. 31, 2015  A drug being developed to treat osteoporosis may also be useful for treating osteogenesis imperfecta or brittle bone disease, a rare but potentially debilitating bone disorder that that is present ... full story

Featured Videos

Solitair Device Aims to Takes Guesswork out of Sun Safety

Reuters - Innovations Video Online (Mar. 31, 2015)  The Solitair device aims to take the confusion out of how much sunlight we should expose our skin to. Small enough to be worn as a tie or hair clip, it monitors the user&apos;s sun exposure by taking into account their skin pigment, location and schedule. Matthew Stock reports.
Video provided by Reuters

Soda, Salt and Sugar: The Next Generation of Taxes

Washington Post (Mar. 30, 2015)  Denisa Livingston, a health advocate for the Dinι Community Advocacy Alliance, and the Post&apos;s Abby Phillip discuss efforts around the country to make unhealthy food choices hurt your wallet as much as your waistline.
Video provided by Washington Post

S. Leone in New Anti-Ebola Lockdown

AFP (Mar. 28, 2015)  Sierra Leone imposed a three-day nationwide lockdown Friday for the second time in six months in a bid to prevent a resurgence of the deadly Ebola virus. Duration: 01:17
Video provided by AFP

Related Stories

Feb. 3, 2015  An examination of process measures endorsed by the National Quality Forum finds that these measures focus predominantly on management of patients with established diagnoses, and that quality measures ... full story

Jan. 22, 2015  When hospitals adopt proactive, enhanced care transition interventions to assure that family caregivers are well prepared when patients are discharged, the incidence of adverse outcomes due to ... full story

Apr. 26, 2011  Hospitals and physician practices that form care-coordinating networks called "Accountable Care Organizations (ACOs)," under provisions of the new health-care law could reap cost-savings ... full story

Feb. 1, 2011  Efforts to keep hospital patients safe and continually improve the overall results of health care can't work unless medical centers figure out a way to get physicians more involved in the ... full story

July 13, 2010  In health care reform discussions, talk inevitably turns to making hospitals and physicians accountable for patient outcomes. But in a new commentary, a patient safety expert argues that the health ... full story

ScienceDaily features breaking news and videos about the latest discoveries in health, technology, the environment, and more -- from major news services and leading universities, scientific journals, and research organizations.