Sunday, December 6, 2009

Public Reporting of Hospital Quality With Media Attention Can Make a Difference: The EFFECT Study from JAMA

In addition to widespread agreement that financial penalties are a good way to batter hospitals over the head on quality of care issues, many policy makers, insurers and academicians also believe in public reporting. After all, nothing like the glare of publicity to shame the poor performers and make patients think again about going to St. Infectya's ER when Washdahands County Hospital has much better numbers. This threat could prompt hospitals to improve their care processes and bend the curve, right?

Well, finally we have some clever and well performed research that says ‘maybe.’

Check out this study by Dr. Tu and colleagues on the EFFECT Trial that was published in the December 2 2009 issue of JAMA. A mix of 86 Canadian Ontario province hospitals participated in a randomized trial to assess the impact of public reporting on how well they treated heart attacks and heart failure.

Readers may recall that the Disease Management Care Blog has pointed out that formal randomized controlled clinical trials can be time consuming, cumbersome and expensive. This Ontario research is an example of a staggered roll out design in which everyone eventually receives an intervention. Since it can be administratively cumbersome to intervene on all hospitals at the same time, it can make sense to do a fraction of the group first and then follow-up with the rest later. During the period of time when the laggards are waiting their turn, they can act as a functional control/comparator group. That’s what happened here.

After 5 hospitals eventually withdrew from the study, 42 hospitals were assigned to and completed an ‘early’ and aggressive roll-out of public reporting that started in January of 2004. 39 hospitals were assigned a ‘late’ and more modest roll-out that started 21 months later. The study design can be found here.

Both groups of hospitals had baseline performance measures collected on the quality of care for all of their heart attack and heart failure patients that had been admitted over a two year period from 1999 through 2001. The ‘early’ hospitals had these baseline performance measures released in January of 2004 with considerable fanfare. It was reported in many TV, radio and print media outlets. In September of 2005, the delayed hospital’s data were released on the web only and without any media fanfare. It was left up to the individual hospitals to decide how to respond to the measures. After a period of time, the hospitals’ heart attack and heart failure measures were assessed again.

So what happened? Most of the twelve measures of quality in heart attack care, such as the use of standard admission orders, assessments of cardiac function, measuring blood cholesterol levels, use of clot busting medications and the use of aspirin, beta blockers, cholesterol medications and ACE inhibitors went up in both hospital groups. The degree of change was no different in the two groups except for one key measure. The aggressive and early use of 'clot busting' medications prior to transfer to a cardiac care unit turned out to be statistically significantly higher in the ‘early’ group. The ‘early’ group also had a 30 day mortality rate that was 2.5% lower compared to the ‘late’ release hospitals. This difference turned out to be statistically significant.

While the authors were critical of relatively blunted effect of high publicity quality reporting (‘only one of 12 heart attack process measures and only one of six heart failure measures showed any improvement,’ and ‘public release of data may not be particularly effective.’) the DMCB is favorably impressed. Interventions that reduce mortality rates in heart attack and heart failure are difficult to come by and this intervention seemed to make a difference.

What’s more, the DMCB also finds the data are intuitively credible. It's been known for a long time that giving clot busters early in the course of care instead of waiting until the patient is in the cardiac care unit saves lives among heart attack victims. In addition, increasing the use of ACE inhibitors is well known to reduce the mortality rate among persons with heart failure.

Take aways:

For the first time, we have good research showing that public reporting with media uptake can lead to real changes in processes of care that are linked to tangible reductions in death rates. While the reductions are not huge, they are meaningful and of a similar magnitude compared to those obtained from other modern interventions in cardiac care.

While public reporting and media attention didn't lead to across the board improvements in all corners of cardiac care, the DMCB wonders if ‘fine tuning’ the measures and the public reporting on interventions that are shown to meaningfully change mortality rates should be considered. For example, should future public reporting be limited to measures on the use of clot busters or ACE inhibitors?

This is also an excellent example of the difference between peer-review published articles that double as marketing materials versus those that are credible scientific reports. The former typically extol their modest findings as robust or ground-breaking advances, while the latter are hyper-critical and tend to understate the significance of their findings while letting the numbers speak for themselves. This particular article is definitely in the latter category.

Last but not least, this is also a good example of clever regional collaboration among care providers to answer important research questions. It seems to the DMCB that all the Ontario Hospitals had pretty much agreed to public reporting. They saw the roll-out as an opportunity to test various methods of carrying it out and came up with some important insights. Hopefully future U.S. comparative effectiveness research will see these opportunities for what they are and the Medicare Chronic Care Practice Research Network will also be willing to adopt these kinds of efficient models.

Here's the User Interface

The PHB & Twitter

LinkedIn

Some more....

Proud to be....

PHB Peer Reviewed Publications:

PHB on Twitter!

Why Should I Read the PHB?

Here's what one reader had to say about the Population Health Blog's ability to to go beyond simple headlines and mainstream newsfeeds:

"This past week, I was surprised to read some of the generic headlines summarizing the VA readmission study. You know, through medical newsfeeds, they almost implied that length of stay didn't have anything to do w/readmissions. When I read the Annals article today, there was certainly a lot more to the study than that. Was happy to see your nice summary, which I agree w/100%. Just wanted to drop you a line to say that Ilooked at your blog w/hopes of finding some commentary on the study---and there it was!"

Not Exactly A Waste Of Time.....

Subscribe To The PHB

This is still true, by the way.....

“Moving into the next century, the most important breakthroughs will be in the from of clinical process innovation rather than clinical product improvement…the next big advances in health care will be the development of protocols for delivering patient care across health care settings over time.”

JD Kleinke, Bleeding Edge

++++++++++++++++++++++++++

Vox audita perit, litteras scripta manet

++++++++++++++++++++++++++

Do Aetna, Humana or UnitedHealth Insurance Cover It? Find Out Here

About Jaan Sidorov MD, MHSA, FACP

While his web persona has been described as a "blogvocateur," Dr. Sidorov has wide range of knowledge about the medical home, condition management, population-based health care and managed care that is only exceeded by his modesty. He has been quoted by the Wall Street Journal, Consumer Reports and NPR’s All Things Considered.
He has over 20 years experience in primary care, disease management and population based care coordination. He is a primary care general internist and former Medical Director at Geisinger Health Plan.
He is primary care by training, managed care by experience and population-based care strategies by disposition.
The contents of this blog reflect only the opinions of Sidorov and should not be interpreted to have anything to do with any current or past employers, clients, customers, friends, acquaintances or enemies, personal, professional, foreign or domestic. This is also not intended to function as medical advice. If you really need that, work with a personal physician or call 911 for crying out loud.
Jaan can be reached at jaansATaolDOTcom.