The first study was a cross-sectional analysis of administrative data from PCORI Merit Review applications across 5 funding cycles. Researchers assessed the extent to which different reviewer types influence review scores and funding outcomes, the emphasis placed on technical merit compared to other criteria by a multistakeholder panel, and the impact of the in-person discussion on agreement among different reviewer types. Results show that scientist, patient, and stakeholder (eg, clinicians, health systems administrators, policy-makers, caregivers) views all contribute to PCORI Merit Review of applications for research funding. Technical merit is critical to funding success, but patient and stakeholder ratings of other criteria also influence funding decisions. In fact, for each reviewer type, overall initial scores were changed on at least half of the applications after the in-person panel discussion.

The second study used anonymous, cross-sectional surveys to understand reviewers’ perspectives of the interactions during the in-person review panel; to examine the value and challenges of including scientists, patients, and stakeholders together; and to understand the perceived importance of PCORI’s review criteria. Survey results indicate that reviewers of all types describe PCORI Merit Review as respectful, balanced, and one of reciprocal influence among different reviewer types. Challenges included concerns about a lack of technical expertise of patient/ stakeholder reviewers and about scientists dominating conversations.

“PCORI was established to fund patient-centered comparative clinical effectiveness research that is relevant to patients and other healthcare decision makers and produces results that can be quickly applied in health decision making,” said author Laura Forsythe, PhD, MPH, PCORI, Washington, DC, USA. “While other funders have incorporated patients, consumers, or the public in their reviews, the extent to which PCORI involves nonscientists in application review is unprecedented. The research described in these articles provides new evidence about how the views of scientists, patients, and other stakeholders are incorporated in the PCORI Merit Review of applications for research funding, and how reviewers’ perceive the interactions involved. We hope this work will facilitate funding of research that is more relevant to healthcare decision making.”

ABOUT VALUE IN HEALTHValue in Health (ISSN 1098-3015) is an international, indexed journal that publishes original research and health policy articles that advance the field of health economics and outcomes research to help healthcare leaders make evidence-based decisions. The journal’s 2017 impact factor score is 5.494. Value in Health is ranked 3rd among 94 journals in healthcare sciences and services, 3rd among 79 journals in health policy and services, and 6th among 353 journals in economics. Value in Health is a monthly publication that circulates to more than 10,000 readers around the world.
Web: www.ispor.org/valueinhealth_index.asp | Twitter: www.twitter.com/ISPORJournals (@ISPORjournals)