PCORI Merit Review: Our Evolving Approach to Review Panels
- The PCORI Strategic Plan
- Clinical Effectiveness and Decision Science
- Dissemination and Implementation
- Evaluation and Analysis
- Healthcare Delivery and Disparities Research
- PCOR Infrastructure & Innovation
- Our Vision & Mission
- Financial Statements and Reports
- The PCORI Strategic Plan
- Board of Governors
- Methodology Committee
- Authorizing Law
- Evaluating Our Work
- PCORI's Advisory Panels
- Procurement Opportunities
Past Opportunities to Provide Input
- Stakeholder Views on Components of 'Patient-Centered Value' in Health and Health Care (2023)
- PCORI's Proposed Research Agenda (2021-2022)
- Proposed National Priorities for Health (2021)
- Proposed Principles for the Consideration of the Full Range of Outcomes Data in PCORI-Funded Research (2020)
- Proposed New PCORI Methodology Standards (2018)
- Data Access and Data Sharing Policy: Public Comment (2017)
- Proposed New PCORI Methodology Standards (2017)
Comment on the Proposed New and Revised PCORI Methodology Standards (2016)
- 1. Standards for Formulating Research Questions
- 10: Standards for Studies of Diagnostic Tests
- 12. Standards on Research Designs Using Clusters
- 13: General Comments on the Proposed Revisions to the PCORI Methodology Standards
- 2: Standards Associated with Patient-Centeredness
- 3: Standards for Data Integrity and Rigorous Analysis
- 4: Standards for Preventing and Handling Missing Data
- 5: Standards for Heterogeneity of Treatment Effects
- 6: Standards for Data Registries
- 7: Standards for Data Networks as Research-Facilitating Structures
- 8. Standards for Causal Inference Methods
- 9. Standards for Adaptive Trial Designs
- Peer-Review Process Comments (2014)
- Draft Methodology Report Public Comment Period (2012)
- Past Opportunities to Provide Input
- Executive Team
- Office of the Executive Director
- Program Support and Information Management
- Staff Conflict of Interest Disclosures
PCORI’s process for evaluating research funding applications is a unique aspect of our commitment to producing evidence that helps patients, caregivers, clinicians, and other healthcare stakeholders make better-informed decisions.
From our earliest days, we sought to include patients and other stakeholders, along with scientists, in our merit review process, inviting reviewers to serve on panels by aligning their experience and expertise with the topics of the applications they assess. The goal has been to ensure that the projects we fund not only produce high-quality research but also address issues of importance and value to the healthcare community.
As we have gained experience with this process, and as our funding strategy evolves, we continue to adjust how we meet our continuing need for a diverse set of reviewers. So, we’re pleased to update you on the latest development in our review process.
With our August 2013 cycle of PCORI Funding Announcement (PFAs), we began to move toward using standing panels to evaluate applications. We identified reviewers willing to assess applications during at least three cycles over two years, rather than for a single cycle. The goal was to make the process more satisfying for reviewers as they gained experience and confidence—and more efficient for us.
Now we find that we’re becoming less dependent on the standing panels for a couple of reasons. First, we’re delighted that the vast majority of our reviewers, whether on standing panels or joining us on an ad hoc basis, have had such a positive experience that they’ve been willing to return for additional cycles. We’re also finding that our need for standing panels is ebbing as our approach to research funding evolves to focus more on larger investments in targeted funding announcements and calls for large, pragmatic studies addressing high-impact topics selected through our multi-stakeholder research prioritization process.
As a result, we are phasing out the designation of standing panels. In doing so, we are fully confident that we will be able to maintain the pool of returning, experienced reviewers needed to ensure that our process is rigorous, consistent, and fair to applicants, as well as fulfilling for the reviewers.
Appreciation for Our Reviewers
We sincerely thank those who have served on our standing panels and hope they will continue to volunteer as reviewers. And we want to acknowledge the important contributions of all our experienced reviewers in helping us to identify the best applications to consider for funding. In recognition of their commitment to our mission, beginning with the Spring 2015 cycle, we will increase the compensation of all returning reviewers from $50 to $75 per application reviewed. (Previously, standing panelist had received the higher amount, as well as a bonus for completing the three required cycles.)
We believe this new policy will reduce the burden on our experienced reviewers while acknowledging their important contributions. We look forward to hearing what you think.
What's Happening at PCORI?
The Patient-Centered Outcomes Research Institute sends weekly emails about opportunities to apply for funding, newly funded research studies and engagement projects, results of our funded research, webinars, and other new information posted on our site.