Skip to main content
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Help Center
  • Subscribe
  • Careers
  • Contact

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • Home
  • About Us
    • Our Programs
      • Clinical Effectiveness and Decision Science
      • Healthcare Delivery and Disparities Research
      • Evaluation and Analysis
      • Engagement
      • Research Infrastructure
    • Governance
      • Board of Governors
      • Methodology Committee
      • Committees
        • Engagement, Dissemination, and Implementation Committee
        • Research Transformation Committee
        • Science Oversight Committee
        • Finance and Administration Committee
        • Executive Committee
        • Governance Committee
          • Executive Evaluation and Compensation Subcommittee
        • Scientific Publications Committee
        • Selection Committee
    • Financials and Reports
      • Our Funding
    • Procurement Opportunities
      • Operations Support Funding
      • Research Support Funding
      • Contracted Projects
    • Our Staff
      • Staff Conflict of Interest Disclosures
      • Executive Team
      • Office of the Executive Director
        • Evaluation and Analysis
        • Research Infrastructure
      • Office of the General Counsel
      • Science
        • Office of the Chief Science Officer
        • Clinical Effectiveness and Decision Science
        • Healthcare Delivery and Disparities Research
        • Peer Review
        • Research Synthesis
      • Engagement
        • Communications
        • Dissemination and Implementation
        • Engagement Awards
        • Office of the Chief Engagement and Dissemination Officer
        • Public and Patient Engagement
        • Public Policy
        • Training
      • Operations
        • Office of the Chief Operations Officer
        • Administrative Services
        • Finance
        • Human Resources
        • Information Technology
        • Procurement
      • Program Support and Information Management
        • Contract Management
        • Data Management & Operations Support
        • Merit Review
        • Office of the Chief Program Support Officer
    • Contact Us
  • Research & Results
    • Explore Our Portfolio
      • Completed Projects With Results
      • Highlights of PCORI-funded Research Results
    • Putting Evidence to Work
      • Evidence for Decisions
      • CME/CE Activities
      • Funded Projects: Putting Research Results into Practice
      • Dissemination and Implementation Framework and Toolkit
    • Peer Review
      • Who Are Our Peer Reviewers?
      • Sign Up to Become a Peer Reviewer
      • Peer Review FAQ
      • Step-by-Step Instructions for Awardees: Peer Review of Draft Final Research Report
    • Research Topics
    • Evidence Synthesis
    • About Our Research
      • How We Select Research Topics
        • Generation and Prioritization of Topics for Funding Announcements
        • Topics in the Prioritization Pathway
      • Research We Support
        • National Priorities and Research Agenda
          • How We Developed our National Priorities and Research Agenda
            • Public Comments for PCORI’s National Priorities and Research Agenda
      • Collaborating with Other Research Funders
      • Research Methodology
        • PCORI Methodology Standards
          • Suggest a Topic Area for New Methodology Standards
        • The PCORI Methodology Report
        • PCORI Methodology Standards and Report FAQ
        • Methodology Standards Academic Curriculum
          • Category 1: Standards for Formulating Research Questions
          • Category 2: Standards Associated with Patient-Centeredness
          • Category 3: Standards for Data Integrity and Rigorous Analyses
          • Category 4: Standards for Preventing and Handling Missing Data
          • Category 5: Standards for Heterogeneity of Treatment Effects
          • Category 6: Standards for Data Registries
          • Category 7: Data Networks as Research-Facilitating Structures
          • Category 8: Standards for Causal Inference Methods
          • Category 9: Standards for Adaptive and Bayesian Trial Designs
          • Category 10: Standards for Studies of Diagnostic Tests
          • Category 11: Standards for Systematic Reviews
        • Methodology Committee - Workshops and Events
      • Evaluating Our Work
        • Planning Our Evaluation, Reporting the Results
          • PCORI's Goals
        • Evaluating Key Aspects of Our Work
  • Engagement
    • What We Mean by Engagement
      • PCORI’s Stakeholders
    • Engagement Awards
    • Engagement in Health Research Literature Explorer
    • Engage with Us
      • Voices of Engagement
        • David White
        • Elizabeth Cox
        • Regina Greer-Smith
        • Kimberly Jinnett
        • Toya Burton
        • David Hahn
        • Rebekah Angove
        • Neely Williams
        • Peter W. Thomas
        • Megan O'Boyle
        • Stephanie Buxhoeveden
        • Sergio Sanchez
      • Become a Merit Reviewer
        • PCORI Stakeholder Reviewer Communities
        • Reviewer Qualifications
        • Reviewer Responsibilities
      • Become a Peer Reviewer
      • PCORI's Advisory Panels
        • Advisory Panel on Clinical Effectiveness and Decision Science (CEDS)
          • Biographies - Advisory Panel on Clinical Effectiveness and Decision Science (CEDS)
        • Advisory Panel on Healthcare Delivery and Disparities Research (HDDR)
          • Biographies - Advisory Panel on Healthcare Delivery and Disparities Research (HDDR)
        • Advisory Panel on Clinical Trials
          • Biographies - Advisory Panel on Clinical Trials
          • Advisory Panel on Clinical Trials Subcommittee on Recruitment, Accrual, and Retention
          • Advisory Panel on Clinical Trials Subcommittee on the Standardization of Complex Concepts and their Terminology
        • Advisory Panel on Patient Engagement
          • Biographies - Advisory Panel on Patient Engagement
        • Advisory Panel on Rare Disease
          • Biographies - Advisory Panel on Rare Disease
        • Advisory Panel Openings
        • PCORI Advisory Panels FAQs
      • Become a PCORI Ambassador
        • History of the Ambassador Program
        • About Ambassadors
        • Who are PCORI's Ambassadors?
          • PCORI Individual Ambassadors
          • PCORI Organizational Ambassadors
          • PCORI Ambassadors: Northeast Region
          • PCORI Ambassadors: South Region
          • PCORI Ambassadors: Midwest Region
          • PCORI Ambassadors: Western Region
        • Ambassador Program Interest Form
      • Provide Input
      • Suggest a Patient-Centered Research Question
        • How to Write a Research Question
      • Participate in PCORI Events
        • PCORI in Practice
  • Funding Opportunities
    • What & Who We Fund
    • What You Need to Know to Apply
      • Glossary
    • Applicant Training
    • Merit Review Process
      • Merit Review Criteria
      • General Merit Reviewer Resources
        • Meet Our Reviewers
        • Reviewer FAQs
    • Research Support Funding Opportunities
      • Eugene Washington PCORI Engagement Awards
        • Eugene Washington PCORI Engagement Awards: Review Process
        • Eugene Washington PCORI Engagement Awards FAQs
        • Eugene Washington PCORI Engagement Awards: Recently Funded Projects
      • Pipeline to Proposal Awards
        • Pipeline to Proposal Awards: Program Offices
        • Pipeline to Proposal Awards: Three-Tiered Program
      • The PCORI Matchmaking App Challenge
        • 2014 PCORI Matchmaking App Challenge - Runners Up
          • Judges for PCORI 2014 Challenge
        • PCORI Challenge Initiative - 2013
          • Judges for PCORI 2013 Challenge
      • Research Support Funding
        • VOI Analysis
    • Awardee Resources
      • Closed PCORI Funding Announcements
    • Help Center
  • Meetings & Events
    • Upcoming
    • Past Events

You are here

  • Blog
  • Patients Become Partners in PCORI Pee...

Patients Become Partners in PCORI Peer Review

Date: 
February 1, 2018
Blog Topics: 
Research,
Dissemination,
Guest Blogs,
Funding Awards

Peer review—independent assessment by recognized experts—is central to the research process, from deciding which study proposals to fund to evaluating articles for publication in scientific journals. At PCORI, our authorizing law requires the completed research we fund to undergo peer review, which ensures scientific integrity and adherence to our methodology standards.

But as we developed our peer-review process in 2015, we decided it should do more, incorporating our patient-centered approach to research while maintaining the principles of a time-honored scientific process. Traditionally, all peer reviewers are scientific content experts. But we added patients and other healthcare stakeholders as reviewers. The idea is that, along with asking scientists about the studies, we consult others with practical expertise and lived experience about the relevance, usefulness, and patient-centeredness of the studies.

To realize this goal, our partners at Oregon Health and Science University (including two of this blog’s coauthors), which helps manage the PCORI peer-review process, identified and trained a cadre of patients and other stakeholder reviewers. These reviewers assess completed PCORI-funded studies by analyzing the draft final research reports that PCORI’s awardees submit when they finish their projects.

More than 400 patients and other stakeholders have signed up to be PCORI peer reviewers. 50 percent are patients. 30 percent are patient advocates. 20 percent are caregivers. 100 have already completed a peer review.

Peer Review Done Differently

We began to engage patients and other stakeholders in our peer-review process in 2016, with a workshop at a conference on patient-focused healthcare issues. We tested reviewer materials to be sure that patients found them useful and clear, and that the patients’ work would meaningfully complement traditional scientific review. Our team then developed and refined online training materials for patient reviewers and outlines of questions that patients were best equipped to answer.

During PCORI’s 2017 Annual Meeting, we hosted another workshop for patient peer reviewers, in which we gathered feedback on the process, heard how their efforts have affected the way awardees’ final research reports summarize their projects and results, and brainstormed how to improve on emerging best practices. (See box below, Gaining a Seat at the Table) In the next year, we will be exploring improvements to peer review to benefit patient reviewers, including the opportunity to serve on an editorial board for peer review, and establishing a buddy system so that experienced reviewers can mentor new reviewers.

PCORI’s mission to incorporate patients throughout the research process is evident in the inclusion of several types of patient representatives—those with lived experience, caregivers, family members, and advocates from organizations that represent a disease or specific population. Peer review is no different.

A group of attendees at a PCORI meeting.

Patients and caregivers who participate in PCORI peer review attend a workshop on peer review at the 2017 PCORI Annual Meeting.

Want to Have an Impact? Become a Patient Peer Reviewer

PCORI is constantly seeking patients and other healthcare stakeholders with experiences and expertise to help us do a better job of assessing the importance of the studies we fund. Capturing the insights of a diverse group of patients is vital to providing a more holistic picture of healthcare choices.

PCORI encourages patients, family caregivers, and representatives of health-focused communities to apply to serve as PCORI peer reviewers. We’ll provide training and ongoing assistance to reviewers. For more information and to apply to become a PCORI peer reviewer, please visit our website. We look forward to welcoming more people to the growing community of patients and other stakeholders helping to support PCORI’s efforts to advance research done differently.

PCORI has offered a way for caregivers, including siblings like myself, to have a seat at the table.

Eunice Im
Gaining a Seat at the Table
Eunice Im is an administrator for a cardiology clinic, cofounder of the California Sibling Leadership Network, a caregiver for a sibling with autism, and a PCORI peer reviewer.
Headshot of Eunice Im

I was initially drawn to PCORI’s peer-review process because a member of my family has autism, and I have often served as a caregiver. That experience exposed me to the need for more patient-centered health care. Had my family known more about shared decision making and had easier access to information about evidence-based treatments for autism, my family could have been better engaged, which would have alleviated some of our emotional and spiritual distress.

So far, being a peer reviewer has been a constructive way for me to contribute toward creating a better healthcare system. I found the PCORI workshop I attended in 2017 very valuable in generating ideas that will lead to meaningful improvements in PCORI’s peer-review process. I left with a better idea of how to more skillfully contribute to the review process.

Being a part of PCORI's peer-review process has been a fulfilling experience. Siblings of people with disabilities and other chronic conditions are traditionally overlooked in health care. But over the course of their lifetime, siblings gather a wealth of knowledge and wisdom regarding what their brothers and sisters are experiencing. 

Family members of people with chronic conditions can be critical partners in deciding how to best care for those we love and playing a role in shaping the research that will make that care more effective and patient centered. We are an untapped resource. PCORI has offered a way for caregivers, including siblings like myself, to have a seat at the table. (Back to top)


The views expressed here are those of the authors and not necessarily those of PCORI.

Comments

I suggest that you use the

Ronald Frank February 1, 2018 11:13 pm

Permalink

I suggest that you use the complete name PCORI
(Patient-Centered Outcomes Research Institute) at least once in each article. Strive for clarity. Avoid repetitive use of certain words if they can be expressed in different terms.

  • reply

Hi Ronald, thank you very

PCORI February 5, 2018 1:42 pm

Permalink

Hi Ronald, thank you very much for your comment. It has been shared with our editorial team.

  • reply

Patients reviewers are

Sandra Finestone February 15, 2018 5:59 pm

Permalink

Patients reviewers are currently used within most of the research funding vehicles. They have proven to be able to provide invaluable insight within the review and even in the writing of the applications themselves. In todays research environment, not having a patient reviewer has the potential to lessen both the effectiveness and the impact of the application

  • reply

Hi Sandra, we appreciate your

PCORI February 21, 2018 9:30 am

Permalink

Hi Sandra, we appreciate your comment. Thanks so much.

  • reply

Add new comment

The content of this field is kept private and will not be shown publicly.

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Author(s): 
Headshot of Marina Broitman

Marina Broitman, PhD

Senior Program Officer, Peer Review
Peer Review
Headshot of Kira Lesley

Kira Lesley

Project Assistant, Oregon Health and Science University

Whitney McInvale, MPH

Program Associate
Public and Patient Engagement
Headshot of Rebekah Webb

Rebekah Webb, MPA

Project Coordinator, Oregon Health and Science University

Topics

Research
Dissemination
Guest Blogs
Funding Awards

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff
  • Contact Us

Research & Results

  • Explore Our Portfolio
  • Putting Evidence to Work
  • Peer Review
  • Research Topics
  • Evidence Synthesis
  • About Our Research

Engagement

  • What We Mean by Engagement
  • Engagement Awards
  • Engagement in Health Research Literature Explorer
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review Process
  • Research Support Funding Opportunities
  • Awardee Resources
  • Help Center

Meetings & Events

April 24
PCORI Online: Cycle 1 2018 Application Submission Webinar
April 30
Board of Governors Meeting: April 30, 2018
May 2
Advisory Panel on Clinical Effectiveness and Decision Science Spring 2018 Meeting

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
info@pcori.org

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2018 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Trademark Usage Guidelines | Credits | Help Center