Skip to main content
Patient-Centered Outcomes Research Institute
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Find It Fast
  • Help Center
  • Subscribe
  • Careers
  • Contact Us

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • About Us
    Close mega-menu

    About Us

    • Our Programs
    • Governance
    • Financials and Reports
    • Procurement Opportunities
    • Our Staff
    • Our Vision & Mission
    • Contact Us

    Fact Sheets: Learn More About PCORI

    Download fact sheets about out work, the research we fund, and our programs and initiatives.

    Find It Fast

    Browse through an alphabetical list of frequently accessed and searched terms for information and resources.

    Subscribe to PCORI Email Alerts

    Sign up for weekly emails to stay current on the latest results of our funded projects, and more.

  • Research & Results
    Close mega-menu

    Research & Results

    • Explore Our Portfolio
    • Research Fundamentals
    • Research Results Highlights
    • Putting Evidence to Work
    • Peer Review
    • Evidence Synthesis
    • About Our Research

    Evidence Updates from PCORI-Funded Studies

    These updates capture highlights of findings from systematic reviews and our funded research studies.

    Journal Articles About Our Funded Research

    Browse through a collection of journal publications that provides insights into PCORI-funded work.

    Explore Our Portfolio of Funded Projects

    Find out about projects based on the health conditions they focus on, the state they are in, and if they have results.

  • Topics
    Close mega-menu

    Topics

    • Addressing Disparities
    • Arthritis
    • Asthma
    • Cancer
    • Cardiovascular Disease
    • Children's Health
    • Community Health Workers
    • COVID-19
    • Dementia and Cognitive Impairment
    • Diabetes
    • Kidney Disease
    • Medicaid
    • Men's Health
    • Mental and Behavioral Health
    • Minority Mental Health
    • Multiple Chronic Conditions
    • Multiple Sclerosis
    • Obesity
    • Older Adults' Health
    • Pain Care and Opioids
    • Rare Diseases
    • Rural Health
    • Shared Decision Making
    • Telehealth
    • Transitional Care
    • Veterans Health
    • Women's Health

    Featured Topic: Women's Health

    Learn more about the projects we support on conditions that specifically or more often affect women.

  • Engagement
    Close mega-menu

    Engagement

    • The Value of Engagement
    • Engagement in Health Research Literature Explorer
    • Influencing the Culture of Research
    • Engagement Awards
    • Engagement Resources
    • Engage with Us

    Engagement Tools and Resources for Research

    This searchable peer-to-peer repository includes resources that can inform future work in patient-centered outcomes research.

    Explore Engagement in Health Literature

    This tool enables searching for published articles about engagement in health research.

    Research Fundamentals: A New On-Demand Training

    It enables those new to health research or patient-centered research to learn more about the research process.

  • Funding Opportunities
    Close mega-menu

    Funding Opportunities

    • What & Who We Fund
    • What You Need to Know to Apply
    • Applicant Training
    • Merit Review
    • Awardee Resources
    • Help Center

    PCORI Funding Opportunities

    View and learn about the newly opened funding announcements and the upcoming PFAs in 2021.

    Tips for Submitting a Responsive LOI

    Find out what PCORI looks for in a letter of intent (LOI) along with other helpful tips.

    PCORI Awardee Resources

    These resources can help awardees in complying with the terms and conditions of their contract.

  • Meetings & Events
    Close mega-menu

    Meetings & Events

    • Upcoming
    • Past Events

    January 2021 Board of Governors Meeting

    The Board approved funding for a new research study relating to kidney health and a new funding allocation for PCORnet. Learn more

    Confronting COVID-19: A Webinar Series

    Learn more about the series and access recordings and summary reports of all six sessions.

    2020 PCORI Annual Meeting

    Watch recordings of all sessions, and view titles and descriptions of the posters presented at the virtual meeting.

You are here

  • Blog
  • Patient Peer Review, PCORI Style

Patient Peer Review, PCORI Style

Date: 
December 14, 2020
Blog Topics: 
Guest Blogs,
Peer Review Blogs,
Research

The Patient-Centered Outcomes Research Institute (PCORI) is a unique organization that, as its name implies, engages patients in all its work. One aspect of that work is peer review, which is traditionally the bastion of scientists and academics. PCORI peer review is different because it includes patient peer reviewers who bring the knowledge and perspectives acquired through their own experiences to ensure the quality and usefulness of PCORI’s research findings.

December 2020 marks the four-year anniversary of patient peer review of PCORI-funded research reports. As one of the first US institutions to include patients in the peer review of scientific publications, PCORI has encountered challenges, but more importantly, we have many successes to celebrate. Foremost, since the inception of the PCORI Peer Review Program, a patient peer reviewer has provided insights and recommendations on more than 98 percent of PCORI-funded research reports.

Peer review—independent assessment by recognized experts—is central to the research process and to PCORI’s goal of providing research results from our funded studies to everyone who could use them. As a contractor with PCORI managing our peer-review process for research reports, Oregon Health and Science University (OHSU) fulfills one of our main goals of patient engagement by ensuring that patient peer reviewers bring their voice to the review of these reports.

Editorial Board Member Jeffrey Oliver, MBA, describes his experience as a patient peer reviewer.

The PCORI Patient Peer Review Editorial Board, established in 2018, is a group of the best and most active patient peer reviewers that guide these efforts. With critical input from the editorial board, the OHSU Editorial Office has revised the patient peer-review form to elicit more patient-specific, constructive, and operational feedback; updated the online patient peer-reviewer training to include more interactive components; and developed a process for assigning well-matched, proficient patient peer reviewers to reports that require a rapid turnaround.

Enthusiastic Response

Patient peer reviewers have expressed genuine excitement to be included in the process. Many are grateful for the opportunity to review, and they are even more committed to patient peer review after participating.

More than 100 patient peer reviewers have accessed the PCORI online patient peer-reviewer training since 2017, while 67 patient peer reviewers have reviewed two or more PCORI-funded research reports.

Compared to scientific and other stakeholder reviewers, patient peer reviewers have the highest rate of accepting invitations to review and the lowest rate of "dropout" (i.e., failing to complete a review) once they have agreed to review. They also complete their reviews in the shortest amount of time.

For the Peer Review blog published in December 2020. Over 600 patients and patient stakeholders have signed up to be PCORI peer reviewers. 52 percent are patients, 35 percent are patient advocates and 13 percent are unpaid caregivers. 175 patient peer rev

We thank all the patients, caregivers, and patient advocates who have been a part of the first four years of PCORI Patient Peer Review. They have contributed to PCORI’s mission of patient-centeredness and patient inclusion in the research process, and their insights have helped hundreds of authors revise their research reports to be more meaningful and useful to patients and caregivers.

Looking Forward to 2021

The upcoming year is going to be a busy one for PCORI Peer Review. PCORI will start reviewing the first batch of large pragmatic trials that focus on the effectiveness of interventions in real-world clinical settings, as well as a significant cohort of COVID-19 research enhancement projects. We need a diverse group of patients and patient stakeholders (caregivers and patient advocates) to join us in peer review of PCORI’s patient-centered, comparative clinical effectiveness research.

PCORI provides online training, one-on-one support, and a small honorarium to its peer reviewers. For more information about peer review, please visit our peer review pages and sign up to become a patient peer reviewer by completing the application here.

Patient Peer Review: A Testament That Together Is Better
By Betty J. Scull, MPA, MA
Betty J. Scull

After my mother succumbed to chronic diabetes in 2012, I—as a retired non-health professional patient stakeholder—was excited to bring my voice to the national patient and stakeholders’ council of a five-year health research project funded by PCORI and the National Institute on Aging in 2014. Shortly thereafter, I became a PCORI Ambassador and patient peer reviewer.

Patient engagement in the peer-review process provides a place where the patient’s voice can be partnered in a meaningful way with that of other stakeholders to review PCORI research reports before they are published. For example, I review the entire report, but unlike researchers and clinicians, I focus on whether there is evidence of meaningful patient engagement throughout the research process and make an assessment of the reported health outcomes and benefits and their relevance to the target patients/caregivers.

I also assess whether the research results contribute to improved health research overall, and I notify the editors of any harms, risks, or biases to the participants that I may ascertain. Finally, because I provide a lay perspective on the process, the readability of a report is important to me to ensure that the report will be meaningful to patients, caregivers, and the public. Thus, my review may include a critique of the text for flaws of a substantive and/or editorial nature.

If patients, healthcare professionals, and researchers continue working together throughout the peer-review process, so much more can be accomplished toward improving the quality, relevance, and moral and ethical values of health research.

Add new comment

The content of this field is kept private and will not be shown publicly.

More information about text formats

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Author(s): 

Kelly Vander Ley, PhD

Deputy Director and Associate Editor, Oregon Health and Science University

Rebekah Webb, MPA

Project Coordinator, Oregon Health and Science University

Marnie Colton, MFA

Medical Editor, Peer Review
Peer Review

Topics

Guest Blogs
Peer Review Blogs
Research

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff
  • Our Vision & Mission
  • Contact Us

Research & Results

  • Explore Our Portfolio
  • Research Fundamentals
  • Research Results Highlights
  • Putting Evidence to Work
  • Peer Review
  • Evidence Synthesis
  • About Our Research

Engagement

  • The Value of Engagement
  • Engagement in Health Research Literature Explorer
  • Influencing the Culture of Research
  • Engagement Awards
  • Engagement Resources
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review
  • Awardee Resources
  • Help Center

Meetings & Events

February 2
PCORI 2021 and Beyond: Opportunities for Funding and Involvement in Patient-Centered Research
February 9
Board of Governors Meeting: February 9, 2021
February 11
Advisory Panel on Patient Engagement Winter 2021 Meeting

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
[email protected]

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2021 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Trademark Usage Guidelines | Credits | Help Center