Skip to main content
Patient-Centered Outcomes Research Institute
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Find It Fast
  • Help Center
  • Subscribe
  • Careers
  • Contact Us

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • About Us
    Close mega-menu

    About Us

    • Our Programs
    • Governance
    • Financials and Reports
    • Procurement Opportunities
    • Our Staff
    • Our Vision & Mission
    • Contact Us

    Fact Sheets: Learn More About PCORI

    Download fact sheets about out work, the research we fund, and our programs and initiatives.

    Find It Fast

    Browse through an alphabetical list of frequently accessed and searched terms for information and resources.

    Subscribe to PCORI Email Alerts

    Sign up for weekly emails to stay current on the latest results of our funded projects, and more.

  • Research & Results
    Close mega-menu

    Research & Results

    • Explore Our Portfolio
    • Research Fundamentals
    • Research Results Highlights
    • Putting Evidence to Work
    • Peer Review
    • Evidence Synthesis
    • About Our Research

    Evidence Updates from PCORI-Funded Studies

    These updates capture highlights of findings from systematic reviews and our funded research studies.

    Journal Articles About Our Funded Research

    Browse through a collection of journal publications that provides insights into PCORI-funded work.

    Explore Our Portfolio of Funded Projects

    Find out about projects based on the health conditions they focus on, the state they are in, and if they have results.

  • Topics
    Close mega-menu

    Topics

    • Addressing Disparities
    • Arthritis
    • Asthma
    • Cancer
    • Cardiovascular Disease
    • Children's Health
    • Community Health Workers
    • COVID-19
    • Dementia and Cognitive Impairment
    • Diabetes
    • Kidney Disease
    • Medicaid
    • Men's Health
    • Mental and Behavioral Health
    • Minority Mental Health
    • Multiple Chronic Conditions
    • Multiple Sclerosis
    • Obesity
    • Older Adults' Health
    • Pain Care and Opioids
    • Rare Diseases
    • Rural Health
    • Shared Decision Making
    • Telehealth
    • Transitional Care
    • Veterans Health
    • Women's Health

    Featured Topic: Women's Health

    Learn more about the projects we support on conditions that specifically or more often affect women.

  • Engagement
    Close mega-menu

    Engagement

    • The Value of Engagement
    • Engagement in Health Research Literature Explorer
    • Influencing the Culture of Research
    • Engagement Awards
    • Engagement Resources
    • Engage with Us

    Engagement Tools and Resources for Research

    This searchable peer-to-peer repository includes resources that can inform future work in patient-centered outcomes research.

    Explore Engagement in Health Literature

    This tool enables searching for published articles about engagement in health research.

    Research Fundamentals: A New On-Demand Training

    It enables those new to health research or patient-centered research to learn more about the research process.

  • Funding Opportunities
    Close mega-menu

    Funding Opportunities

    • What & Who We Fund
    • What You Need to Know to Apply
    • Applicant Training
    • Merit Review
    • Awardee Resources
    • Help Center

    PCORI Funding Opportunities

    View and learn about the newly opened funding announcements and the upcoming PFAs in 2021.

    Tips for Submitting a Responsive LOI

    Find out what PCORI looks for in a letter of intent (LOI) along with other helpful tips.

    PCORI Awardee Resources

    These resources can help awardees in complying with the terms and conditions of their contract.

  • Meetings & Events
    Close mega-menu

    Meetings & Events

    • Upcoming
    • Past Events

    PCORI Webinar: February 2, 2pm ET

    Hear from PCORI leaders about ways to get involved in PCOR, improvements to our funding opportunities, and more. Register

    Confronting COVID-19: A Webinar Series

    Learn more about the series and access recordings and summary reports of all six sessions.

    2020 PCORI Annual Meeting

    Watch recordings of all sessions, and view titles and descriptions of the posters presented at the virtual meeting.

You are here

  • Research & Results
  • Peer Review
  • The Peer Review Process

The Peer Review Process

How do we assess scientific integrity? Scientific integrity refers to transparency, completeness, and candor as applied to presentations of the scientific work. From experience with journal peer review, we know that some authors communicate only the findings that present their research in the most positive light and underplay the importance of shortcomings in the conduct of the research. Selective reporting of study results and study limitations might lead a reader to have more confidence in the conclusions than the results warrant. Consumers of research need to know the whole story. We ask research teams to provide a full report on the research, including a full account of any cautions about interpreting the study results. 

PCORI-funded researcher Mike Jones, PhD shares the value of PCORI’s peer-review process, what distinguishes it from journal review, and his advice to others getting ready to go through the process.

How do we assess methodological rigor? A comprehensive list of The PCORI Methodology Standards that our Methodology Committee developed in 2013 and subsequently expanded to cover additional topics. These include both broad standards—those that should be followed by all patient-centered outcomes research studies—and specific standards, which apply only to certain types of studies. Our peer-review process will evaluate how well the investigators met our methodology standards. 

How do we assess relevance and usefulness? Scientific integrity and methodological rigor are specific goals in our authorizing legislation. Our Board added a third goal when it approved our peer-review process in 2015. The Board wanted to ensure that the final research reports address real problems faced by patients, caregivers, clinicians, and others. In our peer-review process, we ask patients and other stakeholders serving as reviewers whether the research findings will help people like them make healthcare decisions.

What are the Investigator’s Responsibilities in Peer Review?

The principal investigator, who heads the research team, is responsible for meeting the peer-review milestones laid out in the research contract. These obligations include submitting results tables to ClinicalTrials.gov or another approved study registry, submitting the draft final research report for peer review, and revising the report in response to comments from peer reviewers and peer-review editors.

The draft final research report is due about three months after data analysis for the research project is complete. PCORI awardees must submit their results to ClinicalTrials.gov or another approved study registry at least one month before the draft final research report due date.

The instructions for completing the draft final research report provide a detailed guide to writing the report. The instructions are quite specific about the structure of the draft final research report, but principal investigators may contact the PCORI Peer Review Office if they think that the format prescribed in the instructions does not fit with their study.

How Does Peer Review Work?

Peer review is part of PCORI's program to put knowledge gained from high-quality patient-centered outcomes research into practice.

1 month:
-DFRR preparation and submission
-Pre-review check for clarity and completeness
6-7 months:
-DFRR enters peer review > Reviewer comments back to author
-First revision decision made > May have additional revisions
-PCORI final review

Our peer-review process begins with our peer-review contractor, the PCORI Editorial Office, inviting the principal investigator to submit an abstract and other information to our electronic peer-review system, which many medical journals use similar tracking systems for peer review. This allows for the contractor to begin identifying and inviting reviewers for the report up to three months before the principal investigator submits the report.

On or around the due date, the principal investigator submits a draft final research report that includes background about the project and the project’s aims, methods, results, discussion of all study aims, and conclusions. The principal investigator submits the draft final research report to our electronic peer-review system. At PCORI, an experienced member of our peer-review staff reviews the draft final research report to make sure that the writing is clear and follows the prescribed structure outlined in report instructions for awardees. PCORI science staff also make sure that the final report includes all of the funded study activities. After this pre-review, the principal investigator will have two weeks to make any changes before the report can move forward to external peer review. 

Once the report is deemed ready for peer review, the already invited peer reviewers receive access to the report in the peer-review system. The associate editor reads through the completed reviewer comments, assembles their key concerns and suggestions into a letter to the principal investigator that also includes those unedited reviewer comments. The principal investigator then has 45 working days, about nine weeks, to respond to the points raised and to make changes in the draft report.

PCORI's Process for Peer Review of Research Studies graphic
Researchers (Scientists, Clinicians, Patients, Methodologists) > Draft Final Report > Preview for Clarity (PCORI Staff, Experienced Editors) > Revisions by Principal Investigator &

The associate editor then determines whether the revised report has addressed reviewers’ comments adequately or if the principal investigator needs to make more revisions. If the revision fails to address major concerns, a second round of peer review may be necessary. Once the report has completed all requirements of peer review, the PCORI Program Director for Peer Review and Scientific Publications determines whether it is ready to be accepted as final. The director may require another round of revisions.

Once PCORI accepts the final research report, the Patient-Centered Outcomes Research Translation Center completes two summaries of the project—a lay summary for the public and a professional abstracted aimed at health professionals—in accordance with our authorizing law. PCORI will also post the peer-review summary (short summary of the main points brought up during peer review and how they were handled) and later the final research report on the project’s web page on the PCORI website.

Additional Resources
  • Webinar: How to Prepare for PCORI Review
    With Eric Johnson, PhD; Associate Director & Associate Editor, Editorial Office
    December 9, 2019
  • PCORI Peer Review: Awardee Preparation for Peer Review 
    2018 PCORI Annual Meeting Workshop
  • Instructions for Submitting Materials to Editorial Manager™
  • PCORI Policy for Data Management and Data Sharing
  • The PCORI Methodology Standards

Posted: March 8, 2019; Updated: December 12, 2019

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff
  • Our Vision & Mission
  • Contact Us

Research & Results

  • Explore Our Portfolio
  • Research Fundamentals
  • Research Results Highlights
  • Putting Evidence to Work
  • Peer Review
  • Evidence Synthesis
  • About Our Research

Engagement

  • The Value of Engagement
  • Engagement in Health Research Literature Explorer
  • Influencing the Culture of Research
  • Engagement Awards
  • Engagement Resources
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review
  • Awardee Resources
  • Help Center

Meetings & Events

February 2
PCORI 2021 and Beyond: Opportunities for Funding and Involvement in Patient-Centered Research
February 9
Board of Governors Meeting: February 9, 2021
February 11
Advisory Panel on Patient Engagement Winter 2021 Meeting

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
[email protected]

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2021 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Trademark Usage Guidelines | Credits | Help Center