Skip to main content
Patient-Centered Outcomes Research Institute
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Find It Fast
  • Help Center
  • Subscribe
  • Careers
  • Contact Us

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • About Us
    Close mega-menu

    About Us

    • Our Programs
    • Governance
    • Financials and Reports
    • Procurement Opportunities
    • Our Staff
    • Our Vision & Mission
    • Contact Us

    Fact Sheets: Learn More About PCORI

    Download fact sheets about out work, the research we fund, and our programs and initiatives.

    Find It Fast

    Browse through an alphabetical list of frequently accessed and searched terms for information and resources.

    Subscribe to PCORI Email Alerts

    Sign up for weekly emails to stay current on the latest results of our funded projects, and more.

  • Research & Results
    Close mega-menu

    Research & Results

    • Explore Our Portfolio
    • Research Fundamentals
    • Research Results Highlights
    • Putting Evidence to Work
    • Peer Review
    • Evidence Synthesis
    • About Our Research

    Evidence Updates from PCORI-Funded Studies

    These updates capture highlights of findings from systematic reviews and our funded research studies.

    Journal Articles About Our Funded Research

    Browse through a collection of journal publications that provides insights into PCORI-funded work.

    Explore Our Portfolio of Funded Projects

    Find out about projects based on the health conditions they focus on, the state they are in, and if they have results.

  • Topics
    Close mega-menu

    Topics

    • Addressing Disparities
    • Arthritis
    • Asthma
    • Cancer
    • Cardiovascular Disease
    • Children's Health
    • Community Health Workers
    • COVID-19
    • Dementia and Cognitive Impairment
    • Diabetes
    • Intellectual and/or Developmental Disabilities
    • Kidney Disease
    • Maternal Morbidity and Mortality
    • Medicaid
    • Men's Health
    • Mental and Behavioral Health
    • Minority Mental Health
    • Multiple Chronic Conditions
    • Multiple Sclerosis
    • Obesity
    • Older Adults' Health
    • Pain Care and Opioids
    • Rare Diseases
    • Rural Health
    • Shared Decision Making
    • Telehealth
    • Transitional Care
    • Veterans Health
    • Women's Health

    Featured Topic: Women's Health

    Learn more about the projects we support on conditions that specifically or more often affect women.

  • Engagement
    Close mega-menu

    Engagement

    • The Value of Engagement
    • Engagement in Health Research Literature Explorer
    • Influencing the Culture of Research
    • Engagement Awards
    • Engagement Resources
    • Engage with Us

    Engagement Tools and Resources for Research

    This searchable peer-to-peer repository includes resources that can inform future work in patient-centered outcomes research.

    Engagement Awards

    Learn about our Engagement Awards program and view the announcements of all our open funding opportunities.

    Research Fundamentals: A New On-Demand Training

    It enables those new to health research or patient-centered research to learn more about the research process.

  • Funding Opportunities
    Close mega-menu

    Funding Opportunities

    • What & Who We Fund
    • What You Need to Know to Apply
    • Applicant Training
    • Merit Review
    • Awardee Resources
    • Help Center

    PCORI Funding Opportunities

    View and learn about the newly opened funding announcements and the upcoming PFAs in 2021.

    Tips for Submitting a Responsive LOI

    Find out what PCORI looks for in a letter of intent (LOI) along with other helpful tips.

    PCORI Awardee Resources

    These resources can help awardees in complying with the terms and conditions of their contract.

  • Meetings & Events
    Close mega-menu

    Meetings & Events

    • Upcoming
    • Past Events

    PCORI 2021 and Beyond

    During this webinar, PCORI leaders shared ways to get involved in PCOR, improvements to our funding opportunities, and more.

    2020 PCORI Annual Meeting

    Watch recordings of sessions and view titles and descriptions of posters presented at the virtual meeting.

    PCORI Board of Governors Meeting: April 13, 1:00pm ET

    Tune in as the Board discusses possible topics in the development of upcoming PCORI Funding Announcements, among other business. Register now.

You are here

  • Research & Results
  • Peer Review
  • Peer Review FAQ

Peer Review FAQ

I. The Peer-Review Process

Contents

  1. The Peer-Review Process
  2. Preparing Draft Final Research Reports
  3. Completing the Ancillary Information COI Disclosure Form
  4. Posting of Peer-Reviewed Materials

What is the PCORI peer-review process?
The peer-review process is PCORI’s method of ensuring that we present the results from our funded research studies with the highest level of scientific integrity and adhere to the PCORI Methodology Standards in a way that is relevant and useful to patients and other decision makers. The following graphic illustrates the stages of PCORI peer review:

What are reviewers examining during the peer-review process?
Each project’s draft final research report (DFRR) will be reviewed. This report includes the background, methods, results, and conclusions for the complete PCORI-funded study protocol. It should include all aims, analyses, and outcomes. The instructions for preparing the report and a description of the report’s content can be found here.

PCORI's Peer-Review Process:

Step 1: Write your DFRR: 
-Write your DFRR.
-Submit DFRR to Editorial Manager® for peer review

Step 2: Pre-Review:
-A pre-review editor reviews your DFRR.
-If the pre-review editor requests changes, you must res

Where should awardees submit the DFRR?
Awardees should submit the DFRR via the Editorial Manager® platform (the peer-review system). Two to three months before the DFRR is due, PCORI’s Peer Review Contractor (the PCORI Editorial Office) will send an email notification that it is time to submit your structured abstract describing your study and listing key personnel and their affiliations. About two weeks before your DFRR due date, you will receive another email from our Editorial Office inviting you to submit your DFRR. The email will contain an individual link to Editorial Manager®, but awardees may also submit the DFRR by logging into Editorial Manager® here. Instructions for submission can be found here. 

What happens after the awardee submits the report?
Once submitted, the DFRR will enter pre-review. A pre-review editor will review the report to make sure that the DFRR has clearly provided the information required in the DFRR instructions. This editor will be looking to see whether the DFRR is written so that a general scientist audience can understand it well enough to evaluate the underlying scientific content. A PCORI program officer will also determine whether the report describes all of the aims, outcomes, and changes to the study protocol that the awardee planned and completed with PCORI funding. The pre-review editor sends his or her determination and any requests for revisions to the author within two weeks of receiving the DFRR for review and asks the awardee to return the revisions in two weeks.

How long does the peer-review process take?
Once the DFRR enters external peer review, the process will take about six months. This includes review by external reviewers and associate editor; two months for the author’s response; final associate editor comments; and final review by Dr. Sox plus final revisions. Peer review will take more than six months if the associate editor or Dr. Sox find that more than one revision is necessary, or if there are delays in submitting the revisions.

How will authors get the results of the peer review?
Authors will receive all peer-review decisions via email. The synthesis letter, sent after external peer review, includes the associate editor’s summary of the main issues that the reviewers identified, the unedited critiques from external peer reviewers, and the instructions for submitting any revisions. The associate editor may also send a copy of the DFRR with comments or tracked changes for the authors to review. Authors will receive any further associate editor comments and requests for revisions via email, with a link in the message to submit revisions via Editorial Manager. Dr. Sox’s reviews will also be sent via email.

How long do awardees have to respond to reviewers’ comments?
As noted in PCORI’s Process for Peer Review of Primary Research and Public Release of Research Findings, awardees have 45 working days (about two months) to respond to reviewers’ comments. However, we are willing to work with awardees to adjust these deadlines. If editors request additional revisions, awardees will have two to four weeks to respond, depending on the extent of the edits.

What happens after authors revise their report?
When authors complete their revisions, they submit the clean, revised DFRR as well as a tracked-changes version via Editorial Manager®, along with a response letter in which they address the reviewers’ comments. All revisions will be submitted in the same manner, except for the final PCORI review; this will be sent directly via email to Dr. Sox.

What is the difference between the DFRR and the final research report (FRR)?
We consider the submitted report to be a draft until it has been peer-reviewed, revised if necessary, and accepted by PCORI (i.e., completed Dr. Sox’s review). After acceptance, the FRR will be copyedited and posted on our website.

Back to Top

II. Preparing Draft Final Research Reports

What is the difference between the final progress report and the DFRR, both of which are due at the end of the study?
The final progress report documents the final phase of the study. It includes how the study was completed; whether the team met the milestones set forth in the contract; any challenges encountered; remedial actions taken in mitigating and resolving concerns, including risks to study completion; and notable accomplishments. Study findings are not necessarily included in the final progress report. PCORI staff review the final progress report, but it is not publicly disclosed.

In contrast, the DFRR documents all of the work completed in the PCORI-funded study. This report must include a detailed description of the study’s background, methods, results, and conclusions, consistent with PCORI’s Process for Peer Review of Primary Research and Public Release of Research Findings. The DFRR goes through external peer review and the awardee may revise it before PCORI accepts it as the FRR. This final report will be posted on the PCORI website on the project’s web page and will be available for anyone to use.

What attachments should awardees include with the DFRR?
The Instructions to Awardees provide a detailed description of the attachments to include. Along with the DFRR, your submission should include a copy of your study protocol, the PCORI Methodology Standards Checklist, the Ancillary Information COI Disclosure Form identifying conflicts of interest (COIs) for you and the institution, and the Ancillary Information Return of Aggregate Research Results Form. The Research Results Form collects information about the awardee’s completed and/or planned efforts to return complete study results to research participants. For more information about this form, please review the frequently asked questions at the PCORI Help Center. Finally, include a file with high-resolution copies of any figures that you include in your DFRR. This helps us make sure that peer reviewers have clear copies of the figures and improves the quality of the report when we prepare it for posting.

How polished must the DFRR be?
Awardees should submit their best version of a final research report, following the formatting guidelines outlined in the Instructions to Awardees. The submitted DFRR should be carefully edited to make sure that the report is clear and understandable by general scientist readers. The report should include all analyses and results planned in the study protocol and statistical analysis plan. If the report does not meet the submission requirements, it may be returned for revisions before moving forward to review.

A manuscript with our study’s main findings has been peer-reviewed and published in a journal. Can I submit that as my report?
No. The DFRR must follow the Instructions to Awardees to be considered adequate for peer review. Peer-reviewed journal articles also tend to focus on only part of the research conducted in a funded study, whereas the DFRR should include a full accounting of the methods and analyses planned in the study protocol. 

Can I use parts of the published manuscript in the DFRR, such as previously published tables and figures?
The DFRR can include information, such as tables, figures, and sections of text, from previously published journal articles (see the Instructions to Awardees for detailed recommendations on including these materials). Cite the source of the material, including any long sections of text, taken directly from such publications. Awardees are responsible for checking with the journal publisher and, if necessary, getting permission for reprinting or using any part of the published article in the FRR, which will be made publicly available on PCORI’s website following peer review and finalization. Authors should comply with any stipulations the journal publisher sets regarding reuse of materials. Please note that the permissible use of previously published content may depend on the length of text and whether the authors transferred copyright to the journal as part of the author agreement. Please include a copy of any relevant copyright permissions or licenses for PCORI’s records as a separate file with your submission of the DFRR. Remember that the author, not PCORI, is liable for any unauthorized duplication of material from previously published articles that appears in the FRR.

Back to Top

III. Completing the Ancillary Information COI Disclosure Form

Who needs to complete and sign the Ancillary COI Disclosure Form?
The Ancillary Information Conflicts of Interest (COI) Disclosure Form captures COI information related to the study and FRR as listed in our authorizing law:

--PUBLIC AVAILABILITY.—The Institute shall make available to the public and disclose through the official public Internet website of the Institute the following: …The process and methods for the conduct of research, including the identity of the entity and the investigators conduc[t]ing such research and any conflicts of interests of such parties, any direct or indirect links the entity has to industry, and research protocols, including measures taken, methods of research and analysis, research results, and such other information the Institute determines appropriate concurrent with the release of research findings. [42 U.S.C. § 1320e(h)(3), italics added for emphasis.]

The institution that received the study funding (i.e., awardee institution) is responsible for completing the COI form, and a principal investigator and an administrative official from the awardee institution must sign the COI form for it to be considered complete.

What does PCORI consider to be a conflict of interest?
PCORI has modeled aspects of the COI form based on the NIH Grants & Funding policy. For more information on this policy, please visit https://grants.nih.gov/grants/policy/coi/index.htm

Regarding COIs, awardees should disclose any financial or business associations or personal associations related to health care (e.g., if you or someone in your immediate family has worked for or volunteered for a healthcare-related organization, or received payment for or owned stock in a medical device patent or manufacture.)

Do all key personnel from the study have to be on the same form?
All current key personnel on the research project should be listed on the same COI form, even if they are not all listed as authors on the DFRR. If you have had any changes in key personnel, please inform your assigned program officer or program associate so they can make the appropriate updates in the project record.

Do awardees need to include personnel from other institutions on the same COI form that the official from the awardee institution signs? Can awardees submit a separate COI form for each institution involved in this project?
The awardee institution is responsible for the collection of COI statements from all key personnel of the research project. All key personnel should be listed on one form, but if necessary, awardees may add additional pages to list all potential COI statements.

Do awardees have to submit their COI form at the same time as the DFRR?
In general, awardees should submit their COI form at the same time as their DFRR. However, PCORI understands that different institutions have different processes for signing off on conflict disclosure documentation. If the COI form is not complete by the time you are due to submit your DFRR, please notify the PCORI Peer Review Office (peerreview@pcori.org) .

Back to Top

IV. Posting of Peer-Reviewed Materials

What will be posted on PCORI’s website after the peer-review process is complete, and when?
As noted in PCORI’s Process for Peer Review of Primary Research and Public Release of Research Findings document, approved by the Board of Governors, PCORI will post the following within 90 days (3 months) of accepting the FRR:

  • A public-facing summary developed by the PCOR Translation Center after review by the awardee (with audio and Spanish translations available)
  • A 500-word abstract for medical professionals
  • A link to the study results tables on ClinicalTrials.gov (as applicable)
  • Ancillary Information COI Disclosure Form

Within 12 months of accepting the FRR, PCORI will post the following:

  • A summary of the peer-review process
  • The FRR with accompanying appendices if applicable
  • The final study protocol, if available

What information is posted online about the peer review of the DFRR?
As with any peer-review process, the editors and content experts who review the DFRRs often ask the researchers to address concerns about the way they conducted the project, their results, and their conclusions. Awardees usually revise the report to address these concerns to the reviewers’ satisfaction, and PCORI posts a summary of that process along with public and professional abstracts of the study results.

On rare occasions, researchers disagree with a reviewer comment that is key to interpreting the study results. When that disagreement cannot be resolved, PCORI describes it in the peer-review summary but invites awardees to submit a brief explanation of their reasoning if they wish. We limit such statements to 200 words, and they are subject to review by PCORI program staff. Any such awardee response will be posted online with the peer-review summary.

We do not expect awardees to ask to write a response to the peer-review summary when there are no unresolved issues. But if an awardee does so, or asks for changes to the summary for clarification, we will consider such requests on a case-by-case basis.

After the FRR is posted to the PCORI website, may awardees submit additional results?
Yes, awardees may update or otherwise refine the information posted on the project page for their FRR, for example, to align with information in other publications or updates submitted to ClinicalTrials.gov, or to provide new or updated material. PCORI may decide to re-review the materials if there is a significant change to the final report or any changes to the study conclusions.

Is posting results tables to ClinicalTrials.gov considered prior publication? What about the summaries or abstracts posted on PCORI’s website?

Most journals do not consider posting of results on a registry like ClinicalTrials.gov or in summaries of 500 words or less to be prior publication. Our policy regarding the posting of these results conforms to the recommendations of the International Committee of Medical Journal Editors (ICMJE): “The ICMJE will not consider as prior publication the posting of trial results…if results are limited to a brief (500 word) structured abstract or tables (to include patients enrolled, key outcomes, and adverse events).”

Please let us know if a journal editor raises concerns so that we can contact him or her directly to discuss them.

Similarly, the ICMJE does not consider as prior publication the author’s requirements under the Food and Drug Administration Amendments Act of 2007, U.S. Public Law 110-85, Title VIII, to post results tables on ClinicalTrials.gov. For more information, see:

  • ICMJE Statement: http://www.icmje.org/recommendations/browse/publishing-and-editorial-issues/clinical-trial-registration.html
  • ICMJE FAQ: http://www.icmje.org/about-icmje/faqs/clinical-trials-registration/ 

Are there any restrictions on where awardees can publish articles based on PCORI-funded research? For example, are awardees expected to publish only in open-access journals?
Awardees may publish articles resulting from PCORI-funded projects in any journal at any time. We expect that awardees will notify us when they submit manuscripts to journals and when journals accept those manuscripts for publication. We also ask that awardees inquire about open-access options because of our interest in linking to the published articles from our website. For more information about PCORI’s policy, please refer to Public Access to Journal Articles Presenting Findings from PCORI-Funded Research.

Does PCORI peer-review manuscripts submitted before the completion of the study?
PCORI does not peer-review manuscripts submitted to journals at any time. As noted above, we ask awardees to keep PCORI informed of their plans for publication.

If the FRR posts no later than 12 months after acceptance, what will happen if a manuscript describing that work has not yet published in a peer-reviewed journal? Most journals require that the information in submitted manuscripts not be published previously.
PCORI will work closely with awardees, investigators, and journals to coordinate posting of the FRR with publication of manuscripts in press. However, we must balance journal publication with our obligation under our authorizing law, affirmed through public comments on our draft Peer-Review Process document, to make the results of PCORI- funded research widely available to the public as expeditiously as possible. The document states, “PCORI may delay posting beyond 12 months to coordinate posting with publication of a peer-reviewed journal version of study findings."

Back to Top


Posted: March 27, 2017; Updated: December 16, 2020

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff
  • Our Vision & Mission
  • Contact Us

Research & Results

  • Explore Our Portfolio
  • Research Fundamentals
  • Research Results Highlights
  • Putting Evidence to Work
  • Peer Review
  • Evidence Synthesis
  • About Our Research

Engagement

  • The Value of Engagement
  • Engagement in Health Research Literature Explorer
  • Influencing the Culture of Research
  • Engagement Awards
  • Engagement Resources
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review
  • Awardee Resources
  • Help Center

Meetings & Events

April 12
Engagement Awards 2021 Special Cycle -- Applicant Office Hours (Three)
April 13
Board of Governors Meeting: April 13, 2021
April 19
Increasing Vaccine Confidence among Long-Term Care Workers: Expedited COVID-19 PFA -- Applicant Town Hall

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
info@pcori.org

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2021 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Trademark Usage Guidelines | Credits | Help Center