Merit Reviewer FAQs
Click on the links below to learn more about PCORI's Merit Reviewer application process. top
General FAQs | Becoming a Reviewer | Training | Technology | Evaluation | Online Merit Review | Merit Review Panel Discussions | Attendance | Compensation
General FAQs
What are the differences between scientific reviewers, patient reviewers and other stakeholder reviewers?
PCORI’s scientific reviewer community includes members of the health and healthcare research communities with technical or specialized research backgrounds.
PCORI’s stakeholder reviewer community includes patients, caregivers, clinicians, policy makers, and other healthcare system stakeholders. PCORI defines stakeholder reviewer communities as follows:
- Patients (Persons with current or past experience of illness or injury, family members or other unpaid caregivers of patients or members of advocacy organizations that represent patients or caregivers)
- Clinicians (Healthcare professionals working in a clinical setting, including physicians, nurses, physician assistants, rehabilitative professionals, pharmacists, mental healthcare providers and complementary and alternative healthcare providers, as well as professional societies serving clinicians)
- Researchers (Those who conduct clinical research, including investigators or funders of research as well as organizations or associations representing the research community)
- Purchasers (Those who purchase health benefits for employees and their dependents, including individual businesses as well as local, state, regional and national business groups; coalitions that represent businesses; and health coalitions)
- Payers (Those who function as financial intermediaries in the health system, including private insurers and public insurers, as well as organizations representing insurers, such as America’s Health Insurance Plans)
- Industry (Companies that design, invest in or manufacture diagnostics, devices, pharmaceuticals, electronic records systems and mobile apps, and organizations representing the life sciences industry, such as the Advanced Medical Technologies Association)
- Hospitals and Health Systems (Organizations where care is delivered, including public and private hospitals and health systems, urgent care centers, retail health clinics and community health centers, as well as organizations representing these facilities)
- Policymakers (Those who help craft public policy at any level of government, including federal, state, and local government officials; federal, state, and local units of government; and organizations that represent policy makers)
- Training Institutions (Those that deliver health professional education, including public and private universities and colleges; individuals affiliated with the delivery or administration of health professional education; and trade or professional associations representing these institutions, organizations and individuals)
PCORI assigns scientific reviewers, as well as patient and stakeholder reviewers, to every application for online review. PCORI recognizes that some reviewers have multiple roles, including as patients or caregivers, and asks that reviewers distinguish the reviewer type with which they primarily identify.
Does PCORI have a standing panelist designation for reviewers?
Our changing needs and our more targeted funding strategy have led us to phase out the standing panelist designation. We will continue to collaborate with our excellent returning reviewers, including those who have served as standing panelists.
Can I serve as a reviewer if I also plan to submit an application to a PCORI Funding Announcement) PFA?
Yes. However, PCORI does not permit applicants (principal investigator and key personnel) to serve as reviewers for the same PFA for which their application is currently being reviewed.
I have the opportunity to serve on a PCORI advisory panel. Am I still eligible to serve as a PCORI reviewer?
Yes. Members of advisory panels can also serve as PCORI reviewers.
Will applicants be able to see my reviews directly?
Yes. Applicants will be provided with the written critiques for their application, but the anonymity of the reviewers will be preserved.
Will my name be published as a reviewer?
PCORI gives merit reviewers the opportunity to be included in PCORI's publicly available Annual Report. Additionally, merit reviewers' names, degree(s) and affiliations are published on PCORI's website. This is intended to acknowledge and express our appreciation for the services and contributions of PCORI merit reviewers. Please note that the listing of reviewers, while largely complete, will not include individuals who request to have their personal information withheld for privacy. PCORI will not identify which panels reviewers served on.
Becoming a Reviewer
How does PCORI select reviewers for each cycle?
PCORI assesses its need for specific reviewer types based on the quantity and topic areas of applications received for each cycle. Invited reviewers are then assigned applications based on availability, experience and corresponding fit with the applications in the panel.
Can non-U.S. residents become PCORI reviewers?
PCORI will primarily recruit merit reviewers who reside in the United States and its territories. If you live in other countries in North America (Canada, Mexico), you are welcome to apply. We may recruit reviewers to serve during a review cycle if they have expertise that is not represented by our current U.S.-based reviewers. If you live outside of North America, we cannot accept your application to review for PCORI. For more information, visit our Become a Merit Reviewer page.
When will I be notified of my application status as a PCORI reviewer?
PCORI vets reviewers on an ongoing basis and will notify you of your status within approximately one week of receiving your application. (Check your spam/junk folder, just in case.) If you have any questions, contact us at pfa@pcori.org.
If I was previously accepted to the PCORI reviewer pool, do I need to reapply to participate in future cycles?
No. As a member of our reviewer pool, a merit review officer (MRO) may contact you to assess your availability to serve on an upcoming cycle if your experience and expertise align with the applications we receive.
If I am no longer able to serve as a reviewer for a particular cycle, what is the process for alerting PCORI?
Reviewers should send an email to pfa@pcori.org and email their MRO if they are currently working with one.
What if I indicated that I was available but was not assigned applications for Merit Review?
There is always a possibility that you may not be assigned to review applications. PCORI’s aim is to match the content of the application to the expertise and experience of the reviewer, while also developing a panel representative of the patient and stakeholder communities. In the event that you are not assigned an application to review for this cycle, PCORI will keep you in consideration for future review cycles.
How will I know if I have not been selected as a reviewer for this current cycle?
If you were selected to indicate Conflicts of Interest (COIs) and expertise on applications, but not selected as a reviewer, you will receive an email notification from an MRO informing you of your reviewer status for the current review cycle.
If I am not accepted to be a PCORI reviewer, how else can I get involved with PCORI?
We appreciate your interest in PCORI and have several other opportunities to become involved with PCORI. Learn about more ways to get involved or send an email to getinvolved@pcori.org to learn more.
Training Resources
Is previous training required to be a PCORI reviewer?
No, previous training is not required to be a PCORI reviewer. However, once reviewers are assigned to review within a cycle, they are required to review the PCORI merit reviewer training resources. These training materials are updated each cycle to reflect changes in the PFA and merit review process.
When will I receive training?
Once application assignments have been made, the assigned reviewers will be provided with training materials.
Where can I find reviewer training materials and sample reviews?
If you are a reviewer for the current review cycle, you will receive a direct link to the training materials from your MRO.
If I have already taken PCORI reviewer training, do I need to take it again?
Yes. PCORI is continually improving its Merit Review process based on reviewer feedback. As policies and procedures change from cycle to cycle, all reviewers are required to review the provided training resources each cycle.
Technology
Why must I have computer and internet access to serve as a PCORI reviewer?
Reviewer tasks are completed online. Tasks include all training, correspondence, viewing applications in the PCORI Online system and submitting critiques and scores in the system.
Do I have to own a computer?
No. PCORI does not require ownership of a computer to be a reviewer, but PCORI reviewers need to have access to a computer and internet on a regular basis.
Can I use a tablet computer to conduct the online review portion?
No; we encourage Reviewers to use a computer to conduct the online review portion when writing, entering and submitting them into the system along with their scores. Tablet computers are not compatible with the PCORI Online system.
What technology is required to serve as a PCORI reviewer on a virtual panel?
In addition to having computer and internet access, reviewers are encouraged to have access to headphones with a microphone when serving on a virtual panel. Use of a laptop camera or webcam is highly encouraged but not required.
Evaluation
What is PCORI’s scoring rubric?
The PCORI scoring system is based on a nine-point scale. Numerically high scores (for example, scores of 7 to 9) reflect applications that have major weaknesses, while numerically low scores (for example, scores of 1 to 3) are associated with applications that have minor weaknesses. Reviewers are asked to utilize the whole scoring range.
How do reviewers develop the overall score and narrative?
Each criterion score should have its own consideration, but the overall score should reflect the merit of the application as a whole. The overall narrative should validate the score chosen by the reviewer by stating the overall strengths and weaknesses that support the score. Contact your MRO with any other questions about scoring and comments.
Are reviewers required to identify three strengths and three weaknesses for each criterion?
No. There is no required number of strengths and weaknesses for written critiques. The number of strengths and weaknesses for each criterion should correlate with the criterion score. For example, a score of 1 would correlate with an exceptionally strong application with essentially no weaknesses.
Do patient and other stakeholder reviewers need to review the “Protection of Human Subjects” section?
No. Only scientific reviewers are required to evaluate the Protection of Human Subjects section.
What is the difference between patient engagement and patient centeredness?
Patient-centered research seeks to answer questions and measure outcomes that matter to patients and/or their caregivers. Patient and stakeholder engagement, on the other hand, refers to the integration of patients and other stakeholders as partners in the development of the research plan and in key elements of the proposed project.
How do I review a resubmission?
An applicant may resubmit an application that was not funded. An application is considered a resubmission if it has previously completed PCORI’s merit review process, including receipt of the summary statement.
When resubmitting an application, applicants include a resubmission letter with their revised application.
The resubmission letter is an opportunity for applicants to provide an overview of how the application has been strengthened in its scientific merit and responsiveness to the current PFA. Simply responding to previous reviewers’ concerns is not sufficient; the application must be programmatically responsive and demonstrate methodological rigor and patient-centeredness. When evaluating a resubmission, reviewers should determine how well the resubmitted application and resubmission letter meet PFA requirements and address Merit Review criteria.
Online Merit Review
Are the applications vetted before being assigned to reviewers?
PCORI staff screen all applications for programmatic responsiveness to PFAs and administrative compliance. If a reviewer has a concern with a particular application, they are encouraged to reach out to their MRO.
When will I be able to access my assigned applications?
Based on availability, PCORI will invite reviewers to self-rate their expertise (using the application abstracts) and indicate any COI using information about key personnel. PCORI MROs will assign reviewers based on an individual’s experience and corresponding fit with the applications in the panel. Approximately one week after reviewers identify COI and expertise, applications will be assigned in PCORI Online and released to reviewers.
What if I have a conflict of interest for an application that is assigned to me?
Please indicate your COI in PCORI Online and notify your MRO. Any applications you have a COI with will be assigned to a different reviewer.
I accidentally marked an application as having a conflict. What should I do?
Notify your MRO as soon as possible via e-mail and at pfa@pcori.org.
If I am in the process of reviewing an application and identify a potential issue regarding nonresponsiveness, whom should I notify?
Contact your MRO immediately.
Do I need to submit all critiques at once in PCORI Online?
No. However, we do encourage reviewers to submit their critiques early and as they are finished. This allows the MROs to review and ensure any questions or necessary edits are addressed before you complete all your reviews, and before the critique deadline.
Will I see my peers’ critiques of the same application?
Yes. Reviewer critiques will be available prior to the virtual panel discussion so that all reviewers in the panel without a COI can be familiar with the application and critiques.
Merit Review Panel Discussions
One of my assigned applications was selected for discussion at the Merit Review Panel Discussion. How do I know what the critique presentation order will be?
At the virtual meeting, reviewers are asked to present their online critiques for all assigned applications scheduled for discussion. The presentation order generally is as follows: scientific reviewer, patient reviewer, scientific reviewer, stakeholder reviewer and scientific reviewer. However, this order may vary based on program funding announcement. Prior to the Merit Review Panel Discussion, scientific reviewers will be notified by their MRO of which applications they will be the first versus last presenter.
After the Merit Review Panel Discussion, will I be able to revise my online critique comments/scores?
No. Once critiques have been submitted as final in preparation for the Merit Review Panel Discussion, no other revisions can be made. Note that there is another opportunity to score and provide comments for applications discussed at the virtual meeting. Once the overall application scores are submitted at the virtual meeting, they cannot be changed.
What happens once the Merit Review Panel Discussion is completed?
Applications discussed at the Merit Review Panel Discussion are reviewed by PCORI staff to determine which applications should be recommended for funding to the Selection Committee based on the results of Merit Review, programmatic balance and PCORI’s strategic priorities.
What do applicants receive after funding decisions have been announced?
After funding decisions are publicly announced, a summary statement for each application submitted to that cycle will become available to applicants in PCORI Online. For applications that are discussed at the Merit Review Panel Discussion, the summary statement includes a final overall average application score, a summary of the application discussion and preliminary online reviewer critiques. For applications that are not discussed at the Merit Review Panel Discussion, the summary statement includes only the preliminary online reviewer critiques.
How does PCORI assess its Merit Review process and learn about opportunities for improvement?
After the first review cycle of the fiscal year, reviewers are invited to complete a post-review survey. As a learning organization, PCORI continuously evaluates and revises processes, including application review protocols. Please send comments on the Merit Review process to pfa@pcori.org.
Attendance
I already registered to be a reviewer. Do I still need to register to attend the Merit Review Panel Discussion?
Yes. All confirmed reviewers will be sent information on how to register to virtually attend the Merit Review Panel Discussion. All reviewers should register via Zoom once they receive the link for the event.
Do I need to attend the entirety of the Merit Review Panel Discussion?
Yes. PCORI requires reviewers to attend the entire Merit Review meeting to ensure fair and consistent scoring for all applications, and asks that reviewers refrain from making any arrangements that will require them to leave early.
I have a condition that requires special accommodation. How may I request this?
During the process of registering for the Merit Review Panel Discussion, PCORI will ask if you request special accommodations.
What if I am no longer able to attend the Merit Review Panel Discussion?
If, due to an emergency, you need to cancel your attendance at the virtual meeting, we ask that you alert your MRO as soon as possible.
Compensation
How will I be compensated for serving as a PCORI merit reviewer?
All PCORI merit reviewers for all PFAs will receive $100 for each application reviewed, as well as a $225 stipend for each day of the Merit Review Panel Discussion.
What is the compensation process for Merit Review Panel Discussions ?
Stipends for reviewing online applications and attending the virtual meeting are transferred to your account via Bill.com approximately three weeks after the conclusion of the Merit Review Panel Discussion.
Are PCORI stipends taxable?
Yes. All PCORI stipends are taxable, no matter the amount received. Any reviewers, chairs or mentors who receive stipends totaling $600 or more during the calendar year will receive a 1099-MISC in accordance with IRS requirements.
If I am a federal employee, will PCORI pay my stipend?
Reviewers are responsible for using the guidelines for their federal agency/organization as the deciding factor to determine their stipend eligibility. PCORI will handle stipend and reimbursement requests based on information provided by the reviewer.
Last reviewed: Oct. 5, 2026