Skip to main content
Patient-Centered Outcomes Research Institute
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Find It Fast
  • Help Center
  • Subscribe
  • Careers
  • Contact Us

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • About Us
    Close mega-menu

    About Us

    • Our Programs
    • Governance
    • Financials and Reports
    • Procurement Opportunities
    • Our Staff
    • Our Vision & Mission
    • Contact Us

    Fact Sheets: Learn More About PCORI

    Download fact sheets about out work, the research we fund, and our programs and initiatives.

    Find It Fast

    Browse through an alphabetical list of frequently accessed and searched terms for information and resources.

    Subscribe to PCORI Email Alerts

    Sign up for weekly emails to stay current on the latest results of our funded projects, and more.

  • Research & Results
    Close mega-menu

    Research & Results

    • Explore Our Portfolio
    • Research Fundamentals
    • Research Results Highlights
    • Putting Evidence to Work
    • Peer Review
    • Evidence Synthesis
    • About Our Research

    Evidence Updates from PCORI-Funded Studies

    These updates capture highlights of findings from systematic reviews and our funded research studies.

    Journal Articles About Our Funded Research

    Browse through a collection of journal publications that provides insights into PCORI-funded work.

    Explore Our Portfolio of Funded Projects

    Find out about projects based on the health conditions they focus on, the state they are in, and if they have results.

  • Topics
    Close mega-menu

    Topics

    • Addressing Disparities
    • Arthritis
    • Asthma
    • Cancer
    • Cardiovascular Disease
    • Children's Health
    • Community Health Workers
    • COVID-19
    • Dementia and Cognitive Impairment
    • Diabetes
    • Kidney Disease
    • Medicaid
    • Men's Health
    • Mental and Behavioral Health
    • Minority Mental Health
    • Multiple Chronic Conditions
    • Multiple Sclerosis
    • Obesity
    • Older Adults' Health
    • Pain Care and Opioids
    • Rare Diseases
    • Rural Health
    • Shared Decision Making
    • Telehealth
    • Transitional Care
    • Veterans Health
    • Women's Health

    Featured Topic: Women's Health

    Learn more about the projects we support on conditions that specifically or more often affect women.

  • Engagement
    Close mega-menu

    Engagement

    • The Value of Engagement
    • Engagement in Health Research Literature Explorer
    • Influencing the Culture of Research
    • Engagement Awards
    • Engagement Resources
    • Engage with Us

    Engagement Tools and Resources for Research

    This searchable peer-to-peer repository includes resources that can inform future work in patient-centered outcomes research.

    Explore Engagement in Health Literature

    This tool enables searching for published articles about engagement in health research.

    Research Fundamentals: A New On-Demand Training

    It enables those new to health research or patient-centered research to learn more about the research process.

  • Funding Opportunities
    Close mega-menu

    Funding Opportunities

    • What & Who We Fund
    • What You Need to Know to Apply
    • Applicant Training
    • Merit Review
    • Awardee Resources
    • Help Center

    PCORI Funding Opportunities

    View and learn about the newly opened funding announcements and the upcoming PFAs in 2021.

    Tips for Submitting a Responsive LOI

    Find out what PCORI looks for in a letter of intent (LOI) along with other helpful tips.

    PCORI Awardee Resources

    These resources can help awardees in complying with the terms and conditions of their contract.

  • Meetings & Events
    Close mega-menu

    Meetings & Events

    • Upcoming
    • Past Events

    January 2021 Board of Governors Meeting

    The Board approved funding for a new research study relating to kidney health and a new funding allocation for PCORnet. Learn more

    Confronting COVID-19: A Webinar Series

    Learn more about the series and access recordings and summary reports of all six sessions.

    2020 PCORI Annual Meeting

    Watch recordings of all sessions, and view titles and descriptions of the posters presented at the virtual meeting.

You are here

  • Research & Results
  • About Our Research
  • Guidance on the Design and Conduct of...

Guidance on the Design and Conduct of Trials in Real-World Settings: Factors to Consider in Pragmatic Patient Centered Outcomes Research

Comparative clinical effectiveness research is commonly performed in real-world settings that require thoughtful planning to balance the extent of experimental control with more naturalistic (or "pragmatic") study conduct.

Applicants for PCORI funding and PCORI awardees should refer to this guidance, below, for important factors in weighing whether and how pragmatic research features best serve the study question and purpose.


Download this Guidance

PCORI expects all of its funded patient-centered comparative clinical effectiveness research (CER) projects to produce new evidence that fills evidence gaps related to real-world healthcare choices or questions from patients, caregivers, and other stakeholders. This focus on real-world, stakeholder-driven questions necessitates that PCORI-funded researchers consider how the research can be conducted in typical clinical care settings. This planning often entails the incorporation of pragmatic elements of clinical practice into the study design, regardless of whether the study involves a Broad, Targeted, or Pragmatic Clinical Studies PCORI Funding Announcement or award. The purpose of this guidance document is to advise current and prospective PCORI investigators and awardees on approaches for study design and operations while conducting research under real-world clinical care conditions, with the goal to produce high quality and representative study findings that can be readily applied to health care.

PCORI’s patient-centered outcomes research (PCOR) is stakeholder-driven comparative CER that compares two or more alternatives for specific clinical services, the organization of healthcare delivery systems, or communication about healthcare decisions. Pragmatic or real-world research designs are encouraged by PCORI to allow the findings to be generalized and readily adopted into the current clinical care landscape. Pragmatic trials stand in contrast to traditional explanatory clinical trials done in highly-selective patients and tightly- controlled research environments which often do not reflect the complexities of real world patient populations and clinical practices.

PCORI expects PCORI-funded clinical trials using pragmatic designs to adhere to the PCORI Methodology Standards, which lay out minimum requirements for patient-centered outcomes research. Many investigators also frequently refer to a series of publications about the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) in designing their studies [1, 2]. The PRECIS and PCORI approaches to pragmatic studies have much in common, including their encouragement of diverse populations, typical care settings, and minimally intrusive study conduct. Both recommend designing research studies to be fit for purpose in answering stakeholder questions, but they emphasize different comparisons and decisions which result in different recommendations for handling usual care comparators, fidelity of study interventions, and participant adherence.

To date, PRECIS and PRECIS-2 have been oriented primarily to stakeholder questions of whether to introduce or provide coverage of new, efficacious interventions within existing clinical practice(s) or usual care. The principal focus is upon a single intervention compared to a range of established interventions already in use or covered by policy or payment. PRECIS and PRECIS-2 refer to this range of interventions as usual care. The guidance in these documents gives limited attention to the direct comparison of two or more distinct interventions, which is the focus of PCOR. With PCOR, there are stringent considerations when employing “usual care” as a distinct comparator because usual care is often ill-defined, variable, and poorly quantified. These qualities adversely affect meaningful and robust comparisons. PCORI explicitly discourages usual care comparators in PCORI-funded research projects unless they are well justified, detailed, measurable, and serve as a coherent and distinct clinical alternative, such as care that is tightly aligned with clinical practice guidelines.

To allow distinction of small but meaningful differences between active interventions, PCORI recommends that treatment fidelity and participant adherence be monitored judiciously. Careful judgement is required because differential fidelity in conduct of the intervention by providers or adherence by patients may create or obscure outcome differences. Since the goal of CER is to improve the evidence base for guiding real world clinical practice, the approach to controlling or monitoring the intervention’s use by providers and patients should be as unobtrusive as possible and reflect the conditions of anticipated future use. The degree of monitoring will ideally match the conditions of where and how the research will ultimately be applied. While PCORI agrees with the intent of PRECIS and PRECIS-2 to minimize distortions of outcomes or interventions due to study processes themselves, the PCORI Methodology Standards specify a more definitive process for managing variability in the clinical interventions. To be replicated elsewhere, real-world research and its conduct must try to emulate real- life variability in intervention practices and behaviors in a scientifically rigorous way. PCORI’s Methodology Standards for Studies of Complex Interventions establish the necessary framework and approach to identify the core functions, forms, and causal pathways of interventions and comparators and specify how adaptations to their form will be allowed and recorded.

To achieve generalizable and externally valid findings, PCORI-funded clinical trials employing pragmatic design features should loosen the typical, tight study controls that have been used in past clinical research. To preserve internal validity in CER, the fidelity, adherence, and monitoring of the interventions being compared should be explicitly addressed and their allowed implementation, variation and adaptation defined. In contrast, fewer constraints may be needed in the study population, settings, and manner of data collection. By expanding eligibility criteria to encompass more diverse patients, carrying out the trial in non-research settings, and using routinely collected data to minimize study burdens on clinical care delivery, pragmatic approaches can increase generalizability, minimize participant burden, and improve study efficiency. However, pragmatic clinical trials in

PCOR should never be construed to be laissez-faire or anything goes. On the contrary: pragmatic trials are not simple or easy. They require extensive and purposeful planning to optimize internal and external validity.

Download this Guidance

References

  1. Loudon, K., S. Treweek, F. Sullivan, P. Donnan, K. E. Thorpe, and M. Zwarenstein. "The Precis-2 Tool: Designing Trials That Are Fit for Purpose." BMJ 350 (May 8 2015): h2147.
  2. Thorpe, K. E., M. Zwarenstein, A. D. Oxman, S. Treweek, C. D. Furberg, D. G. Altman, S. Tunis, et al. "A Pragmatic-Explanatory Continuum Indicator Summary (Precis): A Tool to Help Trial Designers." J Clin Epidemiol 62, no. 5 (May 2009): 464-75.

Posted: October 11, 2018

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff
  • Our Vision & Mission
  • Contact Us

Research & Results

  • Explore Our Portfolio
  • Research Fundamentals
  • Research Results Highlights
  • Putting Evidence to Work
  • Peer Review
  • Evidence Synthesis
  • About Our Research

Engagement

  • The Value of Engagement
  • Engagement in Health Research Literature Explorer
  • Influencing the Culture of Research
  • Engagement Awards
  • Engagement Resources
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review
  • Awardee Resources
  • Help Center

Meetings & Events

January 21
Cycle 1 2021 Broad PFA Applicant Town Hall
February 2
PCORI 2021 and Beyond: Opportunities for Funding and Involvement in Patient-Centered Research
February 9
Board of Governors Meeting: February 9, 2021

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
[email protected]

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2021 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Trademark Usage Guidelines | Credits | Help Center