- The PCORI Strategic Plan
- Clinical Effectiveness and Decision Science
- Dissemination and Implementation
- Evaluation and Analysis
- Healthcare Delivery and Disparities Research
- Research Infrastructure
- Our Vision & Mission
- Financial Statements and Reports
- The PCORI Strategic Plan
- Board of Governors
- Methodology Committee
- Authorizing Law
- Evaluating Our Work
- PCORI's Advisory Panels
- Procurement Opportunities
- Stakeholder Views on Components of 'Patient-Centered Value' in Health and Health Care: A Request for Input
Past Opportunities to Provide Input
- PCORI's Proposed Research Agenda (2021-2022)
- Proposed National Priorities for Health (2021)
- Proposed Principles for the Consideration of the Full Range of Outcomes Data in PCORI-Funded Research (2020)
- Proposed New PCORI Methodology Standards (2018)
- Data Access and Data Sharing Policy: Public Comment (2017)
- Proposed New PCORI Methodology Standards (2017)
Comment on the Proposed New and Revised PCORI Methodology Standards (2016)
- 1. Standards for Formulating Research Questions
- 10: Standards for Studies of Diagnostic Tests
- 12. Standards on Research Designs Using Clusters
- 13: General Comments on the Proposed Revisions to the PCORI Methodology Standards
- 2: Standards Associated with Patient-Centeredness
- 3: Standards for Data Integrity and Rigorous Analysis
- 4: Standards for Preventing and Handling Missing Data
- 5: Standards for Heterogeneity of Treatment Effects
- 6: Standards for Data Registries
- 7: Standards for Data Networks as Research-Facilitating Structures
- 8. Standards for Causal Inference Methods
- 9. Standards for Adaptive Trial Designs
- Peer-Review Process Comments (2014)
- Draft Methodology Report Public Comment Period (2012)
- Executive Team
- Office of the Executive Director
- Program Support and Information Management
- Staff Conflict of Interest Disclosures
Not all patients will react to a medical treatment in the same way. A treatment that works well for some patients may be ineffective, or even harmful, for others. And that often makes it difficult for patients and clinicians to make informed health and healthcare decisions.
One reason for this is that medical research often provides information only about the average effect of a particular treatment approach, not how an individual patient with a specific set of characteristics will react. But patients want to know, “What is likely to happen to someone like me?”
Answering that question is at the heart of PCORI’s work. In fact, our authorizing legislation requires us to study the effects of health interventions for different patient subpopulations. This is known as research on the heterogeneity of treatment effects (HTE), and we consider it an essential component of the patient-centered comparative clinical effectiveness research (CER) we support.
The results of HTE analyses can be used to develop care programs designed to provide the treatment most likely to be effective for a particular patient—a step toward personalized medicine.
Seeking Better Methods for Analyzing Complex Data
At PCORI, we often say that in research, methods matter. That’s certainly true when it comes to the quality of the evidence produced by HTE analyses—and used by clinicians and patients. Traditional approaches, such as estimating treatment effects for subgroups of patients based on single risk factors, can lead researchers to detect HTE where it doesn’t exist and fail to detect true HTE where it does.
We’re addressing this issue in a variety of ways. For example, PCORI’s Methodology Standards include guidance on conducting appropriate HTE analyses to identify the risks and benefits of an intervention for particular subgroups of patients. Several of the research projects we fund focus on HTE as well.
One study, the subject of a recent paper in a major scientific journal, clearly illustrates how HTE analysis can help patients and doctors make better-informed decisions. This work was funded in part by PCORI to explore variation in treatment effects in randomized controlled trials. Re-examining data from a previous trial of a diabetes prevention program, the researchers used 17 factors to assign patients to diabetes-risk groups. In the study, some patients took metformin, a drug that helps to control blood sugar levels and is recommended to prevent diabetes. The research team found that among patients in the highest-risk group (the top quartile), those who took metformin were less likely to develop diabetes during the next three years, but the rest of the study population showed little benefit. In fact, those at lowest risk for diabetes (in the bottom quartile) showed no benefit at all from the medication.
This HTE analysis suggests a major, positive health impact from prescribing metformin to people at high risk for diabetes—but no benefit for patients at lower risk. However, all patients may experience any of a long list of negative side effects, as well as higher out-of-pocket expenses. In this example, methods research led to findings that can help patients and clinicians make better-informed choices about care.
Taking a Wide Variety of Approaches
- A team at the Johns Hopkins University is developing recommendations and software to help researchers employ HTE analysis in patient-centered outcomes research. The team is using Bayesian statistical methods, which build on information about how treatment effects vary across populations.
- A study at the University of South Carolina is investigating statistical methods for examining large sets of observational data, collected as a treatment has been used in practice. Such observational studies can be more practical than randomized clinical trials in cases where an intervention not only affects individual patients differently but also can have multiple effects within a single patient (for example, a medicine might lower blood pressure, prevent kidney problems, and cause headache and upset stomach).
- Researchers at the University of Miami School of Medicine are developing an improvement on a machine learning technique to identify subgroups with different treatment responses.
- A project at Brigham and Women's Hospital aims to develop and test a tool for predicting whether a patient will take a medication as prescribed. Many patients do not take their prescribed medications, which leads to extra hospitalizations and costs; it also makes medical studies difficult to interpret.
- To improve the value of CER based on observational data, a study at the University of North Carolina at Chapel Hill is assessing specific methods, including HTE analysis, in a comparison of treatments administered to older adults after heart attacks.
Research on methods for HTE analyses can improve the evidence available for clinicians, patients, and other stakeholders to use in determining—on an individual level—whether a treatment is likely to be effective. We welcome your thoughts, questions, and suggestions on our work to apply HTE analyses to improve health outcomes.
April 29, 2015, 5:53 PM
Comment by Katherine McQueston,
Thanks for your comment, Harry. Ensuring that patients and clinicians can accurately and effectively communicate will be key to ensuring that HTE results are best utilized.
April 28, 2015, 3:37 PM
Comment by Harry Ball,
Communication with patients is a key component to health care. I think we forget that the ultimate judge as to whether this job is done well is the understanding of the patient. How well we monitor this is essential.
I am reminded of this every time I call the doctor's office. In the recording we are told, "if this is a life-threatening emergency, call 911." But can the average patient identify a "life threatening emergency"? Can the average patient tell the difference between over-exertion, heartburn, or a pulmonary embolism? Probably not, unless they have personal experience with those events in the past.
We need to evaluate the patients level of understanding, when evaluating communicating skills,
March 13, 2015, 12:13 AM
Comment by Camille Ngoc Do,
"Not all patients will react to a medical treatment in the same way. A treatment that works well for some patients may be ineffective, or even harmful, for others. And that often makes it difficult for patients and clinicians to make informed health and healthcare decisions."
Add new Comment
What's Happening at PCORI?
The Patient-Centered Outcomes Research Institute sends weekly emails about opportunities to apply for funding, newly funded research studies and engagement projects, results of our funded research, webinars, and other new information posted on our site.