Results Summary
What was the research about?
Clinical practice guidelines are recommendations for doctors about when and how to treat health problems. Guidelines are often based on research that compares the benefits and harms of different tests or treatments for one health problem. But this research doesn’t always consider that people may have other health problems or different preferences. Guideline developers need to know what is important to patients.
In this study, the research team developed a process to inform development of clinical guidelines. The team wanted to learn how the balance of benefits and harms of treatment options changes when it includes patient preferences. In this new process, the team
- Defined questions comparing treatment options based on input from patients with three or more long-term health problems
- Used data from prior research studies to answer these questions and assess the balance of benefits and harms of treatment options
- Used results from a patient survey, looking to see if the balance of benefits and harms could change when patients have different preferences.
What were the results?
Using their process, the research team identified two research questions that looked at
- Comparing different blood pressure goals for patients with high blood pressure
- Comparing two medicines to treat diabetes if the most common medicine, metformin, is not enough
The research team found that the balance of benefits and harms for treatment options changed when looking at how much patients worried about different outcomes. For example, the balance of benefits and harms was about the same for the two medicines to treat diabetes. But this balance changed when taking into account that some people want to avoid shots.
What did the research team do?
To identify research questions, the research team had group discussions with 27 patients and their caregivers who had three or more long-term health problems. Next, the team reviewed data from prior studies related to these research questions and looked at the harms and benefits of treatment options. The team also received survey data from 434 patients with two or more long-term health problems. The surveys asked patients about their preferences, with questions about the importance of benefits and harms relative to one another.
The research team looked at whether the balance of benefits and harms is different for some groups of people, and whether preferences matter.
A total of four patients with long-term health problems and caregivers of people with long-term health problems, or both, were part of the research team. They helped plan and conduct the study. Researchers who create guidelines gave feedback on the usefulness of the study results.
What were the limits of the study?
Studies don’t exist for some treatment harms that were important to patients. The balance of benefits and harms may differ when this information becomes available.
Future research could study treatment harms that are important to patients with more than one long-term health problem.
How can people use the results?
Organizations that create guidelines can consider using the new process to include patient preferences when making guidelines.
Professional Abstract
Objective
To develop methods that incorporate patient preferences in assessing the benefit-harm balance of treatment options to inform care of people with multiple chronic conditions (MCC).
Study Design
Design Element | Description |
---|---|
Design | Empirical analysis |
Data Sources and Data Sets | Patient and caregiver focus groups, patient preference surveys, results from published intervention studies found through systematic review |
Analytic Approach | Benefit-harm analyses using the Gail index approach incorporating patient weighting for outcomes |
| Patient-identified research questions, change in benefit-harm balance for treatment interventions based on patient preferences |
Clinical practice guidelines make recommendations for treatments based on whether the benefits of a treatment outweigh the harms. However, guidelines often do not incorporate patient preferences in this benefit-harm balance.
In this study, researchers adapted a five-step process to understand how the benefit-harm balance for treatment options for patients with MCC can change when incorporating patient preferences for treatment outcomes. Throughout this process, a group of four patient and caregiver investigators provided input to the research team. The steps included
- Defining research questions. Researchers conducted focus groups and a prioritization process with 27 patients or caregivers of patients with MCC, to identify comparative effectiveness research questions that were important to patients.
- Data gathering. Based on systematic reviews, researchers selected the most valid and applicable data sources to answer the questions identified in the focus groups. They also reviewed survey data from 434 patients with MCC to understand which potential harms from treatment patients worry most about.
- Determining the benefit-harm balance of treatment options across patient subgroups. With data from the systematic reviews, researchers used the Gail Index, a measure that uses the expected number of events for different benefits (e.g., avoiding death) and harms (e.g., increased risk of stroke) to estimate the benefit-harm balance of interventions for each research question for different patient subgroups, defined based on demographics, condition, or other characteristics.
- Assessing how patient preferences and changes in assumptions change benefit-harm balances. Researchers used survey responses to explore whether the benefit-harm balance depends on individual preferences.
- Dissemination. Researchers presented the results to guideline developers and other medical professionals to see what additional information would be needed to implement the results in guideline development.
Results
From the focus groups, researchers identified two research questions, which included assessing the balance of harms and benefits of
- Different blood pressure targets to treat hypertension in different subgroups of patients
- Treating type 2 diabetes with basal insulin versus sulfonylurea, in addition to metformin, in different subgroups of patients
For the hypertension question, lower blood pressure targets in individuals without a history of prior stroke had a better benefit-harm balance for many patient subgroups, particularly for patients aged 75–84. For almost all patient subgroups, the benefit-harm balance depended on the individual’s preferences, such as worries about kidney injury versus heart attack.
For the diabetes question, the research team found that sulfonylurea and basal insulin had a similar benefit-harm balance among patient subgroups. However, evidence was lacking for many of the outcomes. After accounting for patient preferences, sulfonylurea was better for most patients except for those who do not mind insulin injections.
Limitations
Published literature on some harms that were important to patients was not available. The benefit-harm balance may differ if researchers had this information.
Conclusions and Relevance
The five-step process detected how preference-sensitive benefit-harm balances are and how much they vary across subgroups of patients. Organizations may consider using the process developed in this study when developing clinical practice guidelines.
Future Research Needs
Future research could fill information gaps on outcomes that are important to patients and on approaches to bring estimates of benefit-harm balance to clinical decision making.
Final Research Report
View this project's final research report.
Journal Citations
Results of This Project
Related Journal Citations
Peer-Review Summary
Peer review of PCORI-funded research helps make sure the report presents complete, balanced, and useful information about the research. It also assesses how the project addressed PCORI’s Methodology Standards. During peer review, experts read a draft report of the research and provide comments about the report. These experts may include a scientist focused on the research topic, a specialist in research methods, a patient or caregiver, and a healthcare professional. These reviewers cannot have conflicts of interest with the study.
The peer reviewers point out where the draft report may need revision. For example, they may suggest ways to improve descriptions of the conduct of the study or to clarify the connection between results and conclusions. Sometimes, awardees revise their draft reports twice or more to address all of the reviewers’ comments.
Peer reviewers commented, and the researchers made changes or provided responses. The comments and responses included the following:
- Reviewers commended the sophisticated analytic strategies and novel approaches used in this study. Also, they commented that the study’s main limitations included factors beyond the investigators’ control, such as the complexity of the topic and gaps in the literature.
- Reviewers noted that using the number of chronic conditions was not an adequate way to identify the most complex subjects among the elderly without also considering frailty and disability. The researchers agreed that frailty and disability are important factors that affect decision making and added a comment to this effect. However, the focus of the study was on multiple chronic conditions.
- Reviewers noted that the type of work described in this study is time-intensive and asked for a more nuanced discussion of how insights from this study could be scaled up and applied more broadly. The researchers acknowledged in the discussion that these methods for benefit-harm analysis were time- and resource-intensive, so priorities would need to be set about when to use these methods based on the potential for a benefit-harm analysis to change clinical practice guidelines.