Results Summary

What was the research about?

In mental health care, doctors often make the decisions about treatment. To make care more focused on people’s needs, people with a mental illness and their doctors can make decisions together. This process is called shared decision making.

In this study, the research team compared two programs to help people with mental illness make decisions about treatment:

  • Measurement-Based Care, or MBC, used a web-based portal to ask people about their health, like their symptoms and medicines. These answers helped doctors work with patients to choose medicines and treatment that would work best for each person.
  • Person-Centered Care, or PCC, used peer support staff to help people fill out an online survey. Peer support staff are people recovering from mental illness trained to give peer support. The survey asked questions about people’s health, like how they are feeling, what they do to feel better, and what concerns they have about their medicine. The peer support staff also helped people figure out their treatment goals and prepare to talk with their doctors. Doctors got the patients’ answers before the visit and talked with them about what treatment would work best.

The team looked at whether people with mental illness felt involved in their care and medicine choices.

What were the results?

At the end of the study, people in the two programs didn’t differ in their

  • Experience managing their medicines
  • Shared decision making with their doctors
  • Involvement in their health and mental health care
  • Management of their medicines’ side effects
  • Quality of life
  • Seriousness of their mental health symptoms
  • Ability to do daily activities

Who was in the study?

The study included 2,363 adults who had Medicaid health insurance and received mental health care at one of 14 community mental health centers in Pennsylvania. Of these adults, 86 percent were white, 9 percent were black, and 5 percent were another race; 2 percent were Hispanic. The average age was 42, and 63 percent were women. In the study

  • 24 percent of people had bipolar disorder
  • 23 percent had major depression
  • 20 percent had a substance use problem
  • 17 percent had another type of depression
  • 16 percent had schizophrenia or schizoaffective disorder
  • 10 percent had anxiety or posttraumatic stress disorder
  • 10 percent had another diagnosis

What did the research team do?

The research team assigned 14 community mental health centers by chance to either MBC or PCC programs. People took part in the programs at the centers where they received mental health care. They filled out four surveys between the start of the program and two years later. The team looked at the surveys and at data from Medicaid insurance claims.

People with mental illness, mental health organizations, peer support staff, policy makers, mental health providers, and researchers gave input on the study.

What were the limits of the study?

Four centers didn’t stay in the study. The centers that replaced them may have differed in ways that changed the results. The questions the research team used to look at people’s experiences with managing their medicine had not been used before and may not have captured patients’ experiences fully. Not as many people filled out surveys as expected at the start of the study. Having information from more people might have led to different results.

Future research could develop ways to make the programs easier for clinic staff and doctors to use.

How can people use the results?

Clinics can use the results when considering ways to improve mental health care.

Final Research Report

View this project's final research report.

Peer-Review Summary

Peer review of PCORI-funded research helps make sure the report presents complete, balanced, and useful information about the research. It also assesses how the project addressed PCORI’s Methodology Standards. During peer review, experts read a draft report of the research and provide comments about the report. These experts may include a scientist focused on the research topic, a specialist in research methods, a patient or caregiver, and a healthcare professional. These reviewers cannot have conflicts of interest with the study.

The peer reviewers point out where the draft report may need revision. For example, they may suggest ways to improve descriptions of the conduct of the study or to clarify the connection between results and conclusions. Sometimes, awardees revise their draft reports twice or more to address all of the reviewers’ comments.

Peer reviewers commented, and the researchers made changes or provided responses. The comments and responses included the following:

  • Reviewers did not find the comparison of person-centered care (PCC) versus management-based care (MBC) compelling. They asked for more justification for this comparison based on theoretical and empirical evidence. The researchers expanded their description of the two interventions and added a conceptual framework comparing PCC, MBC, and a typical visit.
  • Reviewers expressed concern about the problems in the study design created when several clinics dropped out postrandomization, and the researchers replaced the clinics without randomization. The researchers acknowledged these limitations, noting that this was a notable example of the problems in conducting research in the real world. They also added information about why clinic sites dropped out of the study and included analyses demonstrating that the new sites did not differ significantly from the dropped-out sites.
  • Reviewers further questioned why the researchers did not use propensity score weighting or similar measures to account for the lack of randomization when completing their outcome analyses. The researchers noted that given their large number of participants and few significant baseline differences between the sites in the two intervention groups, they felt there was no need to seek additional precision through propensity scoring. The researchers went on to say that the small magnitude of the significant differences between PCC and MBC groups, and the results from sensitivity analyses looking at the effects of non-random site assignment both supported this decision.
  • Reviewers asked why the researchers had completed subgroup analyses for Aim 3 given the problems with site randomization, substantial missing data, and the lack of differences between intervention groups. The researchers explained that along with these analyses being a part of their contracted work, they conducted the analyses with the assumption that the results would be exploratory or hypothesis generating rather than confirmatory or hypothesis testing. The researchers stated that they were cautious in their interpretation of the results.
  • Reviewers commented that the assessment of side effects was simplistic and that unmeasured differences might appear and be the result of selection bias given the lack of true randomization. The researchers agreed that collecting more-detailed information about side effects would have been helpful, but said they wanted to minimize the number of survey questions so as to limit the burden on participants. The researchers felt that a single question on side effects would provide adequate information and prompt discussion between prescribers and patients. They went on to say that the single item provided the information that patient stakeholders identified as most important to them.

Conflict of Interest Disclosures

Project Information

Kim MacDonald-Wilson, ScD
UPMC Center for High-Value Health Care
$1,976,939
10.25302/07.2020.CDR.130602474
Amplifying the Patient's Voice: Person-Centered Versus Measurement-Based Approaches in Mental Health

Key Dates

December 2013
March 2019
2013
2018

Study Registration Information

Tags

Has Results
Award Type
Health Conditions Health Conditions These are the broad terms we use to categorize our funded research studies; specific diseases or conditions are included within the appropriate larger category. Note: not all of our funded projects focus on a single disease or condition; some touch on multiple diseases or conditions, research methods, or broader health system interventions. Such projects won’t be listed by a primary disease/condition and so won’t appear if you use this filter tool to find them. View Glossary
Populations Populations PCORI is interested in research that seeks to better understand how different clinical and health system options work for different people. These populations are frequently studied in our portfolio or identified as being of interest by our stakeholders. View Glossary
Intervention Strategy Intervention Strategies PCORI funds comparative clinical effectiveness research (CER) studies that compare two or more options or approaches to health care, or that compare different ways of delivering or receiving care. View Glossary
State State The state where the project originates, or where the primary institution or organization is located. View Glossary
Last updated: January 20, 2023