Skip to main content
Patient-Centered Outcomes Research Institute
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Find It Fast
  • Help Center
  • Subscribe
  • Careers
  • Contact Us

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • About Us
    Close mega-menu

    About Us

    • Our Programs
    • Governance
    • Financials and Reports
    • Procurement Opportunities
    • Our Staff
    • Our Vision & Mission
    • Contact Us

    Fact Sheets: Learn More About PCORI

    Download fact sheets about out work, the research we fund, and our programs and initiatives.

    Find It Fast

    Browse through an alphabetical list of frequently accessed and searched terms for information and resources.

    Subscribe to PCORI Email Alerts

    Sign up for weekly emails to stay current on the latest results of our funded projects, and more.

  • Research & Results
    Close mega-menu

    Research & Results

    • Explore Our Portfolio
    • Evaluating Our Work
    • Research Results Highlights
    • Putting Evidence to Work
    • Peer Review
    • Evidence Synthesis
    • About Our Research

    Evidence Updates from PCORI-Funded Studies

    These updates capture highlights of findings from systematic reviews and our funded research studies.

    Journal Articles About Our Funded Research

    Browse through a collection of journal publications that provides insights into PCORI-funded work.

    Explore Our Portfolio of Funded Projects

    Find out about projects based on the health conditions they focus on, the state they are in, and if they have results.

  • Topics
    Close mega-menu

    Topics

    • Addressing Disparities
    • Arthritis
    • Asthma
    • Cancer
    • Cardiovascular Disease
    • Children's Health
    • Community Health Workers
    • COVID-19
    • Dementia and Cognitive Impairment
    • Diabetes
    • Intellectual and/or Developmental Disabilities
    • Kidney Disease
    • Maternal Morbidity and Mortality
    • Medicaid
    • Men's Health
    • Mental and Behavioral Health
    • Minority Mental Health
    • Multiple Chronic Conditions
    • Multiple Sclerosis
    • Obesity
    • Older Adults' Health
    • Pain Care and Opioids
    • Rare Diseases
    • Rural Health
    • Shared Decision Making
    • Telehealth
    • Transitional Care
    • Veterans Health
    • Women's Health

    Featured Topic: Women's Health

    Learn more about the projects we support on conditions that specifically or more often affect women.

  • Engagement
    Close mega-menu

    Engagement

    • The Value of Engagement
    • Engagement in Health Research Literature Explorer
    • Influencing the Culture of Research
    • Engagement Awards
    • Engagement Resources
    • Engage with Us

    Engagement Tools and Resources for Research

    This searchable peer-to-peer repository includes resources that can inform future work in patient-centered outcomes research.

    Engagement Awards

    Learn about our Engagement Awards program and view the announcements of all our open funding opportunities.

    Research Fundamentals: A New On-Demand Training

    It enables those new to health research or patient-centered research to learn more about the research process.

  • Funding Opportunities
    Close mega-menu

    Funding Opportunities

    • What & Who We Fund
    • What You Need to Know to Apply
    • Applicant Training
    • Merit Review
    • Awardee Resources
    • Help Center

    PCORI Funding Opportunities

    View and learn about the newly opened funding announcements and the upcoming PFAs in 2021.

    Tips for Submitting a Responsive LOI

    Find out what PCORI looks for in a letter of intent (LOI) along with other helpful tips.

    PCORI Awardee Resources

    These resources can help awardees in complying with the terms and conditions of their contract.

  • Meetings & Events
    Close mega-menu

    Meetings & Events

    • Upcoming
    • Past Events

    PCORI 2021 and Beyond

    During this webinar, PCORI leaders shared ways to get involved in PCOR, improvements to our funding opportunities, and more.

    2020 PCORI Annual Meeting

    Watch recordings of sessions and view titles and descriptions of posters presented at the virtual meeting.

    Board Approves Future PFA Topics at April Meeting

    The more than a dozen high-priority research topics will be considered for PCORI Funding Announcements (PFAs) that will be released this fall and in 2022.

You are here

  • Research & Results
  • Explore Our Portfolio
  • Testing a Clinic-Based Program to Red...

This project has results

Testing a Clinic-Based Program to Reduce Risky Behaviors among Teens

Sign Up for Updates to This Study  

Results Summary and Professional Abstract

Results Summary
Download Summary Español (pdf) Audio Recording (mp3)

Results Summary

What was the research about?

Risky behaviors, including eating poorly, not getting enough sleep or exercise, using drugs, and not wearing a helmet or seatbelt often emerge during the teen years. By talking with teens during clinic visits, doctors may help to reduce these behaviors.

In this study, the research team created a program about risky behaviors that had two parts:

  • Doctors took a training on talking with teens about risky behaviors.
  • Teens took an online survey that asked about risky behaviors. The survey gave them feedback to encourage healthy choices. It also gave doctors personalized recommendations for their patients.

The research team compared teens who were and weren’t in the program.

What were the results?

Teens who were and weren’t in the program didn’t differ in

  • How satisfied they were with their clinic visits
  • How satisfied their parents were with clinic visits
  • How empathetic they said their doctors were

After three months, compared with teens who weren’t in the program, teens who were in the program reported fewer risky behaviors. But after 6 and 12 months, the two groups no longer differed.

Compared with teens who weren’t in the program, teens in the program said they received counseling about risky behaviors more often during their initial clinic visits. The two groups didn’t differ in

  • How often they received follow-up care for risky behaviors
  • How ready they said they were to change their behavior

Who was in the study?

The study included 302 teens who received care at six clinics in Seattle and their parents. Of the teens, 70 percent were white, 9 percent were Asian, and 15 percent were other races; 6 percent were Hispanic. The average age was 15, and 52 percent were girls.

What did the research team do?

The research team assigned a program start date by chance to the six clinics. In the first 10 weeks of the study, doctors had clinic visits as they normally would. Teens filled out a survey about risky behaviors before their visit for data collection only. After 10 weeks, doctors completed training on talking about risky behaviors. In the next 10 weeks, clinics started giving teens the program’s online survey before clinic visits. Doctors received a summary of each teen’s risky behaviors and suggestions for next steps for their care before the visits.

One day after their clinic visits, teens and parents filled out a survey about the visit. Teens filled out follow-up surveys about their risky behaviors 3, 6, and 12 months later.

Teens, parents, and doctors gave input to the research team throughout the study.

What were the limits of the study?

The study took place in one city, and 70 percent of teens were ages 13–15. Result may differ in other settings or with older teens.

Future studies could test the program with older teens or add other programs to address specific risky behaviors.

How can people use the results?

Health clinics can use the results when considering ways to reduce risky behaviors among teens.

Professional Abstract

Professional Abstract

Objective

To compare the effectiveness of a program, consisting of an online interactive training for clinicians and an electronic screener for teens, with usual care in increasing teen engagement during clinic visits and reducing risky behaviors

Study Design

Design Elements Description
Design Randomized controlled trial
Population 302 teens receiving care within a practice-based research network and their caregivers
Interventions/
Comparators
  • Interactive online training for clinicians and electronic screener for teens for risky behaviors, including poor nutrition, low physical activity, inadequate sleep, unprotected sexual intercourse, unsafe driving, and substance use
  • Usual care
Outcomes

Primary: teen and caregiver satisfaction with clinic visit, teen perceptions of clinician patient-centeredness, teens’ risky behaviors

Secondary: risky behavior counseling rate, risky behavior follow-up care

Timeframe 1-year follow-up for primary outcomes

This stepped-wedge cluster randomized controlled trial assessed the effectiveness of a program to increase teen engagement during clinic visits and reduce risky behaviors. The program included interactive training for clinicians and an electronic screener for teens to identify poor nutrition, low physical activity, inadequate sleep, and other risky behaviors.

Researchers randomly assigned a study start date to six clinics within a practice-based research network. In the first 10 weeks of the study, clinicians conducted teen clinic visits as they normally would. Teens completed an assessment about risky behaviors prior to their visits. After the 10-week period, clinicians received online interactive training about motivational interviewing and engagement skills centered on reducing teens’ risky behaviors. In the 10 weeks after training, the clinics implemented an online electronic screener, which teens completed prior to their visits. The screener assessed teens’ risky behaviors and then provided personalized feedback to motivate them to reduce these behaviors and encouraged discussion with clinicians. Clinicians received a summary of screening results and recommendations for next steps.

The study included 302 teens from Seattle and their caregivers. Of the teens, 70% were white, 9% were Asian, and 15% were other races; 6% were Hispanic. The average age was 15, and 52% were female.

Teens and caregivers completed a survey about their clinic visits one day later. Teens completed surveys about their risky behaviors 3, 6, and 12 months later.

Teens, parents, and pediatricians provided input to the research team throughout the study.

Results

Teen and caregiver satisfaction with visits and teen ratings of clinician patient-centeredness did not differ significantly between teens in the program and those who received usual care.

After three months, compared with teens who received usual care, teens in the program had greater reductions in risky behavior scores (p<0.05). At 6- and 12-month follow-ups, risk behavior scores for the two groups no longer differed significantly.

Compared with teens who received usual care, teens in the program reported receiving risk behavior counseling more often during their initial visit (p<0.05). The two groups did not differ significantly in other secondary outcomes.

Limitations

The study took place in one city, and 70% of teens were ages 13–15. Results may differ in other locations or for older teens.

Conclusions and Relevance

The interactive training for clinicians and the electronic screener for teens increased health risk behavior counseling during initial clinic visits and produced a short-term reduction in risky behaviors among teens but did not result in long-term reductions in risky behaviors.

Future Research Needs

Future research could test the program with different teen populations or add interventions to address specific risky behaviors.

Final Research Report

View this project's final research report.

More on this Project  

Peer-Review Summary

Peer review of PCORI-funded research helps make sure the report presents complete, balanced, and useful information about the research. It also assesses how the project addressed PCORI’s Methodology Standards. During peer review, experts read a draft report of the research and provide comments about the report. These experts may include a scientist focused on the research topic, a specialist in research methods, a patient or caregiver, and a healthcare professional. These reviewers cannot have conflicts of interest with the study.

The peer reviewers point out where the draft report may need revision. For example, they may suggest ways to improve descriptions of the conduct of the study or to clarify the connection between results and conclusions. Sometimes, awardees revise their draft reports twice or more to address all of the reviewers’ comments. 

Peer reviewers commented and the researchers made changes or provided responses. Those comments and responses included the following:

  • The reviewers asked for more details on how patients influenced the study. The researchers explained that the patient advisory board did not influence the study design but offered other feedback and input over the course of the four -year project, for example in helping to develop the clinician training and in interpreting findings. The researchers also engaged the patient advisory board to help develop the project’s public-facing website and to help plan the social media strategy that will be used when the study’s results are published.
  • The reviewers said the quantitative study design was unclear and that the study may not have been a stepped-wedge design as described. The researchers added details about the study design to their report and asserted that the quantitative study was indeed a stepped-wedge cluster randomized trial (SW-CRT) because it fit three criteria: randomization at the level of clusters; all clusters transitioned from control phase to intervention phase; and the point of randomization was the order in which clinics transitioned to the intervention condition, rather than whether or not clinics received the intervention. The researchers noted that the open cohort design by which patients entered treatment in the clinics still fell under the SW-CRT model.
  • The reviewers questioned the value of the researchers’ use of a summary risk variable that grouped together different types of health behaviors for analysis. The researchers responded that most studies have examined highly limited outcomes, but primary care clinicians address a wide range of behaviors in a short amount of time. There has been no evidence if this kind of wide-ranging advice makes any difference in the health of youth. The researchers said that everyone involved in the study was very interested in understanding how to improve the value of primary care visits. They also noted that the first step in doing so is to measure the impact of screening and feedback in a structured way, which is what this study did.
  • The reviewers pointed out that with five clusters to compare and little room for improvement among the adolescent participants, the researchers should consider the study to not have met its objectives or at least state that there were no meaningful differences between intervention and comparison groups. The researchers disagreed, noting that although the number of significant outcomes was small, these outcomes were important clinically. The researchers did revise the report to acknowledge some of the limitations to the interpretation of results, including the larger number of outcomes that did not show significant differences, and the questionable validity for the summary health risk measure.

Conflict of Interest Disclosures

View the COI disclosure form.

Project Details

Principal Investigator
Carolyn McCarty, PhD
Project Status
Completed; PCORI Public and Professional Abstracts, and Final Research Report Posted
Project Title
Delivering Patient-Centered Adolescent Preventive Care with Training and Technology
Board Approval Date
September 2014
Project End Date
July 2020
Organization
Seattle Children's Hospital
Year Awarded
2014
State
Washington
Year Completed
2020
Project Type
Research Project
Health Conditions  
Infectious Diseases
HPV and other Sexually Transmitted Infections
Mental/Behavioral Health
Addiction/Substance Abuse
Depression
Tobacco Cessation
Reproductive and Perinatal Health
Pregnancy and Birth Outcomes
Trauma/Injuries
Intervention Strategies
Screening Interventions
Other Clinical Interventions
Other Health Services Interventions
Technology Interventions
Training and Education Interventions
Populations
Children -- 18 and under
Low Income
Racial/Ethnic Minorities
Rural
Urban
Funding Announcement
Improving Healthcare Systems
Project Budget
$1,915,148
DOI - Digital Object Identifier
10.25302/10.2020/IHS.140210592
Study Registration Information
HSRP20152242
NCT02764190
Page Last Updated: 
January 15, 2021

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff
  • Our Vision & Mission
  • Contact Us

Research & Results

  • Explore Our Portfolio
  • Evaluating Our Work
  • Research Results Highlights
  • Putting Evidence to Work
  • Peer Review
  • Evidence Synthesis
  • About Our Research

Engagement

  • The Value of Engagement
  • Engagement in Health Research Literature Explorer
  • Influencing the Culture of Research
  • Engagement Awards
  • Engagement Resources
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review
  • Awardee Resources
  • Help Center

Meetings & Events

April 27
Priorities on the Health Horizon: Informing PCORI's Strategic Plan (Webinar #2)
May 6
Advisory Panel on Healthcare Delivery and Disparities Research Spring 2021 Meeting
May 10
Cycle 2 2021 Nonsurgical Options for Women with Urinary Incontinence -- Applicant Town Hall

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
info@pcori.org

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2021 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Trademark Usage Guidelines | Credits | Help Center