Skip to main content
Patient-Centered Outcomes Research Institute
  • Blog
  • Newsroom
  • Glossary
  • Subscribe
  • Careers
  • Contact

PCORI

Patient-Centered Outcomes Research Institute

Search form

  • Home
  • About Us
    • Our Programs
      • Clinical Effectiveness and Decision Science
      • Healthcare Delivery and Disparities Research
      • Evaluation and Analysis
      • Engagement
      • Research Infrastructure
    • Governance
      • Board of Governors
      • Methodology Committee
      • Committees
        • Engagement, Dissemination, and Implementation Committee
        • Research Transformation Committee
        • Science Oversight Committee
        • Finance and Administration Committee
        • Executive Committee
        • Governance Committee
          • Executive Evaluation and Compensation Subcommittee
        • Scientific Publications Committee
        • Selection Committee
    • Financials and Reports
      • Our Funding
    • Procurement Opportunities
      • Operations Support Funding
      • Research Support Funding
      • Contracted Projects
    • Our Staff
      • Executive Team
      • Office of the Executive Director
        • Evaluation and Analysis
        • Research Infrastructure
      • Office of the General Counsel
      • Science
        • Office of the Chief Science Officer
        • Clinical Effectiveness and Decision Science
        • Healthcare Delivery and Disparities Research
        • Merit Review
        • Peer Review
        • Research Synthesis
      • Engagement
        • Communications
        • Dissemination and Implementation
        • Engagement Awards
        • Office of the Chief Engagement and Dissemination Officer
        • Public and Patient Engagement
        • Public Policy
        • Training
      • Operations
        • Office of the Chief Operations Officer
        • Administrative Services
        • Contracts Management and Administration
        • Finance
        • Human Resources
        • Information Technology
        • Procurement
  • Research & Results
    • Explore Our Portfolio
    • Dissemination and Implementation
      • CME/CE Activities
      • Dissemination and Implementation Framework and Toolkit
    • Peer Review
      • Step-by-Step Instructions for Awardees: Peer Review of Draft Final Research Report
      • Peer Review FAQ
    • Research Spotlights
    • About Our Research
      • How We Select Research Topics
        • Generation and Prioritization of Topics for Funding Announcements
        • Topics in the Prioritization Pathway
      • Research We Support
        • National Priorities and Research Agenda
          • How We Developed our National Priorities and Research Agenda
            • Public Comments for PCORI’s National Priorities and Research Agenda
      • Collaborating with Other Research Funders
      • Research Methodology
        • PCORI Methodology Standards
          • Suggest a Topic Area for New Methodology Standards
        • The PCORI Methodology Report
          • Draft Methodology Report Public Comment Period
        • PCORI Methodology Standards and Report FAQ
        • Methodology Standards Academic Curriculum
          • Category 1: Standards for Formulating Research Questions
          • Category 2: Standards Associated with Patient-Centeredness
          • Category 3: Standards for Data Integrity and Rigorous Analyses
          • Category 4: Standards for Preventing and Handling Missing Data
          • Category 5: Standards for Heterogeneity of Treatment Effects
          • Category 6: Standards for Data Registries
          • Category 7: Data Networks as Research-Facilitating Structures
          • Category 8: Standards for Causal Inference Methods
          • Category 9: Standards for Adaptive and Bayesian Trial Designs
          • Category 10: Standards for Studies of Diagnostic Tests
          • Category 11: Standards for Systematic Reviews
        • Methodology Committee - Background
        • Methodology Committee - Workshops and Events
      • Evaluating Our Work
        • Planning Our Evaluation, Reporting the Results
        • PCORI Evaluation Group (PEG)
        • How We Evaluate Key Aspects of Our Work
        • Related Blog Posts
  • Engagement
    • What We Mean by Engagement
      • PCORI’s Stakeholders
    • Engagement Awards
    • Engage with Us
      • Voices of Engagement
        • Regina Greer-Smith
        • Kimberly Jinnett
        • Elizabeth Cox
        • David White
        • Toya Burton
        • David Hahn
        • Rebekah Angove
        • Neely Williams
        • Peter W. Thomas
        • Megan O'Boyle
        • Stephanie Buxhoeveden
      • Become a Merit Reviewer
        • PCORI Stakeholder Reviewer Communities
        • Reviewer Qualifications
        • Reviewer Responsibilities
      • Become a Peer Reviewer
      • Join an Advisory Panel
        • Advisory Panel Openings
        • PCORI Advisory Panels FAQs
        • Advisory Panel on Addressing Disparities
          • Biographies - Advisory Panel on Addressing Disparities
        • Advisory Panel on Assessment of Prevention, Diagnosis, and Treatment Options
          • Biographies - Advisory Panel on Assessment of Prevention, Diagnosis, and Treatment Options
        • Advisory Panel on Clinical Trials
          • Biographies - Advisory Panel on Clinical Trials
          • Advisory Panel on Clinical Trials Subcommittee on Recruitment, Accrual, and Retention
          • Advisory Panel on Clinical Trials Subcommittee on the Standardization of Complex Concepts and their Terminology
        • Advisory Panel on Communication and Dissemination Research
          • Biographies - Advisory Panel on Communication and Dissemination Research
        • Advisory Panel on Improving Healthcare Systems
          • Biographies - Advisory Panel on Improving Healthcare Systems
        • Advisory Panel on Patient Engagement
          • Biographies - Advisory Panel on Patient Engagement
        • Advisory Panel on Rare Disease
          • Biographies - Advisory Panel on Rare Disease
      • Become a PCORI Ambassador
        • History of the Ambassador Program
        • About Ambassadors
        • Who are PCORI’s Ambassadors?
          • PCORI Individual Ambassadors
          • PCORI Organizational Ambassadors
          • PCORI Ambassadors: Northeast Region
          • PCORI Ambassadors: South Region
          • PCORI Ambassadors: Midwest Region
          • PCORI Ambassadors: Western Region
        • Ambassador Program Interest Form
      • Provide Input
        • Past Opportunities to Provide Input
          • Data Access and Data Sharing Policy: Public Comment
            • Data Access and Data Sharing Policy: Public Comment Submissions
          • Comment on the Proposed New and Revised Methodology Standards
          • Peer Review Process Comments
      • Suggest a Patient-Centered Research Question
        • How to Write a Research Question
      • Participate in PCORI Events
        • PCORI in Practice
  • Funding Opportunities
    • What & Who We Fund
    • What You Need to Know to Apply
      • FAQs for Applicants
      • Glossary
      • Have a Question?
    • Applicant Training
    • Merit Review Process
      • Merit Review Criteria
      • Merit Reviewer Resources
        • Merit Review Timeline
        • Reviewer Training
        • Meet Our Reviewers
        • Reviewer FAQs
    • Research Support Funding Opportunities
      • Eugene Washington PCORI Engagement Awards
        • Eugene Washington PCORI Engagement Awards: Review Process
        • Eugene Washington PCORI Engagement Awards FAQs
        • Eugene Washington PCORI Engagement Awards: Recently Funded Projects
      • Pipeline to Proposal Awards
        • Pipeline to Proposal Awards: Program Offices
        • Pipeline to Proposal Awards: Three-Tiered Program
      • PCORnet Infrastructure Awards
      • The PCORI Matchmaking App Challenge
        • 2014 PCORI Matchmaking App Challenge - Runners Up
          • Judges for PCORI 2014 Challenge
        • PCORI Challenge Initiative - 2013
          • Judges for PCORI 2013 Challenge
      • Research Support Funding
    • Awardee Resources
      • Closed PCORI Funding Announcements
      • Post-Award FAQs
  • Meetings & Events
    • Upcoming
    • Past Events

You are here

Public Comments - Methodology Standards

« Back to the list of all comments on the 2016 Methodology Standards

4: Standards for Preventing and Handling Missing Data

MD-2: Use valid statistical methods to deal with missing data that properly account for statistical uncertainty due to missingness

Valid statistical methods for handling missing data should be pre-specified in study protocols. The reasons for missing data should be considered in the analysis. A discussion of the potential ramifications of the statistical approach to missing data on the results should be provided. The plausibility of the assumptions associated with the approach should be assessed. Statistical inference of intervention effects or measures of association should account for statistical uncertainty attributable to missing data. This means that methods used for imputing missing data should produce valid confidence intervals and should permit unbiased inferences based on statistical hypothesis tests. Bayesian methods, multiple imputation, and various likelihood-based methods are valid statistical methods to deal with missing data. Single imputation methods like last observation carried forward, baseline observation carried forward, and mean value imputation are discouraged as the primary approach for handling missing data in the analysis. If investigators do use single-based imputation methods, they must provide a compelling scientific rationale as to why the method is appropriate. This standard applies to all study designs for any type of research question.

Public comments

Along with the addition of “mean value imputation” as one of the examples of handling missing data, AcademyHealth also recommends including ‘hot deck imputation,’ in which each missing value is replaced with an observed response from a “similar” unit. For additional clarification within this standard, PCORI should consider distinguishing between imputation of outcomes versus control variables. Finally, and more generally, we encourage PCORI to push the research community to understand and report the underlying processes of data generation. The application of missing data techniques draws from a solid understanding of these underlying processes, so that the methods employed align with the mechanisms by which the data are missing.
Lisa Simpson, AcademyHealth, Stakeholder - Other, 04/11/2016 - 4:36pm
Why the mention of "valid" confidence intervals? What would constitute an invalid CI? Also, should we be "discouraging" the use of single imputation methods as the primary approach to handling missing data? Sometimes such methods are indeed preferred. {EBort}
{EBort} Merck & Co Inc, Industry, 02/23/2016 - 2:35pm

Pages

  • First page
  • Previous page
  • …
  • Page 17
  • Page 18
  • Page 19
  • Page 20
  • Currently on page 21
  • Page 22
  • Page 23
  • Page 24
  • Page 25
  • …
  • Next page
  • Last page

About Us

  • Our Programs
  • Governance
  • Financials and Reports
  • Procurement Opportunities
  • Our Staff

Research & Results

  • Explore Our Portfolio
  • Dissemination and Implementation
  • Peer Review
  • Research Spotlights
  • About Our Research

Engagement

  • What We Mean by Engagement
  • Engagement Awards
  • Engage with Us

Funding Opportunities

  • What & Who We Fund
  • What You Need to Know to Apply
  • Applicant Training
  • Merit Review Process
  • Research Support Funding Opportunities
  • Awardee Resources

Meetings & Events

July 17
PCORI Online LOI Submission Webinar for Cycle 2 2017 Applicants
July 18
Board of Governors Meeting
July 19
Patient and Stakeholder Engagement in Research: Strategies for Initiating Research Partnerships

PCORI

Footer contact address

Patient-Centered Outcomes
Research Institute

1828 L Street, NW, Suite 900
Washington, DC 20036
Phone: (202) 827-7700 | Fax: (202) 355-9558
info@pcori.org

Subscribe to Newsletter

Twitter Facebook LinkedIn Vimeo

© 2011-2017 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Privacy Policy | Terms of Use | Credits | Help Center