Developing Measures of Pain Appraisal and Pain-Related Self-Efficacy for People Living with Chronic Pain

This project has results

Results Summary and Professional Abstract

Results Summary

Download this abstract: English (pdf)

What was the research about?

Chronic pain, which lasts for months or even years, can disturb people’s daily lives and their relationships with others. Doctors want to measure how chronic pain affects people’s lives so they can help their patients manage pain.

In this study, the research team wanted to measure two aspects of living with and managing chronic pain:

Pain appraisal describes how people think about their pain. It measures how much people worry about their pain and how well they cope with pain or distract themselves from thinking about it.
Pain-related self-efficacy describes how confident a person is that they can live well with pain.

The research team created two pools of questions, called item banks, to measure each of the two aspects of living with chronic pain. From these larger item banks, the team created and tested brief versions using two and six questions. These brief versions take people less time to finish than the full item banks.

What were the results?

The research team created a 24-question item bank for pain appraisal and a 29-question item bank for pain-related self-efficacy. Testing showed that people understood the questions well. The team also found that the questions accurately measured pain appraisal and pain-related self-efficacy. When patients completed the brief versions of the item banks, they provided information similar to that gathered by the full item banks.

Who was in the study?

The study included 795 people living with chronic pain across the United States. Of these people, 86 percent were white, 9 percent were African American, and 5 percent were other races. The average age was 55 and 64 percent were female. Patients had many different types of chronic pain, including low back pain or pain from multiple sclerosis.

What did the research team do?

To develop questions for the item banks, the research team worked with patient advisors and pain experts. Next, the team conducted focus groups and interviews with patients living with chronic pain. These patients gave feedback on whether the questions asked about important features of pain in ways that were easy to understand. Finally, the team tested the full item banks and the brief versions with a large group of people with chronic pain. These people answered the questions online or on paper.

What were the limits of the study?

The research team couldn’t include people with every type of chronic pain. For example, the study didn’t include people with carpal tunnel disease or cancer-related pain. People with types of chronic pain that weren’t in the study may have answered the questions differently.

Future research could study how people of different races or ages, or with other types of pain answer the questions. In addition, researchers could look into how to help doctors and patients use these item banks in health care.

How can people use the results?

Researchers could use the item banks in studies about treating and managing chronic pain. Doctors can use this research to help patients better manage pain.

Professional Abstract

Objective

To develop brief, flexible, and sound measures of pain catastrophizing and pain-related self-efficacy for people living with chronic pain

Study Design

Design Element	Description
Design	Item bank and short form development and testing
Data Sources and Data Sets	Item bank and short form development: patient advisors and expert panel; 19 focus group participants living with chronic pain; 22 cognitive-interview participants living with chronic pain Item scoring: 795 field test respondents living with chronic pain
Analytic Approach	PROMIS development methodology; full item bank to short form correlation; evaluation of validity and reliability
Outcomes	2 item banks for measuring pain catastrophizing and pain-related self-efficacy, and 2- and 6-question short forms to measure both concepts

An item bank is a set of items calibrated using Item Response Theory (IRT) that ask about a specific topic. Users can create custom short forms by picking sets of questions from an item bank or by using computerized adaptive testing. In this study, researchers developed separate item banks to measure pain catastrophizing and pain-related self-efficacy. Pain catastrophizing is a tendency to worry excessively about pain and to feel helpless about coping with it. Pain-related self-efficacy is the belief of people living with chronic pain that they can live well despite that pain. Existing measures of pain catastrophizing and pain-related self-efficacy were created using older methodology requiring all respondents to answer the same items. In this study, patient advisors, pain researchers, and clinicians guided item-bank development and provided feedback throughout the study.

The researchers developed the new item banks using qualitative and quantitative methodologies from the Patient-Reported Outcomes Measurement Information System (PROMIS®), including IRT, which result in flexible, brief, and clinically meaningful measures. To define the two aspects of living with chronic pain, the researchers worked with patient advisors, pain researchers, and clinicians. Then, focus group participants living with chronic pain provided feedback on the definitions and the items used to measure pain catastrophizing and pain-related self-efficacy. Using this feedback, the researchers developed items and tested them in interviews with people living with chronic pain.

Finally, the researchers conducted a field test of the item banks with 795 people living with chronic pain across the country. Of these people, 86% were white, 9% were African American, and 5% were other races. The average age was 55 and 64% were female. Respondents had a variety of chronic pain conditions such as low back pain and pain from multiple sclerosis.

To develop a scoring system and evaluate the reliability and validity of the scores, researchers conducted psychometric analyses. After finalizing the item banks, the team developed two- and six-question short forms for both pain catastrophizing and pain-related self-efficacy and calculated the correlations between the short forms and the full item banks. To evaluate test-retest reliability, the researchers examined the correlations between the scores of respondents who completed the measure a second time 40 to 80 hours later.

Results

Pain Appraisal Scale. The researchers renamed the pain-catastrophizing measure the Pain Appraisal Scale because focus group participants found the term stigmatizing. The final item bank included 24 questions. Scores from the 24-question item bank correlated highly with the two-question (r=0.71) and six-question (r=0.99) short forms. Test-retest reliability was high for the full bank (intraclass correlation [ICC]=0.93), two-question (ICC=0.85), and six-question (ICC=0.91) short forms. The item-bank scores correlated highly with the legacy Pain Catastrophizing Scale (r=0.83), supporting construct validity. Patients with mild, moderate, and severe pain had significantly different scores (p<0.05), supporting known groups validity.

Pain-related self-efficacy item bank. The final item bank included 29 questions. Scores from the full item bank correlated highly with the two-question (r=0.90) and six-question (r=0.97) short forms. Test-retest reliability was high for the full bank (ICC=0.95), two-question (ICC=0.86), and six-question (ICC=0.92) short forms. The item-bank score correlated highly with the legacy Pain Self-Efficacy Questionnaire (r=0.87), supporting construct validity. Patients with mild, moderate, and severe pain had significantly different scores (p<0.05).

Limitations

The study did not include many people with common pain conditions such as carpal tunnel or cancer-related pain. The item banks may not be valid for people with these conditions.

Conclusions and Relevance

Results support the reliability and validity of the pain appraisal and pain-related self-efficacy item banks and short forms. Epidemiologists and researchers can use the measures to examine predictors and correlates of health outcomes related to chronic pain.

Future Research Needs

Future research could include additional validity studies with people of different races or ages, or with other types of pain. Researchers could also determine and validate cutoff scores for use in clinical practice and determine what changes in scores are clinically important.

Final Research Report

View this project's final research report.

Journal Articles

Patient

Measuring Pain Catastrophizing and Pain-Related Self-Efficacy: Expert Panels, Focus Groups, and Cognitive Interviews

Peer-Review Summary

Peer review of PCORI-funded research helps make sure the report presents complete, balanced, and useful information about the research. It also assesses how the project addressed PCORI’s Methodology Standards. During peer review, experts read a draft report of the research and provide comments about the report. These experts may include a scientist focused on the research topic, a specialist in research methods, a patient or caregiver, and a healthcare professional. These reviewers cannot have conflicts of interest with the study.

The peer reviewers point out where the draft report may need revision. For example, they may suggest ways to improve descriptions of the conduct of the study or to clarify the connection between results and conclusions. Sometimes, awardees revise their draft reports twice or more to address all of the reviewers’ comments.

The awardee made the following revisions in response to peer review:

In response to reviewer concerns about the lack of information related to missing data at the item level in this study of scale development, the awardee added information about measures it took to minimize missing data for the legacy, validity, and neuropathic pain measures. In the data-analysis section, the investigator also added more information about measures taken to minimize missing data. Furthermore, in the results section, the awardee provided more information on the occurrence of missing data in candidate item banks.
The awardee responded to reviewer concerns about the potential stigma for patients completing the pain scale by reporting that the awardee asked patients with chronic pain to review the language to make sure it was not stigmatizing. The awardee took the patient advisors’ advice and added two more positively framed self-efficacy items to the pain scale to reduce the negativity of the measure. The awardee added information to the results section about the cognitive interview, including the proportion of people with clinically important levels of pain catastrophizing and self-efficacy. The awardee also noted in the limitations section that few of the study participants had these characteristics, and therefore, future qualitative research should include more individuals with such characteristics to ensure adequate representation on the clinical spectrum of chronic pain.
The awardee addressed reviewers’ concerns that the study sample contained a disproportionately high level of well-educated people and low levels of Hispanic or African-American participants. The awardee added generalizability of the results based on the study sample to the list of study limitations.

Conflict of Interest Disclosures

View the COI disclosure form.

Project Details

Principal Investigator

Dagmar Amtmann, PhD

Project Status

Completed; PCORI Public and Professional Abstracts, and Final Research Report Posted

Project Title

Extending PROMIS Pain Item Banks: Pain Self-Efficacy and Pain Catastrophizing

Board Approval Date

September 2014

Project End Date

June 2018

Organization

University of Washington

Year Awarded

2014

State

Washington

Year Completed

2018

Project Type

Research Project

Health Conditions

Muscular and Skeletal Disorders

Arthritis

Chronic Back Pain

Degenerative Muscular Disorders

Muscular and Skeletal Disorders - Other

Neurological Disorders

Chronic Pain

Multiple Sclerosis

Neurological Disorders - Other

Parkinsons Disease

Nutritional and Metabolic Disorders

Diabetes

Funding Announcement

Improving Methods for Conducting Patient-Centered Outcomes Research

Project Budget

$742,242

DOI - Digital Object Identifier

10.25302/7.2019.ME.140312550

Study Registration Information

HSRP20152315

Page Last Updated:

July 29, 2019