Content validity testing of the INTERMED Self‐Assessment in a sample of adults with rheumatoid arthritis and rheumatology healthcare providers

Abstract

BackgroundCare complexity can occur when patients experience health challenges simultaneously with social barriers including food and/or housing insecurity, lack of transportation or other factors that impact care and patient outcomes. People with rheumatoid arthritis (RA) may experience care complexity due to the chronicity of their condition and other biopsychosocial factors. There are few standardised instruments that measure care complexity and none that measure care complexity specifically in people with RA.ObjectivesWe assessed the content validity of the INTERMEDS Self‐Assessment (IMSA) instrument that measures care complexity with a sample of adults with RA and rheumatology healthcare providers (HCPs). Cognitive debriefing interviews utilising a reparative framework were conducted.MethodsPatient participants were recruited through two existing studies where participants agreed to be contacted about future studies. Study information was also shared through email blasts, posters and brochures at rheumatology clinic sites and trusted arthritis websites. Various rheumatology HCPs were recruited through email blasts, and divisional emails and announcements. Interviews were conducted with nine patients living with RA and five rheumatology HCPs.ResultsThree main reparative themes were identified: (1) Lack of item clarity and standardisation including problems with item phrasing, inconsistency of the items and/or answer sets and noninclusive language; (2) item barrelling, where items asked about more than one issue, but only allowed a single answer choice; and (3) timeframes presented in the item or answer choices were either too long or too short, and did not fit the lived experiences of patients. Items predicting future healthcare needs were difficult to answer due to the episodic and fluctuating nature of RA.ConclusionsDespite international use of the IMSA to measure care complexity, patients with RA and rheumatology HCPs in our setting perceived that it did not have content validity for use in RA and that revision for use in this population under a reparative framework was unfeasible. Future instrument development requires an iterative cognitive debriefing and repair process with the population of interest in the early stages to ensure content validity and comprehension.Patient or Public ContributionPatient and public contributions included both patient partners on the study team and people with RA who participated in the study. Patient partners were involved in study design, analysis and interpretation of the findings and manuscript preparation. Data analysis was structured according to emergent themes of the data that were grounded in patient perspectives and experiences.

Healthy Lives 5 Axis Scale for Individuals with Complex Health and Social Needs: Assessment of Validity and Reliability

“…INTERMED requires 20-30 minutes to complete and is not appropriate for patients who have impaired memory or cognition. While useful in identifying populations who would bene t from case management, recent studies have noted its limitations in differentiating high-cost, high-need patients with multiple chronic conditions from other patients, 20 its validity with individuals with rheumatoid arthritis 21 or its utility for treatment planning in a primary care practice 22 . This nding resonates with a National Academy of Medicine monograph on the care of high-need patients, which notes that "… the current system of metrics is not designed in a way that encourages providers to organize care in the most effective manner."…”