Differential Item Functioning Across Race in Aging Research: An Example Using a Social Support Measure

Sacco, Paul; Casado, Banghwa Lee; Unick, George J.

doi:10.1080/07317115.2011.524818

Cited by 11 publications

(8 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, after accounting for differential item functioning in subsequent analyses, Hispanics/Latinos did not significantly differ from non-Hispanic/Latino Whites on mean social support scores, suggesting that the observed differences in ISEL-12 scores were due to differences in response patterns on the measure, rather than differences in the underlying construct of social support. As such, Sacco et al (2010) warned that ISEL-12 scores should be interpreted with caution among Hispanics/Latinos.…”

mentioning

confidence: 99%

“…In fact, the measure has already been applied in several empirical reports involving samples composed of Hispanics/Latinos (e.g., Arango Lasprilla, Moreno, Rogers, & Francis, 2009; Ornelas & Perreira, 2011; Salgado, Castañeda, Talavera, & Lindsay, 2012). To date, there has been one psychometric evaluation of ISEL-12 scores among Hispanics/Latinos (Sacco, Casado, & Unick, 2010). This study used data from the National Epidemiologic Survey of Alcohol and Related Conditions and reported data from 1,109 older adult Hispanics/Latinos (national origins were not specified) and 6,347 non-Hispanic Whites.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Validation of Interpersonal Support Evaluation List-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study.

Merz

Roesch

Malcarne

et al. 2014

Psychological Assessment

176

120

View full text Add to dashboard Cite

The Interpersonal Support Evaluation List-12 (ISEL-12; Cohen, Mermelstein, Kamarck, & Hoberman, 1985) is broadly employed as a short-form measure of the traditional ISEL, which measures functional (i.e., perceived) social support. The ISEL-12 can be scored by summing the items to create an overall social support score; three subscale scores representing appraisal, belonging, and tangible social support have also been proposed. Despite extensive use, studies of the psychometric properties of ISEL-12 scores have been limited, particularly among Hispanics/Latinos, the largest and fastest growing ethnic group in the United States. The present study investigated the reliability, and structural and convergent validity of ISEL-12 scores using data from 5,313 Hispanics/Latinos who participated in the Hispanic Community Health Study/Study of Latinos Sociocultural Ancillary study. Participants completed measures in English or Spanish, and identified their ancestry as Dominican, Central American, Cuban, Mexican, Puerto Rican, or South American. Cronbach’s alphas suggested adequate internal consistency for the total score for all languages and ancestry groups; coefficients for the subscale scores were not acceptable. Confirmatory factor analyses revealed that the one-factor and three-factor models fit the data equally well. Results from multigroup confirmatory factor analyses supported a similar one-factor structure with equivalent response patterns and variances between language groups and ancestry groups. Convergent validity analyses suggested that the total social support score related to scores of social network integration, life engagement, perceived stress, and negative affect (depression, anxiety) in the expected directions. The total score of the ISEL-12 can be recommended for use among Hispanics/Latinos.

show abstract

mentioning

confidence: 99%

mentioning

confidence: 99%

Validation of Interpersonal Support Evaluation List-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study.

Merz

Roesch

Malcarne

et al. 2014

Psychological Assessment

176

120

View full text Add to dashboard Cite

show abstract

“…Systematic bias in measurement across ethnicity/race has been found in the measures of alcohol use (Fish et al, 2018; Lopez-Vergara et al, 2020), alcohol outcome expectancies (Ham et al, 2013; McCarthy et al, 2009), alcohol dependence (Carle, 2008, 2009), cocaine dependence (Wu et al, 2010), nicotine dependence (Lopez-Vergara et al, 2020; Rose et al, 2018), and cannabis involvement (Miller et al, 2019). Systematic bias in measurement across ethnicity/race has also been found in constructs that frequently overlap with substance use, such as socioeconomic status (Lopez-Vergara et al, 2020), discrimination (Bastos & Harnois, 2020; Harnois et al, 2019; Lewis et al, 2012; Lopez-Vergara et al, 2020; Reeve et al, 2011; Sladek et al, 2020), intelligence (Wicherts, 2016), personality (Dong & Dumas, 2020), social support (Sacco et al, 2011), and depression (Breslau et al, 2008; Crockett et al, 2005), as well as neuropsychological tasks (Avila et al, 2020) and college admission tests (Santelices & Wilson, 2010). Hence, there is substantial empirical evidence supporting psychometric critiques of cross-cultural research.…”

Section: Historical Backgroundmentioning

confidence: 99%

The cultural equivalence of measurement in substance use research.

Lopez-Vergara

Yang

Weiss

et al. 2021

Experimental and Clinical Psychopharmacology

View full text Add to dashboard Cite

Across a wide range of substance use outcomes, ethnic/racial minorities in the U.S. experience a disproportionately higher burden of negative health outcomes and/or lower levels of access to care (relative to non-Latinx White individuals). Various explanations for these substance use-related health disparities have been proposed. This narrative review will not focus on the theoretical content of these explanations but will instead focus on the underlying statistical frameworks that are used to test such theories. Here, we provide a narrative review of psychometric critiques of cross-cultural research, which collectively suggest that (a) research testing similarities and differences among ethnic/racial groups often miss or omit to test statistical assumptions of equal instrument functioning across the ethnic/racial groups being compared; (b) testing the assumptions of equal instrument functioning is feasible using established guidelines from modern measurement theories; and (c) substance use research may need to explicitly incorporate the tests of equal instrument functioning to prevent bias when making inferences across ethnic/racial groups. We provide recommendations for evaluating the cultural equivalence of measurement using structural equation modeling, and advocate that cross-cultural substance use research move toward statistical approaches that are better positioned to test for (and model) bias in measurement. Explicitly testing the cultural equivalence of measurement when making inferences across cultural groups (within a falsifiable psychometric framework) can advance our understanding of similarities and differences among ethnic/racial groups, and hence can provide a more socially just (and statistically robust) scientific base. Public Health SignificanceStatistical critiques question the comparability of measurement in research making group comparisons across ethnic/racial groups. Testing the comparability of measurement across ethnic/racial groups is statistically feasible yet infrequently done. Future research may benefit from statistically testing the comparability of measurement when making comparisons across ethnic/racial groups.

show abstract

“…However, latent variable models can be used to adjust for DIF in the process of scoring measures. For example, Sacco, Casado, and Unick (2011) conducted a DIF analysis of the Interpersonal Support Evaluation List (ISEL-12; Cohen, Mermelstein, Kamarck, & Hoberman, 1985), a measure of perceived social support. Focusing on race, the authors found DIF on 10 of the instrument’s 12 items.…”

Section: How Are We Using Irt?mentioning

confidence: 99%

Advances in applications of item response theory to clinical assessment.

Michael¹

2019

Psychological Assessment

View full text Add to dashboard Cite

Item response theory (IRT) is moving to the forefront of methodologies used to develop, evaluate, and score clinical measures. Funding agencies and test developers are routinely supporting IRT work, and the theory has become closely tied to technological advances within the field. As a result, familiarity with IRT has grown increasingly relevant to mental health research and practice. But to what end? This article reviews advances in applications of IRT to clinical measurement in an effort to identify tangible improvements that can be attributed to the methodology. Although IRT shares similarities with classical test theory and factor analysis, the approach has certain practical benefits, but also limitations, when applied to measurement challenges. Major opportunities include the use of computerized adaptive tests to prevent conditional measurement error, multidimensional models to prevent misinterpretation of scores, and analyses of differential item functioning to prevent bias. Whereas these methods and technologies were once only discussed as future possibilities, they are now accessible because of recent support of IRT-focused clinical research. Despite this, much work still remains in widely disseminating methods and technologies from IRT into mental health research and practice. Clinicians have been reluctant to fully embrace the approach, especially in terms or prospective test development and adaptive item administration. Widespread use of IRT technologies will require continued cooperation among psychometricians, clinicians, and other stakeholders. There are also many opportunities to expand the methodology, especially with respect to integrating modern measurement theory with models from personality and cognitive psychology as well as neuroscience. Public Significance StatementItem response theory (IRT) is a methodology used to develop, evaluate, and score psychological tests. This article reviews the literature for recent advancements in the use of IRT as applied to clinical research and practice. IRT has contributed to major advancements in computerized adaptive testing, multidimensional modeling, and the identification of bias, but there are still many opportunities to further develop applications of the theory.

show abstract

Differential Item Functioning Across Race in Aging Research: An Example Using a Social Support Measure

Cited by 11 publications

References 32 publications

Validation of Interpersonal Support Evaluation List-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study.

Validation of Interpersonal Support Evaluation List-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study.

The cultural equivalence of measurement in substance use research.

Advances in applications of item response theory to clinical assessment.

Contact Info

Product

Resources

About