Detecting Differential Item Functioning of Polytomous Items for an Ideal Point Response Process

Wang, Wei; Tay, Louis; Drasgow, Fritz

doi:10.1177/0146621613476156

Cited by 25 publications

(32 citation statements)

References 52 publications

(88 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Second, measurement invariance of both items and raters between subpopulation groups is critically important in rater‐mediated assessments. The traditional item response theory–based indices and methods for detecting differential item functioning (DIF) can be applied to unfolding models (Carter, ; Seybert, Stark, & Chernyshenko, ; W. C. Wang, Tay, & Drasgow, ). For rater‐mediated assessments, an investigation on differential rater functioning with the use of these indices based on HCM will be considered in future research.…”

Section: Discussion Implications and Future Directionsmentioning

confidence: 99%

“…Second, measurement invariance of both items and raters between subpopulation groups is critically important in rater-mediated assessments. The traditional item response theory-based indices and methods for detecting differential item functioning (DIF) can be applied to unfolding models (Carter, 2011;Seybert, Stark, & Chernyshenko, 2014;W. C. Wang, Tay, & Drasgow, 2013).…”

Section: Discussion Implications and Future Directionsmentioning

confidence: 99%

See 1 more Smart Citation

Conceptualizing Rater Judgments and Rating Processes for Rater‐Mediated Assessments

Wang

Engelhard²

2019

J Educational Measurement

View full text Add to dashboard Cite

Rater‐mediated assessments exhibit scoring challenges due to the involvement of human raters. The quality of human ratings largely determines the reliability, validity, and fairness of the assessment process. Our research recommends that the evaluation of ratings should be based on two aspects: a theoretical model of human judgment and an appropriate measurement model for evaluating these judgments. In rater‐mediated assessments, the underlying constructs and response processes may require the use of different rater judgment models and the application of different measurement models. We describe the use of Brunswik's lens model as an organizing theme for conceptualizing human judgments in rater‐mediated assessments. The constructs vary depending on which distal variables are identified in the lens models for the underlying rater‐mediated assessment. For example, one lens model can be developed to emphasize the measurement of student proficiency, while another lens model can stress the evaluation of rater accuracy. Next, we describe two measurement models that reflect different response processes (cumulative and unfolding) from raters: Rasch and hyperbolic cosine models. Future directions for the development and evaluation of rater‐mediated assessments are suggested.

show abstract

Section: Discussion Implications and Future Directionsmentioning

confidence: 99%

Section: Discussion Implications and Future Directionsmentioning

confidence: 99%

Conceptualizing Rater Judgments and Rating Processes for Rater‐Mediated Assessments

Wang

Engelhard²

2019

J Educational Measurement

View full text Add to dashboard Cite

show abstract

“…As primeiras técnicas para detectar DIF parecem não ter surtido o efeito pretendido, sendo que uma das dificuldades foi encontrar um consenso entre os parâ-metros que o indicariam (Wang, Tay, & Drasgow, 2013 (Pasquali, 2007).…”

Section: Funcionamento Diferencial Do Itemunclassified

“…Um item possui DIF pela TRI quando são padronizadas as mé-tricas da aptidão entre os grupos e depois são calculadas as Curvas Características dos Itens (CCIs) para cada grupo. Caso exista sobreposição entre as CCIs, conclui-se que o item não apresenta DIF (Pasquali, 2007;Wang et al, 2013).…”

Section: Funcionamento Diferencial Do Itemunclassified

Escala de Avaliação da Fadiga: funcionamento diferencial dos itens em regiões brasileiras

et al. 2016

View full text Add to dashboard Cite

RESUMOEste estudo teve como objetivo conhecer, por meio da ABSTRACT -Fatigue Assessment Scale: Diferential item functioning in Brazilian regionsThis study aimed to understand, through the Item Response Theory, the psychometric parameters and Differential Item Functioning (DIF) of the Fatigue Assessment Scale (FAS). There were 7,008 physicians participating, with a mean age of 47.3 years (SD=11.33), the majority being male (62.4%). We estimated the items' parameters through the Samejima Graded Response Model and the DIF by likelihood ratio, the pseudo-R2 statistics and the differences between the weights of the regressions (∆βs). Results showed good variation of the response thresholds (j) and good discrimination (a). Concerning the DIF, even considering the strictest criteria set forth in the literature, the findings showed a non-significant effect of the region in response to the items. In conclusion, probably the FAS does not have DIF, supporting its use in the Brazilian context.

show abstract

“…Differential Item functioning (DIF), can be defined as differentiation in probability of giving correct response for individuals with the same skills levels but coming from different subgroups (Carter & Zickar, 2011;Cohen, Kim, & Baker, 1993;Finch, 2005;Holland, Wainer, & Service, 1993;Rudner, Getson, & Knight, 1980;Shepard, Camilli, & Williams, 1985;Wang, Tay, & Drasgow, 2013) Differentiation in probabilities may be due to item bias or differences in individual knowledge, skills and traits. In determination of test-item bias Differential item functioning (DIF) analysis is widely used technique.…”

Section: Introductionmentioning

confidence: 99%

Comparison of Parametric and Nonparametric Item Response Techniques in Determining Differential Item Functioning in Polytomous Scale

Başokçu¹,

Öğretmen

2014

AJTAS

View full text Add to dashboard Cite

This study aims to compare parametric and nonparametric methods based on Item Response Theory in determining differential item functioning in polytomous scales. DIF analysis based on parametric IRT was conducted by using parameters comparison method. For nonparametric IRT analysis, DIF is determined by comparison of area indices pertaining to ICC obtained for reference and focal groups. The Comparisons were conducted on data sets from TIMSS 2011 8th Class students survey where data set pertaining to responses of students to "Attitudes Toward Mathematics" composing of samplings from Turkey and South Korea and it was determined if it incorporated DIF according to country and sex differences. It is observed that parametric and nonparametric methods produce generally similar results for DIF analysis in terms of countries. Nevertheless, DIF analysis results for country based sex groups differed according to techniques based on parametric and nonparametric IRT. Results of the study showed that items incorporating DIF differed as to preferred technique. This indicated importance of choosing the best technique in studies to detect whether scale items incorporates DIF or not.

show abstract

Detecting Differential Item Functioning of Polytomous Items for an Ideal Point Response Process

Cited by 25 publications

References 52 publications

Conceptualizing Rater Judgments and Rating Processes for Rater‐Mediated Assessments

Conceptualizing Rater Judgments and Rating Processes for Rater‐Mediated Assessments

Escala de Avaliação da Fadiga: funcionamento diferencial dos itens em regiões brasileiras

Comparison of Parametric and Nonparametric Item Response Techniques in Determining Differential Item Functioning in Polytomous Scale

Contact Info

Product

Resources

About