A generalized item response tree model for psychological assessments

Jeon, Minjeong; Boeck, Paul De

doi:10.3758/s13428-015-0631-y

Cited by 120 publications

(150 citation statements)

References 43 publications

Supporting

Mentioning

148

Contrasting

Unclassified

Order By: Relevance

“…Participants ( n = 53) who demonstrated insufficient effort (measured by time spent on the survey) and provided invalid responses to all CRT items were excluded. The final sample size was 591, well within the accepted range (i.e., >500 for fitting Rasch models; Linacre, ) of those used in IRTree literature analyzing models with similar tree size (DeBoeck & Partchev, ; Jeon & De Boeck, ). To specify the IRTree model, response options from each CRT item were coded to create pseudoitems (see Table ).…”

Section: Methodsmentioning

confidence: 80%

Assessing the validity of inferences from scores on the cognitive reflection test

Blacksmith

Yang

Behrend

et al. 2019

Behavioral Decision Making

View full text Add to dashboard Cite

Decision‐making researchers purport that a novel cognitive ability construct, cognitive reflection, explains variance in intuitive thinking processes that traditional mental ability constructs do not. However, researchers have questioned the validity of the primary measure because of poor construct conceptualization and lack of validity studies. Prior studies have not adequately aligned the analytical techniques with the theoretical basis of the construct, dual‐processing theory of reasoning. The present study assessed the validity of inferences drawn from the cognitive reflection test (CRT) scores. We analyzed response processes with an item response tree model, a method that aligns with the dual‐processing theory in order to interpret CRT scores. Findings indicate that the intuitive and reflective factors that the test purportedly measures were indistinguishable. Exploratory, post hoc analyses demonstrate that CRT scores are most likely capturing mental abilities. We suggest that future researchers recognize and distinguish between individual differences in cognitive abilities and cognitive processes.

show abstract

Section: Methodsmentioning

confidence: 80%

Assessing the validity of inferences from scores on the cognitive reflection test

Blacksmith

Yang

Behrend

et al. 2019

Behavioral Decision Making

View full text Add to dashboard Cite

show abstract

“…Based on this recoding, the Böckenholt Model can be fit using software for standard, three-dimensional, binary IRT models. It is important to note that this method is limited to IRtree models in which each response category is reached by a single processing path (Böckenholt, 2012a;Jeon & De Boeck, 2016).…”

Section: The Ir-tree Model Of Response Stylesmentioning

confidence: 99%

“…However, estimating IR-tree models based on pseudoitems in general involves "the restriction that each observed response category has a unique path to one of the latent response processes" (Böckenholt, 2012a, p. 667). Thus, models are excluded in which two branches lead to the same category (Jeon & De Boeck, 2016). 2 However, this restriction does not apply to hierarchical MPT models, where multiple processes may lead to the same outcome with a probability given as the sum of the respective branch probabilities.…”

Section: Multinomial Processing Tree Modelsmentioning

confidence: 99%

A New Model for Acquiescence at the Interface of Psychometrics and Cognitive Psychology

Plieninger

Heck

2018

Multivariate Behavioral Research

View full text Add to dashboard Cite

When measuring psychological traits, one has to consider that respondents often show content-unrelated response behavior in answering questionnaires. To disentangle the target trait and two such response styles, extreme responding and midpoint responding, Böckenholt ( 2012a ) developed an item response model based on a latent processing tree structure. We propose a theoretically motivated extension of this model to also measure acquiescence, the tendency to agree with both regular and reversed items. Substantively, our approach builds on multinomial processing tree (MPT) models that are used in cognitive psychology to disentangle qualitatively distinct processes. Accordingly, the new model for response styles assumes a mixture distribution of affirmative responses, which are either determined by the underlying target trait or by acquiescence. In order to estimate the model parameters, we rely on Bayesian hierarchical estimation of MPT models. In simulations, we show that the model provides unbiased estimates of response styles and the target trait, and we compare the new model and Böckenholt's model in a recovery study. An empirical example from personality psychology is used for illustrative purposes.

show abstract

“…For example, Batchelder and Riefer (1999) summarized a number of applications in psychology using the multinomial process tree model, which combines the multinomial model with the tree structure. In addition, researchers have also incorporated item response models into tree structures for various purposes, such as modelling missing responses (e.g., B€ ockenholt, 2012;B€ ockenholt & Meiser, 2017;Jeon & De Boeck, 2016;Revuelta, 2008).…”

Section: Model Parameterizationmentioning

confidence: 99%

A diagnostic tree model for polytomous responses with multiple strategies

2018

Brit J Math & Statis

View full text Add to dashboard Cite

Constructed-response items have been shown to be appropriate for cognitively diagnostic assessments because students' problem-solving procedures can be observed, providing direct evidence for making inferences about their proficiency. However, multiple strategies used by students make item scoring and psychometric analyses challenging. This study introduces the so-called two-digit scoring scheme into diagnostic assessments to record both students' partial credits and their strategies. This study also proposes a diagnostic tree model (DTM) by integrating the cognitive diagnosis models with the tree model to analyse the items scored using the two-digit rubrics. Both convergent and divergent tree structures are considered to accommodate various scoring rules. The MMLE/EM algorithm is used for item parameter estimation of the DTM, and has been shown to provide good parameter recovery under varied conditions in a simulation study. A set of data from TIMSS 2007 mathematics assessment is analysed to illustrate the use of the two-digit scoring scheme and the DTM.

show abstract

A generalized item response tree model for psychological assessments

Cited by 120 publications

References 43 publications

Assessing the validity of inferences from scores on the cognitive reflection test

Assessing the validity of inferences from scores on the cognitive reflection test

A New Model for Acquiescence at the Interface of Psychometrics and Cognitive Psychology

A diagnostic tree model for polytomous responses with multiple strategies

Contact Info

Product

Resources

About