Psychometric Modeling of response speed and accuracy with mixed and conditional regression

Breukelen, Gerard van

doi:10.1007/s11336-003-1078-0

Cited by 44 publications

(60 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…A commonly suggested transform for RT data is the logarithmic transform (Keppel & Wickens, 2004;Van Breukelen, 2005), which will reshape the distribution of RT data so that its heavy right tail is removed and it becomes more akin to a normal distribution. A mixed model analysis of log-transformed RTs resulted in the same significance levels as in model 1 but improved the distribution of residuals (Fig.…”

Section: Regression Diagnostics and Transformsmentioning

confidence: 99%

Twice random, once mixed: Applying mixed models to simultaneously analyze random effects of language and participants

Janssen

2011

Behav Res

View full text Add to dashboard Cite

Psychologists, psycholinguists, and other researchers using language stimuli have been struggling for more than 30 years with the problem of how to analyze experimental data that contain two crossed random effects (items and participants). The classical analysis of variance does not apply; alternatives have been proposed but have failed to catch on, and a statistically unsatisfactory procedure of using two approximations (known as F 1 and F 2 ) has become the standard. A simple and elegant solution using mixed model analysis has been available for 15 years, and recent improvements in statistical software have made mixed models analysis widely available. The aim of this article is to increase the use of mixed models by giving a concise practical introduction and by giving clear directions for undertaking the analysis in the most popular statistical packages. The article also introduces the DJMIXED add-on package for SPSS, which makes entering the models and reporting their results as straightforward as possible.

show abstract

Section: Regression Diagnostics and Transformsmentioning

confidence: 99%

Twice random, once mixed: Applying mixed models to simultaneously analyze random effects of language and participants

Janssen

2011

Behav Res

View full text Add to dashboard Cite

show abstract

“…In experimental research, this is obtained as a proportion-correct conditioning on observed response time for each time-limit condition. For both SATF and CAF, a certain person ability and item difficulty are assumed to be given (i.e., these parameters are kept constant; Roskam, 1997;van Breukelen, 2005). Experimental research typically computes group means to investigate SATF and CAF.…”

Section: Speed-accuracy and Speed-ability Trade-offmentioning

confidence: 99%

“…The SATF is supposed to increase monotonically; whereas, for the CAF other forms may also be observed depending on the difference between mean correct response time and mean incorrect response time (Heitz, 2014;Luce, 1986). For instance, an erroneous process associated with both a long response time and an incorrect response would produce a decreasing CAF (van Breukelen, 2005).…”

Section: Speed-accuracy and Speed-ability Trade-offmentioning

confidence: 99%

“…Subscript c was added to the observations and person parameters to indicate that the observed variables depend on the person's speed-ability trade-off realized in condition c. As discussed in the following section, various measurement models have been developed to link these observed variables to latent variables representing the constructs of ability and speed (e.g., Loeys, Rosseel, & Baten, 2011;van Breukelen, 2005;van der Linden, 2007). …”

Section: A Conceptual Measurement Framework For Ability and Speedmentioning

confidence: 99%

“…also allows for residual correlations between errors in the item response and the response-time model (e.g., Ranger & Ortner, 2012;van Breukelen, 2005), which means that the structure of (item-specific) correlations between response and response time may be more complex than is represented by measurement models assuming a simple structure and a latent correlation between speed and ability. This is also suggested by random response time effects on task success varying considerably across items (Goldhammer, Naumann, & Greiff, 2015;.…”

Section: Pcimentioning

confidence: 99%

See 2 more Smart Citations

Measuring Ability, Speed, or Both? Challenges, Psychometric Solutions, and What Can Be Gained From Experimental Control

Goldhammer

2015

Measurement: Interdisciplinary Research and Perspectives

View full text Add to dashboard Cite

The main challenge of ability tests relates to the difficulty of items, whereas speed tests demand that test takers complete very easy items quickly. This article proposes a conceptual framework to represent how performance depends on both between-person differences in speed and ability and the speed-ability compromise within persons. Related measurement challenges and psychometric models that have been proposed to deal with the challenges are discussed. It is argued that addressing individual differences in the speed-ability trade-off requires the control of item response times. In this way, response behavior can be captured exclusively with the response variable remedying problems in traditional measurement approaches.Keywords: ability, experimental control, item response modeling, response time modeling, speed, speed-ability trade-offIn their book on the measurement of intelligence, Thorndike, Bregman, Cobb, and Woodyard (1926) present a theorem, which says that "other things being equal, if intellect A can do at each level the same number of tasks as intellect B, but in a less time, intellect A is better." (p. 33). This statement illustrates that in any performance measure, both the result of interacting with an item and how long it took to reach the result need to be considered and that comparing individuals in one respect requires keeping the other aspect constant. Along these lines, Thorndike et al. (1926) proposed the concepts of level (i.e., ability) and speed, which are empirically defined by the produced products (item responses) and the time required to produce them (response times). In measurement literature, various concepts such as ability, level, and power have been used to refer to a disposition explaining individual differences in response accuracy (Gulliksen, 1950;Thorndike et al., 1926;Thurstone, 1937); for consistency reasons, only the term ability will be used in this paper. A wide range of approaches have been suggested to conceptualize and model

show abstract

Reaction Time

Young¹,

Crumer²

2017

Encyclopedia of Animal Cognition and Behavior

View full text Add to dashboard Cite

Psychometric Modeling of response speed and accuracy with mixed and conditional regression

Abstract: time limit tests, conditional accuracy function, speed-accuracy tradeoff, conditional logistic regression, Cox regression, mixed regression, multilevel analysis, latent trait, mental rotation,

Cited by 44 publications

References 31 publications

Twice random, once mixed: Applying mixed models to simultaneously analyze random effects of language and participants

Twice random, once mixed: Applying mixed models to simultaneously analyze random effects of language and participants

Measuring Ability, Speed, or Both? Challenges, Psychometric Solutions, and What Can Be Gained From Experimental Control

Reaction Time

Contact Info

Product

Resources

About