Trail Making Test: Comparison of paper-and-pencil and electronic versions

Bracken, Magdalene R.; Mazur-Mosiewicz, Anya; Glazek, Kuba

doi:10.1080/23279095.2018.1460371

Cited by 20 publications

(15 citation statements)

References 59 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A study by Bracken et al postulates that new standard values must be generated for the application of digital or computerized test procedures, which means a considerable effort (Bracken et al, 2019). This seems not necessary for the use of the digital pen technology, because the method of execution is almost identical.…”

Section: Discussionmentioning

confidence: 99%

“…Less is said about the disadvantages of digitalized cognitive assessments. Some literature findings stated that clinicians should use tests on a computer or a tablet with caution and with consideration of potential technical complications (Bracken, Mazur-Mosiewicz, & Glazek, 2019;Cernich et al, 2007). Cernich et al focus primarily on the possible technical problems in hardware, software, peripherals, the display, connections, and bandwidth as well as program considerations (Cernich et al, 2007).…”

Section: Introduction and Overviewmentioning

confidence: 99%

See 1 more Smart Citation

Digital pen technology for conducting cognitive assessments: a cross-over study with older adults

Steinert

Latendorf

Prange

et al. 2020

Psychological Research

View full text Add to dashboard Cite

Many digitalized cognitive assessments exist to increase reliability, standardization, and objectivity. Particularly in older adults, the performance of digitized cognitive assessments can lead to poorer test results if they are unfamiliar with the computer, mouse, keyboard, or touch screen. In a cross-over design study, 40 older adults (age M = 74.4 ± 4.1 years) conducted the Trail Making Test A and B with a digital pen (digital pen tests, DPT) and a regular pencil (pencil tests, PT) to identify differences in performance. Furthermore, the tests conducted with a digital pen were analyzed manually (manual results, MR) and electronically (electronic results, ER) by an automized system algorithm to determine the possibilities of digital pen evaluation. ICC(2,k) showed a good level of agreement for TMT A (ICC(2,k) = 0.668) and TMT B (ICC(2,k) = 0.734) between PT and DPT. When comparing MR and ER, ICC(2,k) showed an excellent level of agreement in TMT A (ICC(2,k) = 0.999) and TMT B (ICC(2,k) = 0.994). The frequency of pen lifting correlates significantly with the execution time in TMT A (r = 0.372, p = 0.030) and TMT B (r = 0.567, p < 0.001). A digital pen can be used to perform the Trail Making Test, as it has been shown that there is no difference in the results due to the type of pen used. With a digital pen, the advantages of digitized testing can be used without having to accept the disadvantages.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introduction and Overviewmentioning

confidence: 99%

Digital pen technology for conducting cognitive assessments: a cross-over study with older adults

Steinert

Latendorf

Prange

et al. 2020

Psychological Research

View full text Add to dashboard Cite

show abstract

“…Testing mode effects in mental speed frequently result in nonequivalence between paper-based and computer-based administrations (e.g., Bracken et al, 2018; Drapeau et al, 2007; Fellows et al, 2017), thus making meaningful comparisons difficult. Although one could argue that the advantages of computerized assessments outweigh the need for psychometric equivalence, mode effects impede the implementation of mixed-mode designs and can even misdirect theory development if paper- and computer-based measures of a construct seem different as a result of testing modes alone (see Schmitz & Wilhelm, 2019).…”

Section: Discussionmentioning

confidence: 99%

“…A reason for the incomparability of TMT scores might be that the motor skills required to draw on a sheet of paper are quite different from using a mouse and clicking on a computer screen. However, even tablet administrations with touch functionality do not seem to alleviate this problem (Bracken et al, 2018). In recent decades, cognitive assessments are also increasingly administered over the Internet without the presence of a supervisor (e.g., Steger et al, 2020; Zinn et al, 2021).…”

mentioning

confidence: 99%

The Web-Based Assessment of Mental Speed

Gnambs

2023

European Journal of Psychological Assessment

View full text Add to dashboard Cite

Abstract. Although web-based cognitive assessments have gained increasing attention in recent decades, it is still debated whether unstandardized test settings allow for comparable measurements as compared to proctored testing, particularly for speeded cognitive tests. Therefore, two within-subject experiments ( N = 73 and N = 72) compared differences in means, criterion correlations with measures of intelligence, and subjective test quality perceptions of a trail-making test between a proctored paper-based, a proctored computerized, and an unproctored web-based administration mode. The results in both samples showed equivalent means between the two computerized modes, equivalent criterion correlations between the three modes, and no differential item functioning. However, the web-based tests were rated as having an inferior measurement quality as compared to the proctored assessments. Thus, web-based testing allows for comparable measurements of mental speed as compared to traditional computerized tests, although it is still regarded as a lower quality medium by test takers.

show abstract

“…The computerized versions of tests like WCST provide convenience for examiners who find these tests hard to administer and inconvenient to score. Studies examine the equivalence of the manual and computerized versions not only of WCST but also of other neuropsychological tests (Bracken et al, 2019).…”

Section: Discussionmentioning

confidence: 99%

Comparison of computerized and manual versions of the Wisconsin Card Sorting Test on schizophrenia and healthy samples.

Çelik

Oğuz

Konur

et al. 2021

Psychological Assessment

View full text Add to dashboard Cite

This study aims to examine whether there is an equivalence between the two different versions of Wisconsin Card Sorting Test (WCST) regarding psychometric properties on two distinct samples: individuals diagnosed with schizophrenia and those who are healthy. A total of 504 individuals were included in the study, 243 were diagnosed with schizophrenia, and 261 were healthy individuals. Both samples were separated into two subsamples, and the individuals in each separated group were administered either WCST-C (computerized) or WCST-M (manual) version of the test. We compared statistical measures of mean and variance with the data obtained from the two samples. We carried out analyses related to parallel forms reliability and equality of variances of the tests scores produced by parallel forms of the WCST. There was no significant difference between mean values of manual and computerized versions administered for each sample. However, the patterns of variances of the obtained scores were dissimilar. According to these findings, the two versions were found to be inequivalent regarding psychometric properties. Public Significance StatementThis study suggests that the manual and computerized versions of the Wisconsin Card Sorting Test are not equivalent regarding psychometric properties. The findings should guide the practitioners on which test version to choose for a particular target group to evaluate their executive functions.

show abstract

Trail Making Test: Comparison of paper-and-pencil and electronic versions

Cited by 20 publications

References 59 publications

Digital pen technology for conducting cognitive assessments: a cross-over study with older adults

Digital pen technology for conducting cognitive assessments: a cross-over study with older adults

The Web-Based Assessment of Mental Speed

Comparison of computerized and manual versions of the Wisconsin Card Sorting Test on schizophrenia and healthy samples.

Contact Info

Product

Resources

About