Call for Papers: “Process Data in Computer-Based Assessment: 					Opening the Black Box”

doi:10.1027/1015-5759/a000658

European Journal of Psychological Assessment

2021

DOI: 10.1027/1015-5759/a000658

|View full text |Cite

Call for Papers: “Process Data in Computer-Based Assessment: Opening the Black Box”

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

Publication Types

Select...

Article2

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

(1 citation statement)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There is much anticipation of the many advantages of computer-based assessments. However, chief among these advantages is the potential of recording and using process data to "open the black box," as the editors of this special issue stated in the call for papers (Lindner & Greiff, 2021), suggesting that one is peering into the brains, thoughts, and minds of test takers as they take a computer-based assessment with the aim to increase the quality of psychological and educational assessment. As one can imagine, this promised journey into the domain of the neuro and cognitive has drawn the attention of many travelers to response processes.…”

mentioning

confidence: 99%

Process and Product in Computer-Based Assessments

Zumbo

Maddox

Care

2023

European Journal of Psychological Assessment

View full text Add to dashboard Cite

There is no consensus among assessment researchers about many of the central problems of response process data, including what is it and what is it comprised of. The Standards for Educational and Psychological Testing ( American Educational Research Association et al., 2014 ) locate process data within their five sources of validity evidence. However, we rarely see a conceptualization of response processes; rather, the focus is on the techniques and methods of assembling response process indices or statistical models. The method often overrides clear definitions, and, as a field, we may therefore conflate method and methodology – much like we have conflated validity and validation ( Zumbo, 2007 ). In this paper, we aim to clear the conceptual ground to explore the scope of a holistic framework for the validation of process and product. We review prominent conceptualizations of response processes and their sources and explore some fundamental questions: Should we make a theoretical and practical distinction between response processes and response data? To what extent do the uses of process data reflect the principles of deliberate, educational, and psychological measurement? To answer these questions, we consider the case of item response times and the potential for variation associated with disability and neurodiversity.

show abstract

mentioning

confidence: 99%

Process and Product in Computer-Based Assessments

Zumbo

Maddox

Care

2023

European Journal of Psychological Assessment

View full text Add to dashboard Cite

show abstract

Process Data in Computer-Based Assessment

Lindner

Greiff

2023

European Journal of Psychological Assessment

View full text Add to dashboard Cite

This editorial provides a comprehensive framework and overview of potential uses and next steps in research on process data in computer-based assessments, expanding toward broad perspectives on the field and an exploration of future directions and emerging trends. After briefly reflecting on the evolution of process data use in research and assessment practice, we discuss three key challenges, namely (1) the theoretical grounding and validation of process data indicators, (2) assessment design for process data, and (3) ethical standards. By considering best practice approaches in all three areas and current discussions in the literature, we conclude that a focus is needed on the following three areas: (1) strong, holistic theoretical frameworks for validating process data, (2) reliable, standardized data collections, preferably with a top-down approach to developing test items and preregistered hypotheses, and (3) ethical norms for data collection, data use, and guidelines for responsible inference, including restraints in decisions based on process data.

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Call for Papers: “Process Data in Computer-Based Assessment: Opening the Black Box”

Cited by 2 publications

References 2 publications

Process and Product in Computer-Based Assessments

Process and Product in Computer-Based Assessments

Process Data in Computer-Based Assessment

Contact Info

Product

Resources

About