Response-Process Models: Toward an Integration of Cognitive-Processing Models, Psychometric Models, Latent-Trait Theory, and Self-Schemas

Kuncel, Ruth Boutin; Kuncel, Nathan R.

doi:10.4324/9781315806815-12

Cited by 3 publications

(2 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…By focusing on items that are related to prototypical acts, the respondent’s cognitive representation of the construct and the item content are assumed to coincide by which the quality of the questionnaire is ensured. As the prototypical method focuses on the cognitive process of stimulus representation, the term ‘process validity’ [ 50 ] is used to denote the aspect guiding this method [ 51 ]. Construction according to the prototypical method is guided by the (informal) knowledge and experience of the respondents.…”

Section: The Six Questionnaire Design Methodsmentioning

confidence: 99%

Methods for questionnaire design: a taxonomy linking procedures to test goals

2019

View full text Add to dashboard Cite

Background In the clinical field, the use of questionnaires is ubiquitous, and many different methods for constructing them are available. The reason for using a specific method is usually lacking, and a generally accepted classification of methods is not yet available. To guide test developers and users, this article presents a taxonomy for methods of questionnaire design which links the methods to the goal of a test. Methods The taxonomy assumes that construction methods are directed towards psychometric aspects. Four stages of test construction are distinguished to describe methods: concept analysis, item production, scale construction, and evaluation; the scale construction stage is used for identifying methods. It distinguishes six different methods: the rational method utilizes expert judgments to ensure face validity. The prototypical method uses prototypicality judgments to ensure process validity. In the internal method, item sets are selected that optimize homogeneity. The external method optimizes criterion validity by selecting items that best predict an external criterion. Under the construct method theoretical considerations are used to optimize construct validity. The facet method is aimed at optimizing content validity through a complete representation of the concept domain. Conclusion The taxonomy is comprehensive, constitutes a useful tool for describing procedures used in questionnaire design, and allows for setting up a test construction plan in which the priorities among psychometric aspects are made explicit.

show abstract

Section: The Six Questionnaire Design Methodsmentioning

confidence: 99%

Methods for questionnaire design: a taxonomy linking procedures to test goals

2019

View full text Add to dashboard Cite

show abstract

“…Regardless of whether the choice criteria are being retrieved from memory, identified in the environment, or a combination of both (Bröder & Schiffer, 2003;Gigerenzer & Todd, 1999), the question of how to confine the set of potential criteria pervades all described domains (Glöckner & Betsch, 2011;Marewski & Schooler, 2011;Scheibehenne, Rieskamp, & Wagenmakers, 2013;Verheyen & Storms, 2013). The question is perhaps most pressing for theories that adopt constructs such as goals and would like to determine the particular goals that drive individuals (Austin & Vancouver, 1996;Ford & Nichols, 1987;Kuncel & Kuncel, 1995). By definition goals are internally represented, private constructs that one need not necessarily be able to verbalize or even consciously experience.…”

Section: Terminologymentioning

confidence: 99%

Inferring choice criteria with mixture IRT models: A demonstration using ad hoc and goal-derived categories

2015

View full text Add to dashboard Cite

Whether it pertains to the foods to buy when one is on a diet, the items to take along to the beach on one’s day off or (perish the thought) the belongings to save from one’s burning house, choice is ubiquitous. We aim to determine from choices the criteria individuals use when they select objects from among a set of candidates. In order to do so we employ a mixture IRT (item-response theory) model that capitalizes on the insights that objects are chosen more often the better they meet the choice criteria and that the use of different criteria is reflected in inter-individual selection differences. The model is found to account for the inter-individual selection differences for 10 ad hoc and goal-derived categories. Its parameters can be related to selection criteria that are frequently thought of in the context of these categories. These results suggest that mixture IRT models allow one to infer from mere choice behavior the criteria individuals used to select/discard objects. Potential applications of mixture IRT models in other judgment and decision making contexts are discussed.

show abstract

Subjektive Angemessenheit von Items und die Validität von Persönlichkeitsfragebögen

Horlacher

Rodewald

2002

Zeitschrift für Differentielle und Diagnostische Psychologie

View full text Add to dashboard Cite

Zusammenfassung: Die vorliegende Studie prüft den Einfluss der subjektiv wahrgenommenen Angemessenheit von Items auf die Validität von Persönlichkeitsfragebögen. Hierzu lieferten125 Probanden beiderlei Geschlechts außer Selbsteinschätzungen auf 6 Skalen gebräuchlicher Persönlichkeitsinventare auch eine Angemessenheitsbeurteilung zu jedem Item in der Form ab, dass sie angeben sollten, inwieweit die Beantwortung des Item in der Lage sei, etwas über sie als Person zum Ausdruck zu bringen. Die Validierung erfolgte anhand globaler Fremdeinschätzungen. Dabei führte die ausschließliche Berücksichtigung der individuell angemessenen Items (“idiographisches” Vorgehen) zu keinen Validitätsveränderungen gegenüber den Originalskalen, wohingegen es anhand der durchschnittlichen Angemessenheit als Itemselektionskriterium (“nomothetisches” Vorgehen) möglich war, Skalen ohne Validitätsverlust auf ein Viertel ihrer Originallänge zu kürzen. Implikationen für die Validitätssteigerung von Persönlichkeitstests werden diskutiert.

show abstract

Response-Process Models: Toward an Integration of Cognitive-Processing Models, Psychometric Models, Latent-Trait Theory, and Self-Schemas

Cited by 3 publications

References 1 publication

Methods for questionnaire design: a taxonomy linking procedures to test goals

Methods for questionnaire design: a taxonomy linking procedures to test goals

Inferring choice criteria with mixture IRT models: A demonstration using ad hoc and goal-derived categories

Subjektive Angemessenheit von Items und die Validität von Persönlichkeitsfragebögen

Contact Info

Product

Resources

About