Methods for questionnaire design: a taxonomy linking procedures to test goals

Abstract

Background In the clinical field, the use of questionnaires is ubiquitous, and many different methods for constructing them are available. The reason for using a specific method is usually lacking, and a generally accepted classification of methods is not yet available. To guide test developers and users, this article presents a taxonomy for methods of questionnaire design which links the methods to the goal of a test. Methods The taxonomy assumes that construction methods are directed towards psychometric aspects. Four stages of test construction are distinguished to describe methods: concept analysis, item production, scale construction, and evaluation; the scale construction stage is used for identifying methods. It distinguishes six different methods: the rational method utilizes expert judgments to ensure face validity. The prototypical method uses prototypicality judgments to ensure process validity. In the internal method, item sets are selected that optimize homogeneity. The external method optimizes criterion validity by selecting items that best predict an external criterion. Under the construct method theoretical considerations are used to optimize construct validity. The facet method is aimed at optimizing content validity through a complete representation of the concept domain. Conclusion The taxonomy is comprehensive, constitutes a useful tool for describing procedures used in questionnaire design, and allows for setting up a test construction plan in which the priorities among psychometric aspects are made explicit.

Method of preparing a document for survey instrument validation by experts

“…A questionnaire is explained as “an instrument for the measurement of one or more constructs by means of aggregated item scores, called scales” [21] . A questionnaire can be identified on a continuum of unstructured to structure [14] .…”

“…A questionnaire can be identified on a continuum of unstructured to structure [14] . A structured questionnaire will “have a similar format, are usually statements, questions, or stimulus words with structured response categories, and require a judgment or description by a respondent or rater” [21] . Research in social science with a positivist paradigm began in the 19th century.…”

“…In a similar way Oosterveld et al. [21] developed taxonomy of questionnaire design directed towards psychometric aspects. The taxonomy introduces the following questionnaire design methods: (1) coherent, (2) prototypical, (3) internal, (4) external, (5) construct and (6) facet design technique.…”

Evaluation of a Digital Library: An Experimental Study

“…However, data from closed-ended questions are easier to analyse than information from open-ended ones. Nonetheless, open-ended questions allow the respondent to express themselves fully by providing additional explanations, which enriches the quality of data (Oosterveld, Vorst, & Smits, 2019).…”

Training in Qualitative Research Methods for Professionals working with Persons with Disabilities

“…The team, which comprised researchers from the University of Northampton based in both UK and India, prepared a pre-and post-test questionnaire with 30 close-ended questions addressed through a multiple-choice format (Bennett, 2003;Oosterveld, Vorst & Smits, 2019) applied, and about the actions that might be taken to improve such programmes in future.…”