Using Cognitive Interviewing for the Semantic Enhancement of Multilingual Versions of Personality Questionnaires

Abstract

We discuss the use of cognitive interviewing with bilinguals as an integral part of crosscultural adaptation of personality questionnaires. The aim is to maximize semantic equivalence to increase the likelihood of items maintaining the intended structure and meaning in the target language. We refer to this part of adaptation as semantic enhancement, and integrate cognitive interviewing within it as a tool for scrutinizing translations, the connotative meaning, and the psychological impact of items across languages. During the adaptation of a work-based personality questionnaire from English to Arabic, Chinese (Mandarin), and Spanish, we cognitively interviewed 12 bilingual participants about 136 items in different languages (17% of all items), of which 67 were changed. A content analysis categorizing the reasons for amending items elicited eleven errors that affect two identified forms of semantic equivalence. We provide the resultant coding scheme as a framework for designing cognitive interviewing protocols and propose a procedure for implementing them. We discuss implications for theory and practice.

Initial Validation and Refinement of the Hierarchical Inventory of Personality for Children in the Australian Context

“…The sample, with size guided by previous literature (Daouk‐Öyry & McDowal, ), consisted of 10 volunteer (nine females and one male), purposefully recruited, potential end‐users of the HiPIC. One respondent was a child and adolescent psychologist, nine were parents of who five were also teachers, and four were educated to a high‐school level.…”

“…As recommended by Cull et al (2002), problematic items were reviewed by a panel with relevant knowledge, for alternate item creation. This panel included nine researchers with expertise in the psychology of Personality and Individual Differences, specifically having knowledge of development, personality, and psychometrics.…”

“…There is a growing body of literature incorporating qualitative research to address this issue (Daouk‐Öyry & McDowal, ; Lopez‐Fernandez & Molina‐Azorin, ). One approach, the Cognitive Interview (CI) is increasingly acknowledged as an appropriate method for exploring respondent interpretation of items in order to ascertain equivalence.…”

“…Central to the CI are the probes (open‐ended questions) designed to assess item comprehension, clarity, and relevance to the intended construct (Willis & Miller, ). This process leads to semantic enhancement of a translated measure (Daouk‐Öyry & McDowal, ). Study sample sizes incorporating CIs have ranged from one person for an item up to10 or more end‐users of a scale (Daouk‐Öyry & McDowal, ; Sousa & Rojjanasrirat, ), highlighting the qualitative nature of CIs.…”

“…This process leads to semantic enhancement of a translated measure (Daouk‐Öyry & McDowal, ). Study sample sizes incorporating CIs have ranged from one person for an item up to10 or more end‐users of a scale (Daouk‐Öyry & McDowal, ; Sousa & Rojjanasrirat, ), highlighting the qualitative nature of CIs. However, DeVellis (), while recommending the use of the CI, cautions against unreserved acceptance of respondents’ viewpoints, promoting a more thoughtful approach integrating the qualitative narrative with rigorous quantitative analysis.…”