Improving the Face Validity of Self-Report Scales through Cognitive Interviews Based on Tourangeau Question and Answer Framework: A Practical Work on the Nursing Talent Identification Scale

Zamanzadeh, Vahid; Ghahramanian, Akram; Valizadeh, Leila; Bagheriyeh, Farzaneh

doi:10.21203/rs.3.rs-587444/v2

Cited by 3 publications

(3 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on the identified problems, specifically through cognitive interviews, we provided several remedies for the problematic items. A previous study shows that small changes in the appearance of words can lead to greater clarity in understanding items (Zamanzadeh et al, 2022). We made several revisions to the current study.…”

Section: Discussionmentioning

confidence: 99%

A content validity and cognitive interview to develop the HARMONI items: Instrument measuring student well-being in West Java, Indonesia

2023

View full text Add to dashboard Cite

Practitioners in education need instrument to measure the skills of well-being. These skills should be taught in school alongside achievement skills to improve the learning process and student outcome. However, most existing well-being instruments are designed for the western population, even though geographic regions and cultural diversities are important to consider to develop well-being instruments. Thus, we use the PROSPER (Positivity, Relationships, Outcomes, Strengths, Purpose, Engagement, Resilience) model as a student well-being framework to develop an instrument named the HARMONI (Hasil yang berproses, Andal berdaya lenting, Relasi yang positif, Makna dalam tujuan, Orientasi sikap positif, Nilai suatu kekuatan, Inisiatif yang melibatkan), which is specified for West Java high school student population. The HARMONI instrument has seven dimensions: Positivity, Relationships, Outcomes, Strengths, Purpose, Engagement and Resilience. The study aims to develop HARMONI items for high school students in West Java. We conducted three activities: item development, expert reviews, and cognitive interviews. In the review process, nine experts in total who are experts in educational psychology, well-being, and psychometry were involved. Based on the reviews, we reduced the items from 556 to 125 items. The calculation of the Content Validity Index of the reviews showed that the items have good content validity (mean I-CVI ranging from 0.96 to 1). Next, cognitive interviews were conducted to analyze participants’ cognitive processes in responding to the items. The participants of the cognitive interviews were 25 senior high school students in West Java, who were selected based on a purposive sampling technique. The result showed that the participants well understood most of the items. However, several items needed to be revised due to problems related to comprehension, retrieval and judgment. The items were improved by changing incomprehensible, vague and ambiguous words, revising the sentence structure and adding more specific cues. A total of 124 items were ready to be used for a psychometric study.

show abstract

Section: Discussionmentioning

confidence: 99%

A content validity and cognitive interview to develop the HARMONI items: Instrument measuring student well-being in West Java, Indonesia

2023

View full text Add to dashboard Cite

show abstract

“…Based on the COSMIN checklist, the IP‐SSW‐NCP can be said to be valid using face and convergent validity and highly reliable as seen with values obtained for internal consistency and test–retest stability (Mokkink et al, 2016 ; Prinsen et al, 2018 ). Besides these, the cognitive interviewing of the nursing students is known to enhance the face validity of self‐report instruments (Zamanzadeh et al, 2022 ). By carrying out pilot‐testing of the instrument in target language population, a window was provided into how the revised version would work in the real‐world target setting and population (Krach et al, 2017 ).…”

Section: Discussionmentioning

confidence: 99%

“…So convenience sampling was used to select the first 10 junior and senior undergraduate nursing students. They completed the survey and participated in cognitive interviews using a cognitive interview guide by a skilled interviewer adapted from previous studies (Table 1 ) (Cunningham et al, 2019 ; Zamanzadeh et al, 2022 ). These participants were supposed to check for clarity of content and structure, also asked to comment on the ambiguity and difficulty of the items and the answers to each item.…”

Section: Methodsmentioning

confidence: 99%

Translation, cross‐cultural adaptation and evaluation of the Iranian Persian version of student survey on writing nursing care plan

et al. 2023

Self Cite

View full text Add to dashboard Cite

Aim The objective of this study was to validate the Iranian translation and cross‐cultural adaptation of the Student Survey on Writing Nursing Care Plan (SSW‐NCP). Background To provide supporting evidence about the nursing students' skill in planning and documenting nursing care plans based on nursing process, Salvador et al. developed the SSW‐NCP to measure the extent to which nursing students are qualified in writing nursing care plans. However, an Iranian version of the SSW‐NCP is presently not available. Method The cross‐cultural adaptation and linguistic translation of the SSW‐NCP adhered to World Health Organization (WHO) guidelines. The reliability and validity process followed the COSMIN checklist. Results The survey was well translated to Persian language and culturally adapted through confirming the relevancy, appropriateness and logical representation of all aspects on nursing process by bilingual experts and pre‐tested on Persian‐speaking nursing students. The Cronbach's Alpha coefficient (α) and test–retest stability assessing affirmed the reliability, and convergent validity of the adapted survey was confirmed through comparison to Influencing Factors of Nursing Students' Clinical Judgment (IFNSCJ). The adaptation process of the SSW‐NCP resulted in a conceptually equivalent translated version, which is comparable to the original version and is acceptably valid and reliable. Implications for Nursing Management Knowing the proficiency of nursing students as future nurses in writing nursing care plans can provide accurate professional information for better educational and practical level programming and management that can enhance nursing practice. Patient or Public Contribution The target group of survey was nursing students who contributed and participated in the current study.

show abstract

Development of the Canadian Eating Practices Screener to assess eating practices based on 2019 Canada's Food Guide recommendations

Wallace,

Martin,

Bédard

et al. 2023

Appl. Physiol. Nutr. Metab.

View full text Add to dashboard Cite

In 2019, Health Canada released a new iteration of Canada's Food Guide (2019-CFG), which, for the first time, highlighted recommendations regarding eating practices, i.e., guidance on where, when, why, and how to eat. The objective of this study was to develop a brief self-administered screener to assess eating practices recommended in the 2019-CFG among adults aged 18–65 years. Development of the screener items was informed by a review of existing tools and mapping of items onto 2019-CFG recommendations. Face and content validity were assessed with experts in public health nutrition and/or dietary assessment ( n = 16) and individuals from Government of Canada ( n = 14). Cognitive interviews were conducted with English-speaking ( n = 16) and French-speaking ( n = 16) adults living in Canada to assess face validity and understanding of the screener items. While some modifications were identified to improve relevance or clarity, overall, the screener items were found to be relevant, well-constructed, and clearly worded. This comprehensive process resulted in the Canadian Eating Practices Screener/Questionnaire court canadien sur les pratiques alimentaires, which includes 21 items that assess eating practices recommended in the 2019-CFG. This screener can facilitate monitoring and surveillance efforts of the 2019-CFG eating practices as well as research exploring how these practices are associated with various health outcomes.

show abstract

Improving the Face Validity of Self-Report Scales through Cognitive Interviews Based on Tourangeau Question and Answer Framework: A Practical Work on the Nursing Talent Identification Scale

Cited by 3 publications

References 9 publications

A content validity and cognitive interview to develop the HARMONI items: Instrument measuring student well-being in West Java, Indonesia

A content validity and cognitive interview to develop the HARMONI items: Instrument measuring student well-being in West Java, Indonesia

Translation, cross‐cultural adaptation and evaluation of the Iranian Persian version of student survey on writing nursing care plan

Development of the Canadian Eating Practices Screener to assess eating practices based on 2019 Canada's Food Guide recommendations

Contact Info

Product

Resources

About