Applying the Rasch Rating Scale Method to Questionnaire Data

DiStefano, Christine; Jiang, Ning

doi:10.1007/978-981-15-1800-3_3

Cited by 10 publications

(10 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The result of response category analysis has indicated redefining the category 2-3, and an evaluation of WSSC items with DIF notes is suggested in the future update of the scale. Specifically, modifying the scale type from a 5-point Likert scale into 4 points scale can eliminate the potential misfit data and enable the scale to function at its maximum capability (DiStefano & Jiang, 2020). As so, the reliability of data can be increased and accordingly, precise measurement can be obtained (Linacre, 2002a).…”

Section: Discussionmentioning

confidence: 99%

“…Surveys with a rating scale have been regarded as a common method for collecting data about specific types of educational, social and behavioural constructs (DiStefano & Jiang, 2020;Van Zile-Tamsen, 2017). For example, in the context of higher education, Van Zile-Tamsen (2017) has argued that many universities have developed local scales to explore their staffs' and students' satisfaction, teaching and learning effectiveness, educational climates and some others.…”

Section: Introductionmentioning

confidence: 99%

“…Despite the satisfying result from the validation analysis using the conventional method, two critical issues emerge from the calculation. The first issue concerns the application of an ordinal scale to represent the construct (DiStefano & Jiang, 2020). DiStefano and Jiang (2020) argue that, when validating a questionnaire, many researchers tended to sum item responses to obtain a total score and reflect the construct of interest.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

A Rasch-based validation of EFL teachers’ received online social support scale

et al. 2021

View full text Add to dashboard Cite

The primary aim of the study was to examine the validity of the Indonesian version of the 23-item WhatsApp Social Support Scale (WSSC) adapted from an earlier study by Chung, Yang and Chen . A total of 214 in-service English as a foreign language (EFL) teachers across school levels in Indonesia participated in the study. Rasch statistical analyses were performed to validate the adapted questionnaire, including unidimensionality assessment, reliability analysis, Rasch model fit analysis, and differential functioning analysis. The findings of the study showed that WSSC primarily measured a single latent variable, that was, the online social support received by the English as a foreign language (EFL) teachers in the WhatsApp group. The Rasch analysis of the WSSC resulted that the scale fitted the Rasch model with high reliability levels for both person and item levels. Although redefining category 2-3 is required, an evaluation of WSSC items with DIF notes is suggested to improve the scale's reliability.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A Rasch-based validation of EFL teachers’ received online social support scale

et al. 2021

View full text Add to dashboard Cite

show abstract

“…The conventional approach of analyzing rating scale data such as the Likert-type scale relies on the belief that all items in a questionnaire have the same level of difficulty, and the increased unit across each step of a category have equal value (Bond & Fox, 2015;Boone, 2020;DiStefano & Jiang, 2020). For example, from a set of five steps Likert scale, "strongly disagree" (1), "disagree" (2), "neutral" (3), "agree" (4), and "strongly agree" (5), the fifth (5) category has five times the value of the first category (1).…”

Section: Rasch Rating Scale Model (Rsm)mentioning

confidence: 99%

“…The typical approach and the most popular type of instrument used in survey studies that have been around for a long is the rating scale. Therefore, there has been a significant number of research devoted to the rating scale functioning, especially the number of steps categories used in a rating scale (DiStefano & Jiang, 2020;Preston & Colman, 2000). The research into the rating scale steps categories has been becoming a debate for decades, especially on a Likert-type scale.…”

Section: Introductionmentioning

confidence: 99%

Applying the Rasch Rating Scale Model (RSM) to investigate the rating scales function in survey research instrument

Chong

Mokshein

Mustapha

2022

View full text Add to dashboard Cite

The functionality and quality structure of a rating scale are vital in a survey instrument. This article discusses the underlying assumption of a rating scale and addresses the application of the Rasch Rating Scale Model (RSM) to diagnose the rating scale structure in a survey instrument. The instrument used to demonstrate the process of diagnosis a rating scale functioning in this study was the Vocational Teachers’ Assessment Literacy (VoTAL) instrument. The VoTAL instrument utilized the five-point Likert-type response format and consisted of 88 items representing three assessment literacy constructs. The data were obtained from 224 vocational teachers at five vocational colleges, which were randomly selected from the state of Selangor and the federal territory of Kuala Lumpur in Malaysia. The rating scale diagnosis results showed that the initial five steps of rating scale categories were not properly functioning as intended. It was found that the Andrich threshold of category three was disordered as it was not monotonically advance with categories. Additionally, the result also found that the width of the threshold between category three and category four was too narrow (0.66 logits). The results indicate that the rating scale used in the VoTAL instrument was disordered. Thus, it was suggested that the initial five rating step categories were collapsed down into four categories. In conclusion, this study highlights the importance of assessing the rating scale’s functionality in a survey instrument to reduce measurement error and collect valid and reliable data.

show abstract

Investigating the quality of life for children with autism spectrum disorder scale using Rasch methodology

Chezan,

Liu,

Gao

et al. 2023

Autism Research

View full text Add to dashboard Cite

Our purpose in this study was to provide additional psychometric evidence of the Quality of Life for Children with Autism Spectrum Disorder (QOLASD‐C) scale. We used Rasch modeling to investigate the QOLASD‐C functioning, the characteristics of the items comprising the scale, and the item functioning across subgroups of children with ASD based on gender and race/ethnicity. Results showed that QOLASD‐C was unidimensional, met the local independence assumption, and measured quality of life (QOL). The items showed excellent fit to the model and good discriminating ability between low and high QOL. Most items showed a moderate difficulty level. No differential item functioning was observed based on children's gender and race/ethnicity. Implications for research and practice are discussed.

show abstract

Applying the Rasch Rating Scale Method to Questionnaire Data

Cited by 10 publications

References 8 publications

A Rasch-based validation of EFL teachers’ received online social support scale

A Rasch-based validation of EFL teachers’ received online social support scale

Applying the Rasch Rating Scale Model (RSM) to investigate the rating scales function in survey research instrument

Investigating the quality of life for children with autism spectrum disorder scale using Rasch methodology

Contact Info

Product

Resources

About