Using Only Numeric Labels Instead of Verbal Labels: Stripping Rating Scales to Their Bare Minimum in Web Surveys

Gummer, Tobias; Kunz, Tanja

doi:10.1177/0894439320951765

Cited by 7 publications

(3 citation statements)

References 48 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The number of categories and use of verbal labels are both well researched. Research based on randomized experiments has consistently shown that a moderate number of response categories (five-seven), which are all verbalized, is associated with higher reliability and validity than other realizations (e.g., Gummer and Kunz 2021;Maitland 2009aMaitland , 2009b. Researchers have also addressed the effect of rating scales on results in the context of LVM (e.g., Menold and Tausch 2016), demonstrating that seven fully verbalized categories are consistently associated with tenable or high data quality.…”

Section: Introductionmentioning

confidence: 99%

Verbalization of Rating Scales Taking Account of Their Polarity

Menold

2023

Field Methods

View full text Add to dashboard Cite

While numerical bipolar rating scales may evoke positivity bias, little is known about the corresponding bias in verbal bipolar rating scales. The choice of verbalization of the middle category may lead to response bias, particularly if it is not in line with the scale polarity. Unipolar and bipolar seven-category rating scales in which the verbalizations of the middle categories matched or did not match the implemented polarity were investigated in randomized experiments using a non-probabilistic online access panel in Germany. Bipolar rating scales exhibited higher positivity bias and acquiescence than unipolar rating scales. Reliability, validity, and equidistance tended to be violated if the verbalizations of the middle category did not match scale polarity. The results provide a rationale for rating scale verbalization.

show abstract

Section: Introductionmentioning

confidence: 99%

Verbalization of Rating Scales Taking Account of Their Polarity

Menold

2023

Field Methods

View full text Add to dashboard Cite

show abstract

“…However, recent developments in graphical user interfaces have raised the possibility of greater use of VAS in web-based survey applications [30][31][32][33]. Furthermore, a mobile device or multi-device on a web-based survey has been addressed [34,35].…”

Section: Introduction 1backgroundmentioning

confidence: 99%

Usability of Visual Analogue Scales in Assessing Human Perception of Sound with University Students Using a Web-Based Tablet Interface

Yang

Jeon

2021

Sustainability

View full text Add to dashboard Cite

Response scales in auditory perception assessment are critical for capturing the true responses of listeners. Despite its impact on data, response scales have received the least attention in auditory perception assessment. In this study, the usability of visual analogue scales for auditory perception assessment were investigated. Five response scales (a unipolar visual analogue scale–negated to regular, a unipolar visual analogue scale—regular to negated, a bipolar visual analogue scale–positive to negative, a bipolar visual analogue scale—negative to positive, and a unipolar 11-point scale (ISO/TS 15666:2021)) for auditory perception assessment are presented. Music and traffic noise were presented to 60 university students at two different levels, i.e., 45 and 65 dBA, respectively. A web-based experimental design was implemented, and tablet pads were provided to the respondents to record their responses. The unipolar 11-point scale required the longest response time, followed by the two unipolar visual analogue scales and two bipolar visual analogue scales with statistical significance. All response scales used in this study achieved statistical reliability and sensitivity for the auditory perception assessment. Among the five response scales, the bipolar visual analogue scale (negative to positive) ranked first in reliability over repeated measures, exhibited sensitivity in differentiating sound sources, and was preferred by the respondents under the conditions of the present study. None of the respondents preferred the unipolar 11-point scale. The visual analogue scale was favoured over the traditional unipolar 11-point scale by young educated adults in a mobile-based testing environment. Moreover, the bipolar visual analogue scale demonstrated the highest reliability and sensitivity, and it was preferred the most by the respondents. The semantic labelling direction from negated to regular, or from negative to positive, is preferred over its opposite counterpart. Further research is necessary to investigate the use of response scales for the general public including children and the elderly, as well as that of semantic adjectives and their counterparts for auditory perception assessment.

show abstract

“… Weigold et al (2021) examined four item formats—horizontal radio button, text box, drop-down menu, and vertical radio button—and generally found both quantitative and qualitative equivalence across formats. Several studies have examined the effects of altering response option labels (e.g., only using verbal labels for the end points of the scale or removing verbal labels altogether; Gummer & Kunz, 2021 ; Spratto et al, 2021 ; Steinberg & Rogers, in press ). The findings of this research generally support using verbal labels for each level of the response option continuum.…”

mentioning

confidence: 99%

Effects of Response Option Order on Likert-Type Psychometric Properties and Reactions

Robie

Meade

Risavy

et al. 2022

Educational and Psychological Measurement

View full text Add to dashboard Cite

The effects of different response option orders on survey responses have been studied extensively. The typical research design involves examining the differences in response characteristics between conditions with the same item stems and response option orders that differ in valence—either incrementally arranged (e.g., strongly disagree to strongly agree) or decrementally arranged (e.g., strongly agree to strongly disagree). The present study added two additional experimental conditions—randomly incremental or decremental and completely randomized. All items were presented in an item-by-item format. We also extended previous studies by including an examination of response option order effects on: careless responding, correlations between focal predictors and criteria, and participant reactions, all the while controlling for false discovery rate and focusing on the size of effects. In a sample of 1,198 university students, we found little to no response option order effects on a recognized personality assessment vis-à-vis measurement equivalence, scale mean differences, item-level distributions, or participant reactions. However, the completely randomized response option order condition differed on several careless responding indices suggesting avenues for future research.

show abstract

Using Only Numeric Labels Instead of Verbal Labels: Stripping Rating Scales to Their Bare Minimum in Web Surveys

Cited by 7 publications

References 48 publications

Verbalization of Rating Scales Taking Account of Their Polarity

Verbalization of Rating Scales Taking Account of Their Polarity

Usability of Visual Analogue Scales in Assessing Human Perception of Sound with University Students Using a Web-Based Tablet Interface

Effects of Response Option Order on Likert-Type Psychometric Properties and Reactions

Contact Info

Product

Resources

About