Development and validation of the aristotelian virtue of conscientiousness scale using Rasch methodology

Abstract

In the dominant Aristotelian view, virtues are traits that contribute to human flourishing, happiness and well-being. Although some scales in psychology are partially based on Aristotelian virtue theory, few of them operationalise all the aspects of virtues that Aristotle took to be essential. The aim of this project was to develop and validate the Aristotelian Virtue of Conscientiousness Scale (AVCS). The initial 60 scale items were developed based on Aristotelian virtue theory. This item pool was piloted and administered to a sample (n = 301) together with measures of distress, satisfaction with life and Big Five Conscientiousness. The twenty-eight most reliable items were selected based on psychometric criteria and subjected to Rasch analysis. The best model fit was achieved when items were combined into six testlets to address local dependency. The AVCS scale displayed excellent reliability (Person Separation Index = 0.88) and was invariant across gender and age. The ordinal-to-interval conversion tables were generated for the AVCS ordinal scores, which strongly correlated with life satisfaction. The AVCS is a reliable and valid measure with good psychometric properties that can be used in future happiness research. The ordinal AVCS scores can be transformed into interval level data using conversion tables published here, which improves accuracy of measurement.

Measuring Virtue: An Aristotelian Perspective on Advancing Positive Psychology

“…These principles include unidimensionality (the idea that assessments should measure only one construct), measurement invariance (the measure should work equally well for everyone), and equal distance between measurement units (e.g., the scale should measure at least at an interval level of measurement). Rasch analysis is a generally underused technique in positive psychology, with a few exceptions (e.g., McManus et al, 2024;Medvedev., 2017); however, it is a powerful tool for eliminating error variance, as it can convert ordinal data into interval data, resulting in more reliable measurement instruments (Medvedev & Krägeloh, 2022). It can also assess differential items functioning (DIF), which can inform researchers of whether the scale works differently for different groups, such as gender or age groups.…”

“…Lastly, the stringent test of unidimensionality in Rasch analysis can provide stronger evidence than other types of analyses about the unidimensionality of virtue scales and whether the components of virtue really relate to each other in a way that constitutes a unified construct. For a recent example of how Rasch analysis can be used to validate a virtue assessment see McManus et al (2024).…”