On the cultural validity of science assessments

Abstract

We propose the concept of cultural validity as a form of test validity in science assessment. The conceptual relevance of cultural validity is supported by evidence that culture and society shape an individual's mind and thinking. To attain cultural validity, the process of assessment development must consider how the sociocultural context in which students live influences the ways in which they make sense of science items and the ways in which they solve them. These sociocultural influences include the values, beliefs, experiences, communication patterns, teaching and learning styles, and epistemologies inherent in the students' cultural backgrounds, as well as the socioeconomic conditions prevailing in their cultural groups. We contend that current approaches to handling student diversity in assessment (e.g., adapting or translating tests, providing assessment accommodations, estimating test cultural bias) are limited and lack sociocultural perspective. We find that attaining cultural validity may conflict with current basic principles and assumptions in testing, such as item independence and standardization. We discuss the ways in which adopting cultural validity as a criterion for test validity makes it necessary to shift assessment paradigms and adopt new procedures for assessment development. © 2001 John Wiley & Sons, Inc. J Res Sci Teach 38: 553–573, 2001

Student Accounts of the Ontario Secondary School Literacy Test: A Case for Validation

“…There are two broad categories of these kinds of studies -studies that focus on particular skills (e.g., writing, reading comprehension), and studies that explore cultural differences in problem-solving (Duran, 1989), the effects of cultural schemata (Parry, 1987;Pritchard, 1990), acculturational factors (Ortiz, 2005), cultural validity (Solano-Flores & Nelson-Barber, 2001), background knowledge (Clapham, 1998;Ginther & Stevens, 1998;Jennings, Fox, Graves, & Shohamy, 1999), and 'situatedness' (Atkinson, 2005, pp. 50-51).…”

Science inquiry and student diversity: Enhanced abilities and continuing difficulties after an instructional intervention

“…For example, although conducting scientific inquiry is a challenge for most students, it presents additional challenges for students from societies that may not encourage them to engage in some aspects of inquiry practices, such as asking empirical questions about natural phenomena, designing and implementing systematic investigations, and finding answers on their own (e.g., Jegede & Okebukola, 1991;McKinley, Waiti, & Bell, 1992;Nelson-Barber & Estrin, 1995;Solano-Flores & Nelson-Barber, 2001). In many societies, cultural norms prioritize respect for teachers and other adults as authoritative sources of knowledge.…”

Language ideologies and literacy achievement: six multilingual countries and two international assessments

“…Literacy educators and scholars would do well to consider the sociocultural and historical contexts of less-dominant language groups in addition to providing linguistic supports for minority students (Solano-Flores, 2008;Solano-Flores & Nelson-Barber, 2001). Educational resources and programmes that include open, explicit conversations about sociohistorical events and policies associated with the LL may help to expose stereotypes that favour dominant language groups within a school community.…”