Student ratings: The validity of use.

Abstract

In this article, the author discusses the other articles in this Current Issues section and concludes that all of the authors agree that student ratings are valid but that contextual variables such as grading leniency can affect the level of ratings. The authors disagree about the wisdom of applying statistical corrections for such contextual influences. This article argues that the problem lies neither in the ratings nor in the correction but rather in the lack of sophistication of personnel committees who use the ratings. Thus, more attention should be directed toward methods of ensuring more valid use.I thank Matt Kaplan, Diana Kardia, and James Kulik for their helpful comments on earlier drafts of this article.

Validação de Instrumento de Avaliação de Disciplinas de Escola Médica no Brasil

“…No entanto, vários autores, entre eles Cashin 11 e McKeachie 30 , afirmam que a idade, o sexo e a posição no curso não modificam os resultados nas avaliações. Já o anonimato é necessário para um resultado adequado na medida em que aumenta a segurança do respondente e a veracidade das respostas [31][32][33] .…”

Psychometric properties of postsecondary students' course evaluations

“…Moreover, other experts have asserted that course evaluations are the "most valid source of data on teaching effectiveness" (McKeachie, 1997(McKeachie, , p. 1219Scriven, 1988).…”

“…Both McKeachie (1997) and Scriven (1988) provide no supporting evidence or data when offering their conclusions. Both Cashin (1995) and make extensive use of the meta-analysis in their sections on validity.…”

“…For example, Cashin (1995) stated that course evaluations "tend to be statistically reliable, valid, and relatively free from bias or the need for control; probably more so than any other data used for evaluation" (p. 6). Additionally, McKeachie (1997) concluded that course evaluations "are the single most valid source of data on teaching effectiveness" (p. 1219).…”

“…Most people agree that the use of student ratings has been increasing over the past 25 years (Lin, McKeachie, & Tucker, 1984;Penny, 2003) and that most colleges and universities across the United States use the results of course evaluations in judging the effectiveness of their teachers (Benassi & Seidel, 2006;Cashin, 1989;McKeachie & Svinicki, 2005). Most experts in this area have also concluded that course evaluations are, (a) the most psychometrically sound instrument currently available for measuring teacher effectiveness (McKeachie, 1997;Scriven, 1988), (b) reliable measures of teacher effectiveness , and (c) a reasonable means for making valid inferences regarding teacher effectiveness (e.g., Feldman, 1989). …”