Bias Evaluation of Professors' Reviews

Antonie, Luiza; Foxcroft, Jérémy; Gréwal, Gary; Narayanan, Nirmal; Plesca, Miana; Ramirez, Rosina

doi:10.1109/icmla.2018.00096

Cited by 1 publication

(3 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Students are also more likely to use "genius" or "brilliant" in their comments to describe men than women professors [51]. A topics analysis on RMP comments for institutions in Ontario, Canada, shows that men are more likely to receive comments concerning positive teaching and expectation [52].…”

Section: Gender Disparities In Academia and Teaching Evaluationmentioning

confidence: 99%

“…Because SET is a nonzero-sum behavior that does not demand competition over limited resources, evaluative standards are more likely to shift between groups [55]. Although RMP tries to formulate a common-rule scale for its rating [56], students may still have subjective standards when writing reviews and contribute to gender disparities [52]. We thus make the following hypothesis:…”

Section: H2: Rmp Review Comments On Women and Men Professors Have Dif...mentioning

confidence: 99%

“…We then fitted a multiple linear regression model to investigate the association between gender and the overall ratings of professors. The regression model controlled for difficulty level rating [60] and fixed effects [52]. The model specification is…”

Section: Empirical Analysismentioning

confidence: 99%

See 2 more Smart Citations

Contextualizing gender disparities in online teaching evaluations for professors

Zheng

Vastrad²,

He³

et al. 2023

PLoS ONE

View full text Add to dashboard Cite

Student evaluation of teaching (SET) is widely used to assess teaching effectiveness in higher education and can significantly influence professors’ career outcomes. Although earlier evidence suggests SET may suffer from biases due to the gender of professors, there is a lack of large-scale examination to understand how and why gender disparities occur in SET. This study aims to address this gap in SET by analyzing approximately 9 million SET reviews from RateMyProfessors.com under the theoretical frameworks of role congruity theory and shifting standards theory. Our multiple linear regression analysis of the SET numerical ratings confirms that women professors are generally rated lower than men in many fields. Using the Dunning log-likelihood test, we show that words used in student comments vary by the gender of professors. We then use BERTopic to extract the most frequent topics from one- and five-star reviews. Our regression analysis based on the topics reveals that the probabilities of specific topics appearing in SET comments are significantly associated with professors’ genders, which aligns with gender role expectations. Furtherly, sentiment analysis indicates that women professors’ comments are more positively or negatively polarized than men’s across most extracted topics, suggesting students’ evaluative standards are subject to professors’ gender. These findings contextualize the gender gap in SET ratings and caution the usage of SET in related decision-making to avoid potential systematic biases towards women professors.

show abstract

Section: Gender Disparities In Academia and Teaching Evaluationmentioning

confidence: 99%

Section: H2: Rmp Review Comments On Women and Men Professors Have Dif...mentioning

confidence: 99%