Canadian University Rankings: Buyer Beware Once Again

Abstract

We present a data-based perspective concerning recent (e.g., 2008) Maclean's magazine rankings of Canadian universities, including cluster analysis of the 2008 data.

The Marketing of Canadian University Rankings: A Misadventure Now 24 Years Old

“…Overall, the present analysis of Maclean's ranked indices from 2011-2015 corroborate those of prior studies (1991-2010), wherein (a) individual indices correlated with overall rank approximately half the time, (b) high versus low ranking schools were significantly different on roughly half the indices, and (c) cluster analysis produced largely meaningless and incomprehensible (albeit empirically similar) families of institutions (cf. Cramer & Page, 2007;Page & Cramer, 2001;Page, Cramer, & Page, 2008, 2010. That is, the ranking results generally illustrate Aghaz et al, 2015;Amsler & Bolsman, 2012;Huang et al, 2015).…”

“…Most noteworthy for the present study is their evaluation of the Maclean's Canadian ranking exercise, judged to be the most inadequate of the national systems reviewed, chiefly because they relied heavily on subjective rankings of reputation and utilized principally input measures. Previous research has specifically investigated the validity and interpretability of Maclean's rankings (Cramer & Page, 2007;Page et al, 2008Page et al, , 2010, and similar conclusions were reached, namely that the indices selected by Maclean's: (1) did not perform adequately under the psychometric and statistical microscope, (2) were only somewhat relevant to the types of information sought by students and families in their choice of an institution of higher learning, and (3) may incite more harm than good concerning student welfare and institutional self-portrayal. We will similarly show how these outcomes remain unchanged in a five-year analysis of the most recent data.…”

“…To illustrate our routine analysis plan, we presently outline the results from the 2010 ranking data (Page et al, 2010). To begin, a Spearman (rank-based) rho correlation analysis assesses the level of association between rank-based variables (viz.…”

“…he exercise of rating or ranking life's various entities is commonplace today -from best weather and places to live, to restaurants and toasters, to recording artists and vacation spots. Forbes' top 500 companies and public institutions such as hospitals and even centres of higher learning are no exception (Aghaz, Hashemi, & Atashgah, 2015;Amsler & Bolsman, 2012;Huang, Chen, & Chien, 2015;Page & Cramer, 2001;Page, Cramer, & Page, 2008, 2010. Canadian publication Maclean's similarly aims to aid consumers in reaching a sound decision on where to attend college or university.…”

“…Canadian publication Maclean's similarly aims to aid consumers in reaching a sound decision on where to attend college or university. 1 However, with increased public demand for external Huang et al, 2015;Page et al, 2010;Provan & Abercromby, 2000;Siegel, 1959). As Salmi and Saroyan (2007, p. 52)…”