Integrative Approach to Quality Assessment of Medical Journals Using Impact Factor, Eigenfactor, and Article Influence Scores

Abstract

BackgroundImpact factor (IF) is a commonly used surrogate for assessing the scientific quality of journals and articles. There is growing discontent in the medical community with the use of this quality assessment tool because of its many inherent limitations. To help address such concerns, Eigenfactor (ES) and Article Influence scores (AIS) have been devised to assess scientific impact of journals. The principal aim was to compare the temporal trends in IF, ES, and AIS on the rank order of leading medical journals over time.MethodsThe 2001 to 2008 IF, ES, AIS, and number of citable items (CI) of 35 leading medical journals were collected from the Institute of Scientific Information (ISI) and the http://www.eigenfactor.org databases. The journals were ranked based on the published 2008 ES, AIS, and IF scores. Temporal score trends and variations were analyzed.ResultsIn general, the AIS and IF values provided similar rank orders. Using ES values resulted in large changes in the rank orders with higher ranking being assigned to journals that publish a large volume of articles. Since 2001, the IF and AIS of most journals increased significantly; however the ES increased in only 51% of the journals in the analysis. Conversely, 26% of journals experienced a downward trend in their ES, while the rest experienced no significant changes (23%). This discordance between temporal trends in IF and ES was largely driven by temporal changes in the number of CI published by the journals.ConclusionThe rank order of medical journals changes depending on whether IF, AIS or ES is used. All of these metrics are sensitive to the number of citable items published by journals. Consumers should thus consider all of these metrics rather than just IF alone in assessing the influence and importance of medical journals in their respective disciplines.

Representation of Developing Countries in Orthopaedic Journals: A Survey of Four Influential Orthopaedic Journals

“…We retrospectively reviewed all 4329 papers published during a 3-year period (May 22, 2007-May 20, 2010 [30,32]. We scrutinized the published information in each article to determine the countries identified in the authors' affiliation addresses.…”

Correlación entre indicadores bibliométricos en revistas de Web of Science y Scopus

“…El principal inconveniente de la evaluación por expertos señalado en la literatura ha sido su carácter subjetivo, de ahí que se haya utilizado con mayor frecuenciael segundo, necesario para comprender el impacto científico de las revistas (Rizkallah;Sin, 2010).…”

A New Method for Evaluating Author’s Scientific Impact by using an Eigenfactor Derived Scoring System

“…score of that journal doubles. [14] The SCImago Journal Rank Indicator (SJR), also a variation of the Google PageRank algorithm, is similar to the EF; it is computed by weighting the sum of four parameters: minimum prestige (the same for all journals, but dependent upon the total database), the number of published articles on a three year period, the prestige of the citing journals and a rest term adding the contribution of the journals not connected to the citation network of the published articles. [6] For a detailed analysis of the advantages of EF Score see Franceschet.…”