Revisiting subject classification in academic databases: A comparison of the classification accuracy of Web of Science, Scopus & Dimensions

Abstract

Classification of research articles into different subject areas is an extremely important task in bibliometric analysis and information retrieval. There are primarily two kinds of subject classification approaches used in different academic databases: journal-based (aka source-level) and article-based (aka publication-level). The two popular academic databases- Web of Science and Scopus- use journal-based subject classification scheme for articles, which assigns articles into a subject based on the subject category assigned to the journal in which they are published. On the other hand, the recently introduced Dimensions database is the first large academic database that uses article-based subject classification scheme that assigns the article to a subject category based on its contents. Though the subject classification schemes of Web of Science have been compared in several studies, no research studies have been done on comparison of the article-based and journal-based subject classification systems in different academic databases. This paper aims to compare the accuracy of subject classification system of the three popular academic databases: Web of Science, Scopus and Dimensions through a large-scale user-based study. Results show that the commonly held belief of superiority of article-based subject classification over the journal-based subject classification scheme does not hold at least at the moment, as Web of Science appears to have the most accurate subject classification.

Understanding the Bibliometric Patterns of Publications in IEEE Access

“…The division represents a broad subject area or research discipline, while Groups and Fields represent increasingly detailed subsets of these categories. There are 22 Divisions, 157 Groups, and 1238 Fields [57].…”

Augmented Humanity: A Systematic Mapping Review

“…In the first six items, basic information about the article was extracted, including the article's year of publication, title, author(s), type of publication, etc. Items 7 and 8 extracted data about the areas of knowledge and categories in which the articles are classified; this is because WoS performs significantly better than Scopus in terms of the accuracy of its journal ranking system [31,32]. In item 9, the relevant characteristics were extracted after detailed reading of the articles, and finally, item 10 is about the abstract of each article.…”

Similarity network fusion for scholarly journals

“…), or of social attributes (authors). There are many works aimed at comparing scientific field classifications emerging from the use of different proxies of similarities [12,13,14], or at evaluating the accuracy of the level, documents or journals, at which they are defined [15,16]. Other works developed journal classification systems based on single layer networks and compared them with "ready-made classifications" such the ones of Web of Science or Scopus.…”