Bibliometric Indicators and Analysis of Research Systems

Abstract

STI Working Papers SeriesThis Working Papers Series of the OECD Directorate for Science, Technology and Industry is designed to make available to a wider readership selected studies prepared by staff in the Directorate or by outside consultants working on OECD projects. The papers included in the series are of a technical and analytical nature and deal with issues of data, methodology and empirical analysis in the areas of work of DSTI. The Working Papers are generally available only in their original language -English or French -with a summary in the other.Comment on the papers is invited, and should be sent to Directorate for Science, Technology and Industry, OECD, 2 rue André Pascal, 75775 Paris Cedex 16, France.The opinions expressed in these papers are the full responsibility of the author(s) and do not necessarily reflect those of the OECD or of the governments of its Member countries. Copyright OECD, 1997Application for permission to reproduce or translate all or part of this publication should be made to: Head of Publications Service, OECD, 2 rue André Pascal, 75775 Paris Cedex 16, France.3 Bibliometric indicators and analysis of research systems: Methods and examplesYoshiko Okubo* This report -linked to the technical documents of the OECD manuals for the measurement of R&D activities ("Frascati Family") -presents the essential elements of bibliometrics and its application to the analysis of research systems. Bibliometrics is based on the enumeration and statistical analysis of scientific output in the form of articles, publications, citations, patents and other, more complex indicators.It is an important tool in evaluating research activities, laboratories and scientists, as well as the scientific specialisations and performance of countries. The report, having set the background for the development of bibliometrics, presents the databases on which bibliometrics is built, as well as the principal indicators used. Twenty-five examples are presented at the end of the document, illustrating the various uses of bibliometric methods for analysing research systems. These indicators measure scientific output, by counting the number of papers; the impact of papers on scientific disciplines, by counting the number of co-citations; the extent of international co-operation, as evidenced by joint signatures; the scientific content of patents, etc.

Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification

“…Since the ASN was defined before the publication of the manifesto, it is unreasonable to expect that the ASN fully complies. However, the manifesto did not appear out of the blue: the issues associated with the use of bibliometrics to evaluate individuals are well known and have already been described in the literature (Institute de France; Laloë & Mosseri, 2009;Sahel, 2011;IEEE;Okubo, 1997).…”

Recompensas em organizações: abordagens de pesquisa e padrões de citação utilizados no Brasil

“…Por fi m, o nível micro mapeia a produção científi ca nos departamentos, grupos de pesquisa e programas entre universidades e entre grandes instituições (Kobashi & Santos, 2006). Os indicadores bibliométricos permitem, portanto, situar um país com relação aos demais, uma instituição com relação a um país ou a outras instituições, assim como situar pesquisadores individuais frente à comunidade científi ca de sua especialidade (Okubo, 1997).…”

“…Uma bibliometria pode gerar diferentes indicadores, os quais são frequentemente usados em conjunto (Okubo, 1997). Eles podem ser divididos em indicadores de produção, de citação e de ligação (Macias-Chapula, 1998).…”

A Bibliometric Analysis of Evaluative Medical Education Studies

“…1,2 It employs computerized analytic techniques and uses the individual publication as the unit of analysis, drawing data from sources such as MEDLINE, Google Scholar, and Journal Citation Reports (JCR). 3 Articles' metadata-including the indexing terms applied by the National Library of Medicine (NLM) and provided in MEDLINE-are retrieved and analyzed rather than articles' full text, which does not need to be obtained or examined.…”