The methodology is partly based on the 'issue management' approach by Lancaster & Lee (1985) partly on common publication and citation analysis of the set of source documents (n=4,725), the set of their references (n=27,099) and the set of publications (n=7,863) citing the source documents. Median age analyses are included for the sets of references and citations to the source documents. DIVAlike diagrams (Database Information Visualization and Analysis system) are used to demonstrate the distribution of source documents over document types, time and volume of citations obtained. Social Network Analysis (SNA) is applied to topic modeling of the top-100 central WoS Categories of 'smart city(ies)' research and to the set of references. Findings show that the first mention of the concept 'smart city(ies)' in publication titles takes place in 1999. The research area demonstrates a strong multidisciplinary nature and an exponential growth of research publications (in WoS) 2008-2016 dominated by China, Italy, USA, Spain and England. The same five countries are also among the most citing and cited countries. Aside from a constantly strong ICT (Information and Communication Technology) and Electrical/Electronic Engineering presence 'sustainability' elements (Energy, Transport, Environment) are also vital, in particular during the first and third analysis period. The references from the source documents have more distinct topical clusters than the source documents. Artificial Intelligence (AI) appears as a novel field among the source documents 2008-2016, but disappears from the top-25 list in the citing documents. Instead Economics, Water Resources and Meteorology & Atmospheric Sciences move into the list. Proceedings papers, as in many other engineering and technology based research fields, are the dominant document type (70 %) but have small citation impact (0.6 c/p), thus decreasing the overall impact of the area to 3.6 c/p. Journal articles are the most cited type with 76 % of all citations received (impact 2008-2016: 7.5 c/p). Most citations to journal articles derive from journal articles themselves (76 %).

The paper reports the developments and citation patterns over three time periods of research on Renewable Energy generation and Wind Power 1995-2011 in EU, Spain, Germany and Denmark. Analyses are based Web of Science and incorporate journal articles as well as conference proceeding papers. Sxcientometric indicators include publication collaboration ratios, topplayer distribution as well as citedness and correspondence analyses of citing publications, relative citation impact, distributions of top-cited as well as topciting institutions and publication sources and cluster analysis of citing title terms to map knowledge export areas. Findings show an increase in citation impact for Renewable Energy and Wind Power research albeit hampered by scarcely cited conference papers. Although EU maintains its global top position in producing Renewable Energy and Wind Power research the developments of EU and German world shares as well as citation impact are negative during the most recent seven year period. During the same time the citation impact of Spain and Denmark increase and place both nations among the top-ranking countries in Wind Power research. Spain is the only EU country that increases its world production share from 2000. China is currently ranked three after EU and USA in research output, however with a very low citation impact. Spain, Denmark and Germany each demonstrates distinct collaboration patterns and publication source and citation distribution profiles. More than half the citations to EU Wind Power research are EU-self citations. An expected intensified EU collaboration in the Wind Energy field does not come about. The most productive research institutions in Denmark and Spain are also the most cited ones.

This paper is a result of the WOW project (Wind power On Wikipedia) which forms part of the SAPIENS (Scientometric Analyses of the Productivity and Impact of Eco-economy of Spain) Project (Sanz-Casado et al., 2013). WOW is designed to observe the relationship between scholarly publications and societal impact or visibility through the mentions of scholarly papers (journal articles, books and conference proceedings papers) in the Wikipedia, English version. We determine 1) the share of scientific papers from a specific set defined by Wind Power research in Web of Science (WoS) 2006-2015 that are included in Wikipedia entries, named data set A; 2) the distribution of scientific papers in Wikipedia entries on Wind Power, named data set B, captured via the three categories for the topic Wind Power in the Wikipedia Portal: Wind Power, Wind turbines and Wind farms; 3) the distributions of document types in the two wiki entry data sets' reference lists. In parallel the paper aims at designing and test indicators that measure societal impact and R&D properties of the Wikipedia, such as, a wiki reference focus measure; and a density measure of those types in wiki entries. Methods: The study is based on Web mining techniques and a developed software that extracts a range of different types of Wikipedia references from the data sets A and B. Results: Findings show that in data set A 25.4% of the wiki references are academic, with a density of 17.62 academic records detected per wiki entry. However, only 0.62 % of the original WoS records on Wind Power are also found as wiki references, implying that the direct societal impact through the Wikipedia is extremely small for Wind Power research. In the second Wikipedia set on Wind Power (data set B), the presence of scientific papers is even more insignificant (10.6%; density: 3.08; WoS paper percentage: 0.26 %). Notwithstanding, the Wikipedia can be used as a tool informing about the transfer from scholarly publications to popular and non-peer reviewed publications, such as Web pages (news, blogs), popular magazines (science/technology) and research reports. Nonscholarly wiki reference types stand for 74.6% of the wiki references (data set A) and almost 90% in data set B. Interestingly, the few WoS articles in wiki entries on Wind Power present on average 34.3 citations received during the same period (2006-2015) as WoS Wind Power publications not mentioned in wiki entries only receives on average 5.9 citations. Conclusions: Owing to the scarcity of Wind Power research papers in the Wikipedia, it cannot be applied as a direct source in evaluation of Wind Power research. This is in line with other recent studies regarding other subject areas. However, our analysis presents and discusses six supplementary indirect indicators for research evaluation, based on publication types found in the wiki entry reference lists: Share of (WoS) records; Density; and Reference Focus, plus Popular Science Knowledge Export, Non-Scholarly Knowledge Export and Academic Knowledge Export. The same in...

Cómo citar este artículo/ Citation: Sanz-Casado, E.; García-Zorita, C.; Serrano-López, A. E.; Efraín-García, P.; De Filipo, D. (2013). Rankings nacionales elaborados a partir de múltiples indicadores frente a los de índices sintéticos. Revista Española de Documentación Científica, 36(3):e012. doi: http://dx.doi.org/10.3989/redc.2013.3.1.023Resumen: En este trabajo se analiza el interés de los rankings nacionales de universidades para visibilizar la actividad investigadora de estas instituciones en países no centrales. Para ello, en la primera parte de carácter metodológico, se presentan las características de los rankings nacionales que se muestran más adecuados para identificar y comparar las actividades de las instituciones de un mismo entorno. Se describen, además, las ventajas y limitaciones de la utilización de múltiples indicadores frente a indicadores sintéticos. En la segunda parte se presenta el Observatorio IUNE como una herramienta que ofrece información amplia y variada para el seguimiento de la actividad investigadora de las universidades españolas. Los datos obtenidos permiten conocer las características del sistema universitario español, así como posicionar a las instituciones en función de su actividad en 6 dimensiones diversas a partir de 42 indicadores distintos.Palabras clave: Rankings de universidades; actividad científica; Observatorio IUNE; indicadores. National Rankings based on multiple indicators versus synthetic indicesAbstract: This paper analyzes the interest of national rankings of universities in making visible the research activities of these institutions in non-core countries. To do this, the first part of methodology presents the characteristics of the national rankings that are more appropriate for identifying and comparing the activities of institutions of the same environment. It also describes the advantages and limitations of using multiple indicators as opposed to synthetic indicators. The second part presents the IUNE Observatory as a tool that provides comprehensive and diverse information for monitoring the research activity of Spanish universities. The data obtained allow us to identify the characteristics of the Spanish university system as well as to position the institutions according to their activities, into 6 different dimensions based on 42 different indicators.

No abstract