Research evaluation of computer science publications using Altmetrics: a cohort study of Indian Central Universities

Lamba, Manika; Kashyap, Neha; Madhusudhan, Margam

doi:10.1108/gkmc-07-2020-0097

Cited by 7 publications

(6 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…En varios de los artículos seleccionados para esta revisión se reconoce a los artículos de revista como instrumento para la difusión de resultados en las diferentes disciplinas (Borku Uysal et al, 2021;Garcovich et al, 2020;Guallar et al, 2020;Lamba et al, 2020;Sun y Xia, 2016).…”

Section: Resultsunclassified

“…Como explica Lamba (2020), desde la democratización del acceso a internet a finales de la década de 1990 principios del siglo XXI, la forma en la que los investigadores intercambian y manejan la información ha cambiado mucho (Lamba et al, 2020), lo que ha facilitado que aumente la importancia de las métricas alternativas como una forma complementaria de medir el impacto. Gracias a la web social y a las nuevas métricas, los investigadores tienen hoy en día nuevas opciones para respaldar un artículo publicado a través de una web o en las redes sociales (Garcovich et al, 2020).…”

Section: Resultsunclassified

See 1 more Smart Citation

Comunicación académica y buscadores científicos: 'Scoping Review'

Pastor-Ramón¹,

Rovira²

2023

ixc

View full text Add to dashboard Cite

To enable scientific development, research must be communicated. Scholarly communication has evolved over the years, but not the way how researchers have to justify their scientific output. This scoping review aims to describe the situation of the main scientific search engines Web of Science and Scopus, which are based on their own journal collections, and others based on citation web searches such as Google Scholar, Dimensions, and The Lens. A bibliographic search was carried out in the Lista, WoS, and Scopus databases for scientific articles dealing with scholarly communication and focusing on the resources analyzed. The search was limited to the years 2016-2021 and to the languages Spanish, English, Catalan, French, Italian and Portuguese. Bibliographic databases such as WoS and Scopus continue giving a biased picture of the influence of research, and web-based tools, such as GS and Dimensions, are resources that still have many shortcomings for not allowing the replication of searches or downloading of data, e.g., by GS. It is therefore recommended to use as much information as possible to have a more complete picture of the care received.

show abstract

Section: Resultsunclassified

Comunicación académica y buscadores científicos: 'Scoping Review'

Pastor-Ramón¹,

Rovira²

2023

ixc

View full text Add to dashboard Cite

show abstract

“…Social media indicators are widely used to evaluate academic achievements, and many of them have a positive correlation between citation and online attention scores (Thelwall and Nevill, 2018; Huang et al. , 2018; Lamba et al. , 2021; Nuzzolese et al.…”

Section: Resultsmentioning

confidence: 99%

“…Total cites has a moderate positive correlation with the indicators values of journal discourse leading (0.361 ≤ r ≤ 0.765), indicating a significant overall consistency. Social media indicators are widely used to evaluate academic achievements, and many of them have a positive correlation between citation and online attention scores (Thelwall and Nevill, 2018;Huang et al, 2018;Lamba et al, 2021;Nuzzolese et al, 2019;Salajegheh and Dayari, 2019;Syamili and Rekha, 2017;Yang and Qi, 2021). Boetto et al (2021) used a sample of 212 scientific papers on COVID-19 and found a moderate correlation among traditional citations, social media citations, news and blog citations.…”

Section: Evaluation Of Discourse Leading For Integrating Altmetrics I...mentioning

confidence: 99%

Characteristics analysis and evaluation of discourse leading for academic journals: perspectives from multiple integration of altmetrics indicators and evaluation methods

Wang

2022

LHT

View full text Add to dashboard Cite

PurposeUnder the background of open science, this paper integrates altmetrics data and combines multiple evaluation methods to analyze and evaluate the indicators' characteristics of discourse leading for academic journals, which is of great significance to enrich and improve the evaluation theory and indicator system of academic journals.Design/methodology/approachThis paper obtained 795,631 citations and 10.3 million altmetrics indicators data for 126,424 published papers from 151 medicine, general and internal academic journals. In this paper, descriptive statistical analysis and distribution rules of evaluation indicators are first carried out at the macro level. The distribution characteristics of evaluation indicators under different international collaboration conditions are analyzed at the micro level. Second, according to the characteristics and connotation of the evaluation indicators, the evaluation indicator system is constructed. Third, correlation analysis, factor analysis, entropy weight method and TOPSIS method are adopted to evaluate and analyze the discourse leading in medicine, general and internal academic journals by integrating altmetrics. At the same time, this paper verifies the reliability of the evaluation results.FindingsSix features of discourse leading integrated with altmetrics indicators are obtained. In the era of open science, online academic exchanges are becoming more and more popular. The evaluation activities based on altmetrics have fine-grained and procedural advantages. It is feasible and necessary to integrate altmetrics indicators and combine the advantages of multiple methods to evaluate the academic journals' discourse leading of which are in a diversified academic ecosystem.Originality/valueThis paper uses descriptive statistical analysis to analyze the distribution characteristics and distribution rules of discourse leading indicators of academic journals and to explore the availability of altmetrics indicators and the effectiveness of constructing an evaluation system. Then, combining the advantages of multiple evaluation methods, The author integrates altmetrics indicators to comprehensively evaluate the discourse leading of academic journals and verify the reliability of the evaluation results. This paper aims to provide references for enriching and improving the evaluation theory and indicator system of academic journals.

show abstract

“…However, Luc et al suggest that more comprehensive social media strategies should be tested rigorously for further validation of their results. Finally, we are aware of a recent study by Lamba et al [23], investigating altmetric attention score and citation counts to examine the productivity of research groups working in certain sub-domains of computer science. Based on Spearman's rank correlation, Lamba et al observe a weak to moderate positive relationship between citations and altmetric attention scores.…”

Section: Related Workmentioning

confidence: 99%

Altmetrics and citation counts

Shakeel

Alchokr

Krüger

et al. 2022

Proceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries

View full text Add to dashboard Cite

Background. Researchers, funding agencies, and institutions involve bibliographic data to assess the impact or reputation of papers, publication venues, researchers, and institutions. Particularly citation counts, and metrics that build on these (e.g., impact factor, h-index), are widely used, despite extensive and rightful criticism regarding, for instance, their meaning, value, and comparability. Moreover, such metrics require time to accumulate and do not represent the scientific impact outside of academia, for instance, on industry. To overcome such limitations, researchers investigate and propose altmetrics to complement or provide a more meaningful alternative to traditional metrics. Altmetrics are based on user interactions in the internet and especially social-media platforms, promising a faster accumulation and to represent scientific impact on other parts of society. Aim. In this paper, we complement current research by studying the altmetrics of 18,360 papers published at 16 publication venues of the computer science domain. Method. Namely, we conducted an empirical study to understand whether altmetrics correlate with citation counts and how they have evolved over time. Results. Our results help understand how altmetrics can complement citation counts, and which represent proxy metrics that indicate the immediate impact of a paper as well as future citations. We discuss our results extensively to reflect on the limitations and criticism on such metrics. Conclusion. Our findings suggest that altmetrics can be helpful to complement citation metrics, potentially providing a better picture of overall scientific impact and reducing potential biases of focusing solely on citations. CCS CONCEPTS• Information systems → Social networks; Social recommendation; • General and reference → Empirical studies.

show abstract

Research evaluation of computer science publications using Altmetrics: a cohort study of Indian Central Universities

Cited by 7 publications

References 27 publications

Comunicación académica y buscadores científicos: 'Scoping Review'

Comunicación académica y buscadores científicos: 'Scoping Review'

Characteristics analysis and evaluation of discourse leading for academic journals: perspectives from multiple integration of altmetrics indicators and evaluation methods

Altmetrics and citation counts

Contact Info

Product

Resources

About