Quantitative Evaluation of Software Quality Metrics in Open-Source Projects

Barkmann, Henrike; Lincke, Rüdiger; Löwe, Welf

doi:10.1109/waina.2009.190

Cited by 57 publications

(62 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Observations similar to those we made for sentiment analysis tools, have been made in the past for software metric calculators [31] and code smell detection tools [32]. Similarly to our findings, disagreement between the tools was observed.…”

Section: Discussionsupporting

confidence: 89%

Choosing your weapons: On sentiment analysis tools for software engineering research

Jongeling

Datta

Serebrenik

2015

2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)

View full text Add to dashboard Cite

Abstract-Recent years have seen an increasing attention to social aspects of software engineering, including studies of emotions and sentiments experienced and expressed by the software developers. Most of these studies reuse existing sentiment analysis tools such as SentiStrength and NLTK. However, these tools have been trained on product reviews and movie reviews and, therefore, their results might not be applicable in the software engineering domain.In this paper we study whether the sentiment analysis tools agree with the sentiment recognized by human evaluators (as reported in an earlier study) as well as with each other. Furthermore, we evaluate the impact of the choice of a sentiment analysis tool on software engineering studies by conducting a simple study of differences in issue resolution times for positive, negative and neutral texts. We repeat the study for seven datasets (issue trackers and STACK OVERFLOW questions) and different sentiment analysis tools and observe that the disagreement between the tools can lead to contradictory conclusions.

show abstract

Section: Discussionsupporting

confidence: 89%

Choosing your weapons: On sentiment analysis tools for software engineering research

Jongeling

Datta

Serebrenik

2015

2015 IEEE International Conference on Software Maintenance and Evolution (ICSME)

View full text Add to dashboard Cite

show abstract

“…Barkmann et al [30] analyzed 146 Free Software projects written in Java, identifying the correlation between a set of object-oriented metrics and their theoretical ideal values. However, in their work the values of source code metrics were not associated with problems or attractiveness of Free Software projects.…”

Section: Related Workmentioning

confidence: 99%

A Study of the Relationships between Source Code Metrics and Attractiveness in Free Software Projects

Meirelles

Santos

Miranda

et al. 2010

2010 Brazilian Symposium on Software Engineering

View full text Add to dashboard Cite

Abstract-A significant number of Free Software projects has been widely used and considered successful. However, there is an even larger number of them that cannot overcome the initial steps towards building an active community of users and developers. In this study, we investigated whether there are relationships between source code metrics and attractiveness, i.e., the ability of a project to attract users and developers. To verify these relationships, we analyzed 6,773 Free Software projects from the SourceForge.net repository. The results indicated that attractiveness is indeed correlated to some source code metrics. This suggests that measurable attributes of the project source code somehow affect the decision to contribute to and adopt a Free Software. The findings described in this paper show that it is relevant for project leaders to monitor source code quality, particularly a few objective metrics, since these can have a positive influence in projects chances of forming a community of contributors and users around their software, enabling further enhancement in quality.

show abstract

“…Is this a sign of poor quality? In software quality assessment, there exist certain recommendations, but more often than not the meaning of the values depends on the product [2]. However, there are still several uses for the metric values.…”

Section: Discussionmentioning

confidence: 99%

“…Based on our experience with measuring software quality [2,17], we build on the Goal-Question-Metric (GQM) paradigm [4] and suggest a metrics-based quality model. Quantitative metrics are collected throughout production and use of the technical documentation.…”

Section: Introductionmentioning

confidence: 99%

A Metrics-Based Approach to Technical Documentation Quality

Wingkvist

Ericsson

Lincke

et al. 2010

2010 Seventh International Conference on the Quality of Information and Communications Technology

View full text Add to dashboard Cite

Abstract-Technical documentation is now fully taking the step from stale printed booklets (or electronic versions of these) to interactive and online versions. This provides opportunities to reconsider how we define and assess the quality of technical documentation. This paper suggests an approach based on the Goal-Question-Metric paradigm: predefined quality goals are continuously assessed and visualized by the use of metrics. To test this approach, we perform two experiments. We adopt well known software analysis techniques, e.g., clone detection and test coverage analysis, and assess the quality of two real world documentations, that of a mobile phone and of (parts of) a warship. The experiments show that quality issues can be identified and that the approach is promising.

show abstract

Quantitative Evaluation of Software Quality Metrics in Open-Source Projects

Cited by 57 publications

References 9 publications

Choosing your weapons: On sentiment analysis tools for software engineering research

Choosing your weapons: On sentiment analysis tools for software engineering research

A Study of the Relationships between Source Code Metrics and Attractiveness in Free Software Projects

A Metrics-Based Approach to Technical Documentation Quality

Contact Info

Product

Resources

About