A Quality Model for Open Source Software Selection

Sung, Won Jun; Kim, Ji Hyeok; Rhew, Sung Yul

doi:10.1109/alpit.2007.81

Cited by 25 publications

(11 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The model proposed in the work of Sung et al was designed to be used for the selection of OSS for development purposes. It consists of four main characteristics (reusability, functionality, usability, and portability) and 10 subcharacteristics (suitability, security, understandability, learnability, operability, adaptability, installability, coexistence, functional commonality, and lawfulness).…”

Section: Related Workmentioning

confidence: 99%

FOSSES: Framework for open‐source software evaluation and selection

et al. 2019

View full text Add to dashboard Cite

A plethora of approaches exists for the evaluation and selection of open-source software (OSS) in the literature. However, these approaches are hardly ever used in practice for the following reasons: first, the lack of a situational-based procedure to define the evaluation criteria for OSS given its varied and dynamic nature; second, the inability of existing evaluation techniques, such as the analytic hierarchy process, to cope well with uncertainty factors, thus producing misleading results that affect the quality of decisions made; and third, a significant number of existing approaches require the prototyping of alternatives being considered in order to facilitate evaluation and decision-making. This study addresses the aforementioned challenges by evolving a process framework for evaluating and selecting OSS. The proposed framework is validated by applying it to a case study. In addition, expert opinion was elicited via questionnaires from 10 experts, and overall feedback suggests that 80% of them are willing to adopt the approach. KEYWORDS analytic hierarchy process, evidential reasoning, MCDM, open-source software, process framework, weighted scoring model 780The MCDM problem can be referred to as the process of choosing software among available alternatives based on a number of conflicting attributes. 8 MCDM is aimed at 9 (1) helping decision makers choose the best alternative, (2) sorting out the alternatives that seem good among the set of available alternatives, and (3) ranking the alternatives in decreasing order of their performance. A large number of well-known MCDM methods exist, such as the Technique for Order of Preference by Similarity to Ideal Solution (TOPSIS), data envelopment analysis, the analytic hierarchy process (AHP), the analytic network process, VIKOR, decision-making trial and evaluation laboratory, the Preference Ranking Organization Method for Enrichment Evaluations, and the Elimination and Choice Expressing Reality method, to mention a few. 10 The AHP is the most popular in terms of its application in software evaluation and selection. 7,11,12 However, the AHP has some known limitations, which can easily be surmounted by using the evidential reasoning (ER) approach in place of the AHP. 13 The ER approach is different from most conventional MCDM methods in that it employs a belief structure to represent an assessment as a distribution. For instance, the distributed assessment of a given software's quality may be {(Excellent, 70%), (Good, 30%), (Average, 0%), (Poor, 0%), (Worst, 0%)}, which means that the quality of the software is assessed to be Excellent with 70% of belief degree and Good with 30% of belief degree. Some of the advantages of using ER over the AHP 13 include the following:i. ability to handle very large multi-attribute decision-making problems compared to the AHP; ii. ability to assess newly added alternatives independently, whereas the AHP would have to repeat an assessment procedure to incorporate new alternatives; iii. ability to produce consistent ranking after n...

show abstract

Section: Related Workmentioning

confidence: 99%

FOSSES: Framework for open‐source software evaluation and selection

et al. 2019

View full text Add to dashboard Cite

show abstract

“…ağırlıklandırma) ise [9,11,18], [24,29,30] çalışmalarında olduğu gibi kullanıcı görüşü önemsenmeden (kural-odaklı) değerlendirme yapılmıştır. Değerlendirme için [8][9][10][11]26] çalışmalarında yapıldığı gibi yeni bir değerlendirme modeli önerilmemiş olup ISO/IEC 25010 kalite modeline bağlı kalınmıştır.…”

Section: İli̇şki̇li̇ çAlişmalar (Related Work)unclassified

Açık kaynak yazılımlarda bakım yapılabilirliği ve güvenilirliği ölçmek için iki boyutlu değerlendirme metodu

Yılmaz¹,

Tarhan²

2019

Gazi Üniversitesi Mühendislik-Mimarlık Fakültesi Dergisi

View full text Add to dashboard Cite

 Evaluation method for maintainability and reliability in Open Source Software  Code-based and community-based evaluation  Implementation of the proposed method for three Open Source Software products and a comparison of the results with other methods Increased popularity of open source software (OSS) has led to a considerable proliferation of alternative software. However, this being the case, an evident lack of studies that would contribute to evaluation of OSS by organizations has turned the process of selecting the most suitable product into an appealing research problem. In this article, a method to evaluate reliability and maintainability of OSS products by using both code-based and community-based aspects is proposed. Figure A. Process followed to evaluate OSS products Purpose: In this article, a method to evaluate reliability and maintainability of OSS by using both code-based and community-based aspects is proposed through the synthesis of existing studies in literature. Theory and Methods: To perform code-based evaluation, some internal attributes of the most recent quality model, ISO/IEC 25010, are selected and object-oriented C&K metrics are employed in an attempt to measure these attributes. To perform community-based evaluation, metrics derived from historical data such as emailing lists, problem reports, frequently asked questions, and etc. are utilized to identify and satisfy information needs as conformant to ISO/IEC 15939 standard for software measurement process. Results: The two-dimensional method was used in selection of the Java build tools written in Java, and the results obtained by applying the proposed method and the results obtained by using OSMM and OpenBRR which are common methods in the literature were compared. According to the evaluation and comparison results, the results obtained with the existing models confirm each other and the results obtained with the proposed method Conclusion: The proposed method can be subject to further empirical studies on OSS selection with respect to maintainability and reliability attributes.

show abstract

“…While open source software (OSS) was the focus of the quality model described in [2], this model may still be applied to custom software for acceptance testing, in the case where access to the source code is a condition of the outsourcing arrangement. However, it is not as readily applied to COTS software.…”

Section: Software Choicementioning

confidence: 99%