Rating of software trustworthiness via scoring of system testing results

Abstract

It is important to have a form of software trustworthiness rating serving as early health indicator on the capability of the software before it is released to end-users and customers. Although various software certification schemes are available in the market, there is limited information on how far results from system testing are exploited and used to rate the trustworthiness of the software under test. Thus, the proposed software trustworthiness rating strategy uses the scoring upon the completion of system testing execution. The strategy covers rating of software that has undergone system testing completely or partially. It is based on multiple levels calculation toward coming out with final rating: test strategies imposed, completeness of system test execution, test iterations, test case priority and test case result for each iteration. As a result, the multilevel scores calculation successfully derives meaningful trustworthiness rating for the software under test, whether it is a complete rating or partial rating.

A Novel Software Trustworthiness Evaluation Strategy via Relationships between Criteria

“…Muhammad et al classify software trustworthiness using values assigned to test case results. The rating strategy includes imposed test strategy, completeness of system test execution, test iterations, test case priority, and test case results from each iteration [25]. Yang et al present a social-tosoftware framework of software trustworthiness measurement [26].…”

“…The essence of this method is to predict the trustworthiness of attributes according to the internal attribute values. Typical models for the synthesis of trustworthy attribute values include machine learning [11][12][13][14][15], axiomatic approaches [16][17][18][19][20], uncertainty theory [21][22][23][24], system testing [25], the social-to-software framework [26], user feedback [27], heuristic-systematic processing [28], the development framework [29], crowd wisdom [30], etc.…”

Improved Allocation and Reallocation Approaches for Software Trustworthiness Based on Mathematical Programming

“…This model can be applied to predict the vulnerability severity/type [17]. Muhammad et al used the values assigned to test case results to classify software trustworthiness [18]. The rating strategy contains test strategies imposed, completeness of system test execution, test iterations, test case priority and test case results, for each iteration.…”

A Reallocation Approach for Software Trustworthiness Based on Trustworthy Attributes

“…Muhammad et al use the scoring upon the completion of system testing execution to rate software trustworthiness. The rating strategy is based on multiple level calculations that produce a final rating, including test strategies imposed, completeness of system test execution, test iterations, test case priority and test case result for each iteration [17]. Based on trust theory in the field of humanities and sociology, Yang et al propose a measurable Social-to-Software software trustworthiness framework, and present a whole metric solution for software trustworthiness, namely, the advanced J-M model based on power function, the time-loss rate for ability trustworthiness measurement and the fuzzy comprehensive evaluation model [18].…”