A framework for evaluating a software bidding model

Kitchenham, Barbara; Pickard, Lesley M.; Linkman, Stephen; Jones, Peter W.

doi:10.1016/j.infsof.2004.05.005

Cited by 27 publications

(50 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, once those models have been created, they need to be validated against the real world they are modeling. Kitchenham et al [28] propose a framework for validating bidding systems, which can also be used for evaluating SD or BN models. The evaluation framework is composed of five quality aspects: 1) syntactic quality, 2) semantic quality, 3) pragmatic quality, 4) test quality, and 5) value quality.…”

Section: Analysis Of the Results And Discussionmentioning

confidence: 99%

e-Learning in Project Management Using Simulation Models: A Case Study Based on the Replication of an Experiment

et al. 2006

View full text Add to dashboard Cite

Abstract-Current e-learning systems are increasing their importance in higher education. However, the state of the art of e-learning applications, besides the state of the practice, does not achieve the level of interactivity that current learning theories advocate. In this paper, the possibility of enhancing e-learning systems to achieve deep learning has been studied by replicating an experiment in which students had to learn basic software engineering principles. One group learned these principles using a static approach, while the other group learned the same principles using a system-dynamics-based approach, which provided interactivity and feedback. The results show that, quantitatively, the latter group achieved a better understanding of the principles; furthermore, qualitatively, they enjoyed the learning experience.

show abstract

Section: Analysis Of the Results And Discussionmentioning

confidence: 99%

e-Learning in Project Management Using Simulation Models: A Case Study Based on the Replication of an Experiment

et al. 2006

View full text Add to dashboard Cite

show abstract

“…It consists of evaluating five different qualities: Semantic, Syntactic, Pragmatic, Test and Value (see [3]). The framework is an extension of Lindland et al's framework for evaluating the quality of conceptual models [6].…”

Section: The Evaluation Frameworkmentioning

confidence: 99%

“…In a previous paper [3], we proposed a framework for evaluating a software bidding model, and suggested that such a framework might be useful for any expert-opinionbased model of a software process where there was little or no data available for model validation. In this paper, we present the results of two trials aimed at evaluating the framework.…”

Section: Introductionmentioning

confidence: 99%

Experiences of using an evaluation framework

Kitchenham

Linkman

2005

Information and Software Technology

Self Cite

View full text Add to dashboard Cite

This paper reports two trials of an evaluation framework intended to evaluate novel software applications. The evaluation framework was originally developed to evaluate a risk-based software bidding model, and our first trial of using the framework was our evaluation of the bidding model. We found that the framework worked well as a validation framework but needed to be extended before it would be appropriate for evaluation. Subsequently, we compared our framework with a recently completed evaluation of a software tool undertaken as part of the Framework V CLARiFi project. In this case, we did not use the framework to guide the evaluation; we used the framework to see whether it would identify any weaknesses in the actual evaluation process. Activities recommended by the framework were not undertaken in the order suggested by the evaluation process and we found problems relating to that oversight surfaced during the tool evaluation activities. Our experiences suggest that the framework has some benefits but it also requires further practical testing. q

show abstract

“…There is some literature on software project bidding and its risk management now [4][5][6][7][8]. Kitchenham et al present a software project bidding framework that allows users to visualize the risk involved in an offer and to make appropriate bid/no bid decisions [4].…”

Section: Introductionmentioning

confidence: 99%

“…Jørgensen and Carelius consider that risk premium overcompensated for the level of uncertainty leads to a higher price in software project bidding [6]. Kitchenham et al develop an extended evaluation framework and an associated evaluation process to evaluate software bidding model [7], and report two trials of the evaluation framework in software project bidding [8]. However, the investigations are usually limited in a certain segment or stage, for example cost and offer.…”

Section: Introductionmentioning

confidence: 99%