Performance Effects of Measurement and Analysis: Perspectives from CMMI High Maturity Organizations and Appraisers

Abstract

ixii | CMU/SEI-2010-TR-022iii | CMU/SEI-2010-TR-022 List of Tables Table 1: Relationships between individual items about the of use of healthy process performance model ingredients and overall value 49 Table 2: Relationships between individual items about the of use of statistical methods for process performance modeling and overall value 52 Table 3: 2009 -Relationships between the use of automated method to support measurement related activities and overall value attributed to process performance modeling 53 Table 4: Relationships between data quality and integrity activities and overall value attributed to process performance modeling: 54 Table 5: Relationships between modelers' understanding of the intent of CMMI process performance baselines and models and overall value attributed to the model outcomes56 Table 6: Relationship between involvement by individual stakeholder roles and overall value attributed to process performance models 58 Table 7: Relationship between quality of training available for different practitioner roles and overall value attributed to process performance models 60 Table 8: Relationship between technical challenges that projects sometimes face and overall value attributed to process performance models 62 Table 9: Relationships between obstacles to measurement and analysis and overall value of process performance model outcomes 63 Table 10: Relationships between barriers and facilitators of process performance modeling and overall value of the model outcomes 65 Table 11: List of FiguresComparison of relationships between emphasis on healthy process performance model ingredients with achievement of target goals and overall value of process performance model outcomes 68 Table 12:Comparison of relationships between use of healthy process performance model ingredients with achievement of target goals and overall value of process performance model outcomes 69 Table 13:Comparison of relationships between use of statistical methods with achievement of target goals and overall value of process performance model outcomes 71 Table 14:Comparison of relationships between use of simulation and other optimization methods with achievement of target goals and overall value of process performance model outcomes 74 AbstractThis report describes results from two recent surveys conducted by the Software Engineering Institute (SEI) to collect information about the measurement and analysis activities of software systems development organizations. Representatives of organizations appraised at maturity levels 4 and 5 completed the survey in 2008. Using a variant of the same questionnaire in 2009, certified high maturity lead appraisers described the organizations that they had most recently coached or appraised for the achievement of similar high maturity levels. The replies to both surveys were generally consistent even though the two groups are often thought to be quite different. The results of the surveys suggest that the organizations understood and used CMMI-based process performance model...

Symptom‐based improvement recommendations

“…Most recently an ISO standard [3] for how to diagnose -or assess as it is called -was published along with a maturity model. Studies have shown [4][5][6] that increasing your maturity as an IT or Software developing company bring about real benefits such as higher quality of your products, less rework, and faster development of new products.…”