Shape models are used for many tasks in modern image analysis, e.g. segmentation, tracking, etc. Rarely, the quality of fit of adapted shape models is automatically determined to decide, whether the model fitting was successful. This paper develops a principal strategy to measure this quality of fit and defines a specific measure in the case of Stable Mass Spring Models, which are especially appropriate for that. The quality of fit measure is tested in two medical segmentation cases (left ventricles in SPECT data and lymph nodes in CT data) and has been shown to work well. Using application specific thresholds on the quality of fit, it could be automatically detected, whether a segmentation was successful or failed.