Psychometric Evaluation of an Inpatient Consumer Survey Measuring Satisfaction with Psychiatric Care

Abstract

The overall findings from this study provide evidence that the ICS is a reliable measure of consumer satisfaction in psychiatric inpatient settings. The analysis has shown the ICS to provide valid and reliable results and to focus on the specific concerns of consumers of psychiatric inpatient care. Scores by item indicate that opportunity for improvement exists across healthcare organizations.

Assessment of Patient Empowerment - A Systematic Review of Measures

“…All but three studies [ 31 , 33 , 36 ] reported internal consistency and could be rated using COSMIN box A. Ratings for internal consistency were either poor [ 13 , 17 , 18 , 28 , 30 , 34 , 35 , 37 , 41 , 44 , 45 ] or fair [ 16 , 29 , 32 , 38 – 40 , 42 , 43 , 46 – 53 ]. Reliability (box B) was only assessed in six studies, either resulting in poor [ 32 , 37 , 39 ] or fair ratings [ 18 , 36 , 43 ].…”

“…Reliability (box B) was only assessed in six studies, either resulting in poor [ 32 , 37 , 39 ] or fair ratings [ 18 , 36 , 43 ]. Measurement error was not reported in any study and could therefore not be rated with COSMIN box C. Content validity (box D) was assessed by most studies with a high variability of scores, ranging from several studies rated as poor [ 13 , 16 , 28 , 35 , 37 , 38 , 45 – 47 , 49 – 52 ] to one single study rated as excellent [ 34 ]. Structural validity (box E) was also assessed by most studies with only the study on the Genetic Counseling Outcome Scale [ 18 ] being rated as good and all other studies receiving poor [ 28 , 30 , 31 , 34 , 36 , 37 , 41 ] or fair ratings [ 16 , 17 , 29 , 32 , 35 , 38 – 40 , 42 – 44 , 46 – 53 ].…”

“…Measurement error was not reported in any study and could therefore not be rated with COSMIN box C. Content validity (box D) was assessed by most studies with a high variability of scores, ranging from several studies rated as poor [ 13 , 16 , 28 , 35 , 37 , 38 , 45 – 47 , 49 – 52 ] to one single study rated as excellent [ 34 ]. Structural validity (box E) was also assessed by most studies with only the study on the Genetic Counseling Outcome Scale [ 18 ] being rated as good and all other studies receiving poor [ 28 , 30 , 31 , 34 , 36 , 37 , 41 ] or fair ratings [ 16 , 17 , 29 , 32 , 35 , 38 – 40 , 42 – 44 , 46 – 53 ]. Regarding hypothesis testing (box F) studies were either rated as poor [ 16 , 18 , 28 , 30 , 31 , 35 – 38 , 43 , 45 – 47 ] or fair [ 29 , 32 , 33 , 39 – 42 , 49 , 51 – 53 ].…”

“…Structural validity (box E) was also assessed by most studies with only the study on the Genetic Counseling Outcome Scale [ 18 ] being rated as good and all other studies receiving poor [ 28 , 30 , 31 , 34 , 36 , 37 , 41 ] or fair ratings [ 16 , 17 , 29 , 32 , 35 , 38 – 40 , 42 – 44 , 46 – 53 ]. Regarding hypothesis testing (box F) studies were either rated as poor [ 16 , 18 , 28 , 30 , 31 , 35 – 38 , 43 , 45 – 47 ] or fair [ 29 , 32 , 33 , 39 – 42 , 49 , 51 – 53 ]. Testing of cross-cultural validity (box G) was only applicable for five studies, but was rated poor for three of those studies [ 28 , 38 , 41 ] and fair for the other two studies[ 39 , 42 ].…”

“…For interpretability, only four studies reported how missing items were handled [ 18 , 34 , 35 , 44 ]. All four studies excluded responses with more than a minimum percentage of missing items.…”