Online assessment of patients' views on hospital performances using Rasch model's KIDMAP diagram

Chien, Tsair Wei; Wang, Wen Chung; Wang, Hsien Yi; Lin, Hung Jung

doi:10.1186/1472-6963-9-135

Cited by 24 publications

(41 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The person separation reliability (similar to Cronbach alpha) calculated from the original paper [5] was 0.94 (mean 2.64, SD 2.09). Based on this number, the CAT stop rule for measurement of standardized error was determined to be 0.51(SD × sqrt(1 – alpha) = 2.09 × sqrt(1 – 0.94)).…”

Section: Methodsmentioning

confidence: 96%

See 1 more Smart Citation

A Web-Based Computerized Adaptive Testing (CAT) to Assess Patient Perception in Hospitalization

Chien¹,

Wang²,

Huang³

et al. 2011

J Med Internet Res

Self Cite

View full text Add to dashboard Cite

Background Many hospitals have adopted mobile nursing carts that can be easily rolled up to a patient’s bedside to access charts and help nurses perform their rounds. However, few papers have reported data regarding the use of wireless computers on wheels (COW) at patients’ bedsides to collect questionnaire-based information of their perception of hospitalization on discharge from the hospital.Objective The purpose of this study was to evaluate the relative efficiency of computerized adaptive testing (CAT) and the precision of CAT-based measures of perceptions of hospitalized patients, as compared with those of nonadaptive testing (NAT). An Excel module of our CAT multicategory assessment is provided as an example.Method A total of 200 patients who were discharged from the hospital responded to the CAT-based 18-item inpatient perception questionnaire on COW. The numbers of question administrated were recorded and the responses were calibrated using the Rasch model. They were compared with those from NAT to show the advantage of CAT over NAT.Results Patient measures derived from CAT and NAT were highly correlated (r = 0.98) and their measurement precisions were not statistically different (P = .14). CAT required fewer questions than NAT (an efficiency gain of 42%), suggesting a reduced burden for patients. There were no significant differences between groups in terms of gender and other demographic characteristics.Conclusions CAT-based administration of surveys of patient perception substantially reduced patient burden without compromising the precision of measuring patients’ perceptions of hospitalization. The Excel module of animation-CAT on the wireless COW that we developed is recommended for use in hospitals.

show abstract

Section: Methodsmentioning

confidence: 96%

“…Unidimensionality, local independence, item fit, and differential item functioning using the Rasch model to investigate these criteria have been previously reported [5]. …”

Section: Methodsmentioning

confidence: 99%

A Web-Based Computerized Adaptive Testing (CAT) to Assess Patient Perception in Hospitalization

Chien¹,

Wang²,

Huang³

et al. 2011

J Med Internet Res

Self Cite

View full text Add to dashboard Cite

show abstract

“…5) different from the traditional monochrome diagram [35, 36–38] or KIDMAP solely for dichotomous scales [25]. More information has been included in the colorful KIDMAP: all person distributions and dispersions along all items, Z-scores displaying the most unexpected items, and the individual person location points on items suitable for polytomous and continuous variables.…”

Section: Discussionmentioning

confidence: 99%

Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey

Chien

Shao²,

Kuo

2017

BMC Med Res Methodol

Self Cite

View full text Add to dashboard Cite

BackgroundMany continuous item responses (CIRs) are encountered in healthcare settings, but no one uses item response theory’s (IRT) probabilistic modeling to present graphical presentations for interpreting CIR results. A computer module that is programmed to deal with CIRs is required.To present a computer module, validate it, and verify its usefulness in dealing with CIR data, and then to apply the model to real healthcare data in order to show how the CIR that can be applied to healthcare settings with an example regarding a safety attitude survey.MethodsUsing Microsoft Excel VBA (Visual Basic for Applications), we designed a computer module that minimizes the residuals and calculates model’s expected scores according to person responses across items. Rasch models based on a Wright map and on KIDMAP were demonstrated to interpret results of the safety attitude survey.ResultsThe author-made CIR module yielded OUTFIT mean square (MNSQ) and person measures equivalent to those yielded by professional Rasch Winsteps software. The probabilistic modeling of the CIR module provides messages that are much more valuable to users and show the CIR advantage over classic test theory.ConclusionsBecause of advances in computer technology, healthcare users who are familiar to MS Excel can easily apply the study CIR module to deal with continuous variables to benefit comparisons of data with a logistic distribution and model fit statistics.Electronic supplementary materialThe online version of this article (doi:10.1186/s12874-016-0276-2) contains supplementary material, which is available to authorized users.

show abstract

“…CAT, which is based on Item Response Theory (IRT), is a test administration method that tailors the assessment to the latent-trait level of the examinee (Cella, Gershon, Lai, & Choi, 2007;Jette, Haley, Ni, Olarsch, & Moed, 2008;Lord, 1990). CAT has attracted much attention because of its better control of item exposure and lower cost of item development (Chien, Wang, Wang & Lin, 2009;Jette et al, 2008). CAT overcomes the shortcomings of the two traditional forms of standardized assessments, both the burdens associated with lengthy assessments and the loss of precision and reliability of shorter fixed-form assessments.…”

Section: Introductionmentioning

confidence: 99%

Computerized Adaptive Assessment of Organizational Climate

et al. 2016

View full text Add to dashboard Cite

Título: Evaluación adaptativa informatizada del clima organizacional. Resumen: Los Tests Adaptativos Informatizados (CAT) constituyen un gran avance en el campo de la evaluación de las ciencias sociales y de la salud. Es interesante incorporar este desarrollo metodológico al campo de la psicología organizacional. El objetivo de esta investigación es desarrollar un CAT para evaluar el clima organizacional. Para ello, se construyó un banco de 160 ítems, que se administró a una muestra de 3163 trabajadores (M = 51,90 años; DT = 6,28 años). Los resultados muestran que el CAT funciona de manera eficiente para los tres bancos de ítems utilizados (150, 130 y 50 ítems). La función de información muestra que el rasgo latente se mide con una precisión similar en todo el rango de valores. La correlación entre las puntuaciones obtenidas con el CAT, los tres bancos de ítems y la escala CLIOR de clima organizacional fue superior a 0,90 en todos los casos (ET <0,32). Con una precisión fiajada en ET <0,32, el CAT de 150 ítems utiliza una media de 22,5 ítems (DT = 13,5). El CAT desarrollado permite una evaluación útil y precisa del clima organizacional en contextos organizacionales. Palabras clave: clima organizacional, tests adaptativos informatizados, teoría de respuesta a los ítems, evaluación. Abstract:Computerized Adaptive Tests (CAT) constitutes a major advance in the field of the assessment of social sciences and health. It is interesting to incorporate this methodological development to organizational field. The objective of this research is to develop a CAT for evaluating the organizational climate. In order to do this, a bank of 160 items was constructed, which was administered to a sample of 3,163 workers (M age= 51.90 years; SD= 6.28 years). The results show that the CAT works efficiently for the three item banks used (150, 130 and 50 items). The information function shows that the latent trait in the whole range of values is measured with similar accuracy. The correlation between the scores obtained with the CAT, the three item banks and the CLIOR scale of organizational climate was higher than .90 in all cases (SE<0.32). With a SE< 0.32, the 150 item CAT uses a mean of 22.5 items (SD = 13.5 items). The CAT developed allows an accuracy and useful assessment of the organizational climate on organizational settings and research.

show abstract

Online assessment of patients' views on hospital performances using Rasch model's KIDMAP diagram

Cited by 24 publications

References 25 publications

A Web-Based Computerized Adaptive Testing (CAT) to Assess Patient Perception in Hospitalization

A Web-Based Computerized Adaptive Testing (CAT) to Assess Patient Perception in Hospitalization

Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey

Computerized Adaptive Assessment of Organizational Climate

Contact Info

Product

Resources

About