Improving Response Rates and Representation of Hard-to-Reach Groups in Family Experience Surveys

Toomey, Sara L.; Elliott, Marc N.; Zaslavsky, Alan M.; Quinn, Jessica; Klein, David J.; Wagner, Stephanie; Thomson, Cassandra; Wu, Melody; Onorato, Sarah; Schuster, Mark A.

doi:10.1016/j.acap.2018.07.007

Cited by 20 publications

(17 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This may be mainly due to our face-to-face mode for data collection, which usually gains higher response rates than mail or telephone approaches. In addition, we believe that the electronic questionnaire and online survey system helped improve the participation of hard-to-reach groups in our trial, as demonstrated by the similar tablet administration in Japan and the US (18)(19)(20).…”

Section: Discussionmentioning

confidence: 88%

Reliability and validity of an instrument to assess pediatric inpatients’ experience of care in China

Hu¹,

Yuan²,

Ren³

et al. 2021

Transl Pediatr

View full text Add to dashboard Cite

Background: The Child Hospital Consumer Assessment of Healthcare Providers and Systems (Child HCAHPS) is a standard instrument to measure pediatric inpatients' experience of care. Currently, no Chinese version of the Child HCAHPS exists for Chinese patients. Therefore, this study aimed to create a Chinese version of the Child HCAHPS and investigate its validity and reliability in a Chinese setting.Methods: Using the approach recommended in guidelines from the Agency for Healthcare Research and Quality for translating HCAHPS surveys, we produced a Chinese version of the Child HCAHPS. A twomonth field test with seven hospitals across five provinces in China was performed to assess its validity.Construct validity was assessed using confirmatory factor analysis. We evaluated convergent validity by factor loading, average variance extracted (AVE), and construct reliability (CR). Cronbach's alpha and corrected item-total correlation (CITC) were used to reflect hospital-level unit reliabilities for the survey's item composites. The correlation of the measure score with the overall rating was calculated to evaluate criterion validity.Results: An overall response rate of 63% was achieved, and 2,258 respondents completed the questionnaire.Confirmatory factor analysis showed a comparative fit index (CFI) of 0.905, a non-normed fix index of 0.886, and a root mean square error of approximation (RMSEA) of 0.089. Most items had factor loadings over 0.7. Cronbach's alpha coefficient on the overall level was 0.981, and all measures' CITC exceeded 0.6, demonstrating good to excellent hospital-level reliability of the composite and single-item measures. All composite measures had good to excellent internal consistency reliability (0.716 to 0.994). Item-to-composite correlation ranged from 0.510 to 0.997. Composite-to-composite correlations ranged from 0.488 to 0.997.According to the survey result, for all the 18 composite or single-item measures, mean top-box scores ranged from 56% ("Involving teens in care") to 87% ("Informed in Emergency Room"). Conclusions:The Chinese version of the Child HCAHPS demonstrated acceptable validity and reliability.The application of this tool can help benchmark ongoing healthcare improvement initiatives in China.

show abstract

Section: Discussionmentioning

confidence: 88%

Reliability and validity of an instrument to assess pediatric inpatients’ experience of care in China

Hu¹,

Yuan²,

Ren³

et al. 2021

Transl Pediatr

View full text Add to dashboard Cite

show abstract

“…In addition, a recent study showed that over 80% of children completing the CLEFT-Q scales, representing 9 of the 12 PROMs in the Set, liked answering the questions, and felt it made them understand their condition and feelings better (Klassen et al, 2020). The fact that the children get something in return (insight in their own well-being, more individualized care) could be a reason for obtaining relatively high response rates in contrast to the reported email survey response rates of 20% to 40% among adults in literature (Rodriguez et al, 2006;Fowler et al, 2019;Toomey et al, 2019).…”

Section: Discussionmentioning

confidence: 99%

Barriers and Facilitators to the International Implementation of Standardized Outcome Measures in Clinical Cleft Practice

Apon

Rogers-Vizena

Allori

et al. 2021

The Cleft Palate Craniofacial Journal

View full text Add to dashboard Cite

Objective: To identify barriers and facilitators to international implementation of a prospective system for standardized outcomes measurement in cleft care. Design: Cleft teams that have implemented the International Consortium for Health Outcomes Measurement Standard Set for cleft care were invited to participate in this 2-part qualitative study: (1) an exploratory survey among clinicians, health information technology professionals, and project coordinators, and (2) semistructured interviews of project leads. Thematic content analysis was performed, with organization of themes according to the dimensions of the reach, effectiveness, adoption, implementation and maintenance (RE-AIM) framework: reach, effectiveness, adoption, implementation, and maintenance. Results: Four cleft teams in Europe and North America participated in this study. Thirteen participants completed exploratory questionnaires and 5 interviewees participated in follow-up interviews. Survey responses and thematic content analysis revealed common facilitators and barriers to implementation at all sites. Teams reach patients either via email or during the clinic visit to capture patient-reported outcomes. Adopting routine data collection is enhanced by aligning priorities at the organizational and cleft team level. Streamlining workflows and developing an efficient data collection platform are necessary early on, followed by pilot testing or stepwise implementation. Regular meetings and financial resources are crucial for implementing, sustaining, analyzing collected data, and providing feedback to health care professionals and patients. Fostering patient-centered care was articulated as a positive outcome, whereas time presented challenges across all RE-AIM dimensions. Conclusions: Identified themes can inform ongoing implementation efforts. Intentionally investing time to lay a sound foundation early on will benefit every phase of implementation and help overcome barriers such as lack of support or motivation.

show abstract

“…Third, the response rate (35%) was not high. Although it is much higher than that in the U.S. national survey (17.1%) [6], it was lower than those of previously reported surveys using a QR code or special tablet devices (63% and 71%, respectively) [11,27]. Of note, in these previous studies, eligible parents were approached on the day of discharge before they left the hospital, despite the recommendation of the Agency for Healthcare Research and Quality to initiate the survey between 48 h and 6 weeks after discharge.…”

Section: Discussionmentioning

confidence: 63%

Translating and validating the Child HCAHPS survey in Japan: A single-center cross-sectional study

Inata

Nakagami-Yamaguchi²

2022

Preprint

View full text Add to dashboard Cite

Purpose: The Child Hospital Consumer Assessment of Healthcare Providers and Systems Survey (Child HCAHPS) assesses the experiences of pediatric patients and their parents or guardians with inpatient care. This study aimed to develop a Japanese version of the Child HCAHPS and to examine its validity and reliability. Methods: A draft Japanese version of the Child HCAHPS was produced in a conceptually equivalent and culturally appropriate manner. Using the draft Japanese version, the survey was administered using a push-to-web method to eligible parents/guardians of children (aged 0–17 years) discharged from a tertiary children’s hospital in Osaka, Japan in December 2021 through March 2022. Construct validity and internal consistency reliability were tested. Results: Of 1,300 eligible candidates to whom survey invitations were mailed, 460 returned complete surveys (response rate 35%). The validity of a composite “Involving teens in their care” remained unproven. With the remaining composites, however, confirmatory factor analysis showed fair goodness of fit of the same factor structure as that of the original Child HCAHPS (the comparative fit index = 0.92, Tucker-Lewis index = 0.90, and root mean square error of approximation = 0.052). The Cronbach coefficient was close to or above 0.7 for most of the items indicating a good reliability. Conclusions: The Japanese Child HCAHPS demonstrated acceptable psychometric properties for assessing patient and family experiences in a Japanese tertiary children’s hospital. However, several items and composites with suboptimal properties warrant further validation in future multicenter surveys.

show abstract

Improving Response Rates and Representation of Hard-to-Reach Groups in Family Experience Surveys

Cited by 20 publications

References 24 publications

Reliability and validity of an instrument to assess pediatric inpatients’ experience of care in China

Reliability and validity of an instrument to assess pediatric inpatients’ experience of care in China

Barriers and Facilitators to the International Implementation of Standardized Outcome Measures in Clinical Cleft Practice

Translating and validating the Child HCAHPS survey in Japan: A single-center cross-sectional study

Contact Info

Product

Resources

About