OBJECTIVE-In 1995, the Agency for Health Care Policy and Research initiated the Consumer Assessments of Healthcare Providers and Systems (CAHPS) project to develop and evaluate survey protocols for collecting reliable and valid assessments of health care from consumers. CAHPS surveys are used throughout the United States for evaluating ambulatory and hospital care experiences, including a version for assessing pediatric ambulatory care; however, pediatric experts thought that the existing pediatric instruments did not adequately assess developmental and preventive care. The objective of this study was to develop and test an Ambulatory Pediatric CAHPS survey that focuses on clinicians and groups and includes measures of developmental and preventive care.METHODS-To develop the survey, we conducted 2 focus groups and conducted 9 cognitive interviews. We conducted a telephone pretest with 20 parents and coded potential problems with the interview (behavioral coding). We conducted a dual-language field test of the instrument with 670 parents who reported about their children's ambulatory care. We used data from that survey to assess the reliability and validity of the measures.RESULTS-Questions about developmental monitoring and preventive care were developed and tested. Two scales that were based on those new questions had good internal consistency (coefficient α) and interphysician reliability. A consortium of CAHPS investigators and federal sponsors have approved the resulting instrument as a national measure of pediatric care.
CONCLUSIONS-
METHODS
Questionnaire DevelopmentTo develop the new questions, we followed a protocol similar to that used to develop other CAHPS surveys. 13,14,17 That included conducting focus groups, cognitive testing of draft survey questions, telephone pretesting of questions, translation of the questions into Spanish, and field-testing of the survey. One of the goals of the study was to learn about the relative efficacy of 3 modes of data collection: mail, telephone, and Internet-based. Thus, we conducted a randomized assessment of different data collection protocols.
Focus GroupsWe conducted 2 focus groups about parents' perspectives on the developmental and preventive care provided to their children. One group was conducted with English-only speakers and a second with bilingual Spanish/English parents. Participants were primarily mothers; only 3 of the 14 participants were fathers. They were a racially diverse group: 21% white, 21% black, and 50% Latina (some declined to select a race/ethnicity category). Their children ranged in age from 2 to 17 years.Each focus group was a semistructured discussion about the main topics covered by the Ambulatory Pediatric CAHPS instrument. Overall, both groups had a similar understanding of the concepts discussed: experiences with getting health care, preventive care, behavioral and cognitive development, referral to critical child development services, family issues and interactions with other children, shared decision-making, knowledge of ...