Development and Evaluation of CAHPS Questions to Assess the Impact of Health Information Technology on Patient Experiences With Ambulatory Care

Abstract

Background Little is known about whether health information technology (HIT) affects patient experiences with health care. Objective To develop HIT questions that assess patients care experiences not evaluated by existing ambulatory CAHPS measures. Research Design We reviewed published articles and conducted focus groups and cognitive testing to develop survey questions. We collected data, using mail and the internet, from patients of 69 physicians receiving care at an academic medical center and two regional integrated delivery systems in late 2009 and 2010. We evaluated questions and scales about HIT using factor analysis, item-scale correlations, and reliability (internal consistency and physician-level) estimates. Results We found support for three HIT composites: doctor use of computer (2 items), e-mail (2 items), and helpfulness of provider’s website (4 items). Corrected item-scale correlations were 0.37 for the two doctor use of computer items and 0.71 for the two e-mail items, and ranged from 0.50 to 0.60 for the provider’s website items. Cronbach’s alpha was high for e-mail (0.83) and provider’s website (0.75), but only 0.54 for doctor use of computer. As few as 50 responses per physician would yield reliability of 0.70 for e-mail and provider’s website. Two HIT composites, doctor use of computer (p<0.001) and provider’s website (p=0.02), were independent predictors of overall ratings of doctors. Conclusions New CAHPS HIT items were identified that measure aspects of patient experiences not assessed by the CAHPS C&G 1.0 survey.

Is There a Relationship Between Patient Satisfaction and Favorable Surgical Outcomes?

“…One study assessed the relationship between health information technology (HIT) and patient satisfaction scores in groups of patients seeing specialists and primary care providers. 24 Four factors were found to be highly associated with favorable scores on the physician communication domain: ability to have questions answered in a timely manner through email, ability to an make appointments by email, physician use of a computer, and a provider website.…”

Development of and Field Test Results for the CAHPS PCMH Survey

“…The 3-item composite from the CAHPS Health Information Technology (Health IT) survey is recommended as a supplemental set of items where access to and use of e-mail for advice are more salient. 17…”

Effect of a post-paid incentive on response rates to a web-based survey

“…My Health Manager is a sophisticated patient portal that supports secure communication with physicians and other providers (including pharmacy staff), appointment setting, access to a personal medical records, test results, and pharmacy information, provision of health care reminders, and tools for requesting prescription refills. Patients had to have had either visited or emailed 1 of 30 primary care providers in the study within the prior 12 months (McInnes et al 2012). …”