A Multidimensional Tool Based on the eHealth Literacy Framework: Development and Initial Validity Testing of the eHealth Literacy Questionnaire (eHLQ)

Abstract

BackgroundFor people to be able to access, understand, and benefit from the increasing digitalization of health services, it is critical that services are provided in a way that meets the user’s needs, resources, and competence.ObjectiveThe objective of the study was to develop a questionnaire that captures the 7-dimensional eHealth Literacy Framework (eHLF).MethodsDraft items were created in parallel in English and Danish. The items were generated from 450 statements collected during the conceptual development of eHLF. In all, 57 items (7 to 9 items per scale) were generated and adjusted after cognitive testing. Items were tested in 475 people recruited from settings in which the scale was intended to be used (community and health care settings) and including people with a range of chronic conditions. Measurement properties were assessed using approaches from item response theory (IRT) and classical test theory (CTT) such as confirmatory factor analysis (CFA) and reliability using composite scale reliability (CSR); potential bias due to age and sex was evaluated using differential item functioning (DIF).ResultsCFA confirmed the presence of the 7 a priori dimensions of eHLF. Following item analysis, a 35-item 7-scale questionnaire was constructed, covering (1) using technology to process health information (5 items, CSR=.84), (2) understanding of health concepts and language (5 items, CSR=.75), (3) ability to actively engage with digital services (5 items, CSR=.86), (4) feel safe and in control (5 items, CSR=.87), (5) motivated to engage with digital services (5 items, CSR=.84), (6) access to digital services that work (6 items, CSR=.77), and (7) digital services that suit individual needs (4 items, CSR=.85). A 7-factor CFA model, using small-variance priors for cross-loadings and residual correlations, had a satisfactory fit (posterior productive P value: .27, 95% CI for the difference between the observed and replicated chi-square values: −63.7 to 133.8). The CFA showed that all items loaded strongly on their respective factors. The IRT analysis showed that no items were found to have disordered thresholds. For most scales, discriminant validity was acceptable; however, 2 pairs of dimensions were highly correlated; dimensions 1 and 5 (r=.95), and dimensions 6 and 7 (r=.96). All dimensions were retained because of strong content differentiation and potential causal relationships between these dimensions. There is no evidence of DIF.ConclusionsThe eHealth Literacy Questionnaire (eHLQ) is a multidimensional tool based on a well-defined a priori eHLF framework with robust properties. It has satisfactory evidence of construct validity and reliable measurement across a broad range of concepts (using both CTT and IRT traditions) in various groups. It is designed to be used to understand and evaluate people’s interaction with digital health services.

Environment and health: Risk perception and its determinants among Italian university students

“…The growing complexity of health-related information scenarios has led to further distinctions, defining e-health literacy (Kayser et al, 2018) and health literacy related to specific topics such as vaccine health literacy or environmental health literacy (Finn and O'Fallon, 2017). In studies where measurements of health literacy have been included in surveys on attitudes and perceptions, they were found to be strongly related to knowledge, health behaviors, health outcomes and medical costs (Institute of Medicine, 2004;Berkman et al, 2011;Kickbusch et al, 2013).…”

Measures of eHealth Literacy: Options for the Malaysian Population

“…The most significant use of the eHLF in current research is its use in the development and validation of the eHealth Literacy Questionnaire (eHLQ). Kayser et al (2018) produced and validated the eHLQ based on the seven domains of the eHLF. This instrument will be discussed in the coming sections.…”

“…Not long after the DHLI was published, Kayser et al (2018) presented their own eHealth literacy instrument that was constructed based on the eHLF by Norgaard et al (2015). Kayser et al (2018) began with the statements gathered in the workshops conducted by Norgaard et al (2015) and performed various consultations with international communities to ensure that the items would be applicable in different settings. The researchers were also careful to simultaneously construct the instrument in Danish and English to ensure that it would be easy to translate into different languages.…”

“…The initial version of the eHLQ contained 57 items with a 4-point response scale. After reliability and validation testing through confirmatory factor analysis, Kayser et al (2018) successfully produced a 37 item questionnaire to measure the seven dimensions in the eHLF: 1) using technology to process health information, 2) understanding of health concepts and language, 3) ability to actively engage with digital services, 4) feel safe and in control, 5) motivated to engage with digital services, 6) access to digital services that work; and 7) digital services that suit individual needs. Each of the dimensions contained four to six items.…”

Skills and characteristics of the e-health literate patient

“…To advance healthcare quality and access, while avoiding a digital divide, we need to understand users’ knowledge, skills, and experiences of current and emerging systems. A new measure of e-health literacy has been developed for this purpose 5. We need to revise and plan health professional training not just to respond to changing technology but to co-design both the development and implementation with patients and technology developers.…”