BACKGROUND
Electronic patient portals are secure websites tied to an institutional electronic health record system from which patients can view their medical information. These types of records are populated with a person’s lifetime health history. Despite the continuing extensive research in this area, measuring patient portal impact continues to be a convoluted process.
OBJECTIVE
To explore what is known about patient portal evaluations and provide recommendations for future endeavours. The focus was on mapping what measures are used to assess the impact of patient portals on the four specific dimensions (patient, population, healthcare workforce, and health system perspectives) of the Quadruple Aim Framework, and what components from the Benefits Evaluation Framework were most commonly evaluated to measure impact.
METHODS
A scoping review was conducted using the methodological framework of Arksey and O’Malley. Reporting was guided by Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews. A systematic and comprehensive search using the OVID platform, the following databases were searched: Ovid MEDLINE® ALL, including Epub Ahead of Print, In-Process & Other Non-Indexed Citations, Embase, and PsycINFO. CINAHL on the Ebsco platform and Web of Science were also searched for studies published between 2015 and June 2020. A systematic grey literature search was conducted using the Google search engine in Edmonton, Alberta, Canada between February 13 and February 25, 2020. A data extraction form was developed and reviewed to categorize the literature into themes and areas of interest, which varied by study type. Two frameworks for analysis were incorporated, the Quadruple Aim and the Canada Health Infoway’s Benefits Evaluation Frameworks. Extracted data were tabulated based on a coding template developed to categorize the literature into themes and areas of interest, which varied by study type and QA perspective. Furthermore, the evaluated patient portal functions were mapped onto the Benefits Evaluation Framework. A descriptive, analytical approach was used to summarize the outcomes of the studies. In addition, a list of the various terms/outcomes/variables that were used to describe ‘impact’ was compiled.
RESULTS
In total, 96 studies were included for data extraction. The studies were categorized based on the Quadruple Aim dimensions, with strict adherence to the definitions for each dimension(1,2). From the patient perspective, we identified that most evaluations focused on benefits and barriers to access, access to test results, medication adherence, condition management, medical notes, and secure messaging. From the population perspective, the evaluations focused on increase in population outreach, decrease in disparities related to access of care services, and improvement in quality of care. From the healthcare workforce perspective, the evaluations focused on impact of patients accessing medical records, impact on workflow, impact of bi-directional secure messaging, and virtual care. From the health system perspective, the evaluations focused on decrease in no-show appointments, impact on office visits and telephone calls, impact on admission and readmission rates and emergency department visits, and impact on healthcare utilization. Altogether, 77 peer-reviewed studies were mapped on the expanded version of the BE Framework. The mapping was done by sub-dimension to create a more precise representation about the areas that are currently explored when studying patient portals. Most of the studies evaluated more than one sub-dimension.
CONCLUSIONS
Despite the extensive and existing research in the area of patient portals, the evidence from this scoping review suggests that impact research is available, but it lacks multidimensionality. The Quadruple Aim and the Benefits Evaluation Frameworks provided guidance in identifying the gaps in the current literature by providing a way to show how impact was assessed. This review highlights the need to appropriately plan how impact will be assessed and how the findings will be translated into effective adaptations. If the how and what are not properly planned, the generalizability of patient portals studies will continue to elude researchers and implementation teams.