Development and empirical user-centered evaluation of semantically-based query recommendation for an electronic health record search engine

Abstract

Objective The utility of biomedical information retrieval environments can be severely limited when users lack expertise in constructing effective search queries. To address this issue, we developed a computer-based query recommendation algorithm that suggests semantically interchangeable terms based on an initial user-entered query. In this study, we assessed the value of this approach, which has broad applicability in biomedical information retrieval, by demonstrating its application as part of a search engine that facilitates retrieval of information from electronic health records (EHRs). Materials and Methods The query recommendation algorithm utilizes MetaMap to identify medical concepts from search queries and indexed EHR documents. Synonym variants from UMLS are used to expand the concepts along with a synonym set curated from historical EHR search logs. The empirical study involved 33 clinicians and staff who evaluated the system through a set of simulated EHR search tasks. User acceptance was assessed using the widely used technology acceptance model. Results The search engine's performance was rated consistently higher with the query recommendation feature turned on vs. off. The relevance of computer-recommended search terms was also rated high, and in most cases the participants had not thought of these terms on their own. The questions on perceived usefulness and perceived ease of use received overwhelmingly positive responses. A vast majority of the participants wanted the query recommendation feature to be available to assist in their day-to-day EHR search tasks. Discussion and Conclusion Challenges persist for users to construct effective search queries when retrieving information from biomedical documents including those from EHRs. This study demonstrates that semantically-based query recommendation is a viable solution to addressing this challenge.

Google Medical Update: Why Is the Search Engine Decreasing Visibility of Health and Medical Information Websites?

“…Baidu is popular in China because of the general unavailability of Google in the country. In a few studies, researchers built [29], prepared [30], or used [31] specialized medical search engines and tested how the results were perceived by users.…”

A relevance and quality-based ranking algorithm applied to evidence-based medicine

“…To the best of our knowledge, little research similar to ours can be found, apart from the study used as a comparison [18] . Some other specific systems can be found for searching for literature on Medicine, but they focus on other types of documents, such as Personal Health Records [38][39][40] , or fields like Precision Medicine which requires specific information about, for example, the patient: diseases, genes and mutations, etc. [41] The main drawback of the algorithm described is the extra time necessary to compute the quality-based step with respect to other more optimized systems only based on textual characteristics.…”

Assessment of Electronic Health Record Search Patterns and Practices by Practitioners in a Large Integrated Health Care System

“…Although the search feature is a key tool for efficiently retrieving information from the mass of EHR data, we identified several uses of the search feature that seem to be forced inefficiencies 37 retrieving synonyms and abbreviations, as well as related clinical information. 38,39 The present study contributes to the scant literature on EHR searching, which focuses primarily on homegrown solutions for searching within or across patient records. 16,17,23,40 One of the only prior studies 16 of searches within patient records included 2207 EHR searches by 436 unique users at a single institution and found that the most common searches were for laboratory or test results.…”