Validation of text-mining and content analysis techniques using data collected from veterinary practice management software systems in the UK

Abstract

Electronic patient records from practice management software systems have been used extensively in medicine for the investigation of clinical problems leading to the creation of decision support frameworks. To date, technologies that have been utilised for this purpose such as text mining and content analysis have not been employed significantly in veterinary medicine.The aim of this research was to pilot the use of content analysis and text-mining software for the synthesis and analysis of information extracted from veterinary electronic patient records. The purpose of the work was to be able to validate this approach for future employment across a number of practices for the purposes of practice based research. The approach utilised content analysis (Prosuite) and text mining (WordStat) software to aggregate the extracted text. Text mining tools such as Keyword in Context (KWIC) and Keyword Retrieval (KR) were employed to identify specific occurrences of data across the records. Two different datasets were interrogated, a bespoke test dataset that had been set up specifically for the purpose of the research, and a functioning veterinary clinic dataset that had been extracted from one veterinary practice.Across both datasets, the KWIC analysis was found to have a high level of accuracy with the search resulting in a sensitivity of between 85.3-100%, a specificity of between 99.1-99.7%, a positive predictive value between 93.5-95.8% and a negative predictive value between 97.7-100%. The KR search, based on machine learning, was utilised for the clinic-based dataset and was found to perform slightly better than the KWIC analysis.This study is the first to demonstrate the application of content analysis and text mining software for validation purposes across a number of different datasets for the purpose of search and recall of specific information across electronic patient records. This has not been demonstrated previously for small animal veterinary epidemiological research for the purposes of large scale analysis for practice-based research. Extension of this work to investigate more complex diseases across larger populations is required to fully explore the use of this approach in veterinary practice.

Differentiated Visions: How Ontario Universities See and Represent Their Futures

“…KWIC utilises a combination of quantitative and qualitative textual analysis by capturing the frequency of key words used in texts and documenting and analysing the context of their use (Leech & Onwuegbuzie, 2008). The methodology has a high level of accuracy (Jones-Diette et al, 2019), and is especially useful for comparing the contents across documents (Hermann et al, 2020), which is, in part, the goal of our analysis. For example, a search for the word 'teaching' across all SMA documents permits exploration of the frequency with which teaching was discussed in each document.…”

Project Coordinators’ Perceptions according to the Organization Structure to Reduce Communication Risks in Multinational Project

“…The obtained interview data script were analyzed through text-mining based on R Studio, a type of qualitative analysis. Text-mining is based on data-mining and proceeds via computer algorithms, which overcomes the reliability issue induced by content analysis (Aureli, 2017;Jones-Diette et al, 2019). Unlike quantitative analyses, text mining can help extract valuable knowledge of interest from unstructured information from the observed patterns (Xue et al, 2022).…”

A call to action for veterinarians and partners in animal health to collect antimicrobial use data for the purposes of supporting medical decision-making and antimicrobial stewardship

“…These techniques have been used to characterize AMU in equine and small animal practice. [22][23][24][25][26] However, the use of natural language-processing and text-mining techniques are not well validated or easy to use, so the need for interoperability still exists. In addition, the need to identify or align standard and nonstandard terminology will also not be eliminated by the use of advanced informatics technologies.…”