Artificial intelligence-enhanced care pathway planning and scheduling system: content validity assessment of required functionalities

Abstract

Background Artificial intelligence (AI) and machine learning are transforming the optimization of clinical and patient workflows in healthcare. There is a need for research to specify clinical requirements for AI-enhanced care pathway planning and scheduling systems to improve human–AI interaction in machine learning applications. The aim of this study was to assess content validity and prioritize the most relevant functionalities of an AI-enhanced care pathway planning and scheduling system. Methods A prospective content validity assessment was conducted in five university hospitals in three different countries using an electronic survey. The content of the survey was formed from clinical requirements, which were formulated into generic statements of required AI functionalities. The relevancy of each statement was evaluated using a content validity index. In addition, weighted ranking points were calculated to prioritize the most relevant functionalities of an AI-enhanced care pathway planning and scheduling system. Results A total of 50 responses were received from clinical professionals from three European countries. An item-level content validity index ranged from 0.42 to 0.96. 45% of the generic statements were considered good. The highest ranked functionalities for an AI-enhanced care pathway planning and scheduling system were related to risk assessment, patient profiling, and resources. The highest ranked functionalities for the user interface were related to the explainability of machine learning models. Conclusion This study provided a comprehensive list of functionalities that can be used to design future AI-enhanced solutions and evaluate the designed solutions against requirements. The relevance of statements concerning the AI functionalities were considered somewhat relevant, which might be due to the low level or organizational readiness for AI in healthcare.

Artificial Intelligence in Perioperative Care: Opportunities and Challenges

“…64 Additional source data validation and auditing may be necessary to ensure high-quality and well-annotated data for training and updating artificial intelligence algorithms. 65 After implementation, infrastructure should support continuous assessment of model performance and its impact on clinical practice to avoid unintended adverse effects, also referred to as “algorithmovigilance.” 66 Deployed systems should also enable collaboration and interoperability among different stakeholders, including clinicians, researchers, data scientists, and information technology professionals. 67…”

Profiling of patients with type 2 diabetes based on medication adherence data

“…An interesting intelligent artificial tool that analyses patient health portfolios and supports patient profiling was presented by Gehani and Panda ( 20 ). Machine learning has been used to plan treatment pathways based on patient profiles ( 21 ). In addition to using traditional statistical clustering methods to assess patient profiles in diabetes, preferred communication channels have also been used and it has been shown, that effective interaction between healthcare providers and patients can lead to better treatment outcomes ( 22 ).…”

Künstliche Intelligenz und Robotik in der Chirurgie – aktuelle Innovationsbewertung

“…Der Fachkräftemangel verschärft diese Problematik zusehends und schafft die Notwendigkeit für einen effizienteren Einsatz der verfügbaren Ressourcen. Einige Projekte befassen sich mit dem Management von Patientenströmen und integrieren dabei perspektivisch auch das zu erwartende Auftreten von Notfalleingriffen, die verfügbaren postoperativen Ressourcen, das individuelle Patientenrisiko und die Personalbedarfsplanung[8]. Abb.…”