Evaluation Framework for Successful Artificial Intelligence–Enabled Clinical Decision Support Systems: Mixed Methods Study

Ji, Mengting; Genchev, Georgi Z.; Huang, Huizhen; Ting, Xu; Lu, Hui; Yu, Guangjun

doi:10.2196/25929

Cited by 29 publications

(18 citation statements)

References 60 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Ford et al [ 81 ] pointed out that many previous CDSSs were not developed with the end user, practice context, or clinical workflow in mind. In addition, previous studies show that user attitudes [ 82 ] and acceptance are central to the success of CDSSs [ 83 , 84 ].…”

Section: Discussionmentioning

confidence: 99%

The Interplay of Work, Digital Health Usage, and the Perceived Effects of Digitalization on Physicians’ Work: Network Analysis Approach

Saukkonen¹,

Elovainio²,

Virtanen³

et al. 2022

J Med Internet Res

View full text Add to dashboard Cite

Background In health care, the benefits of digitalization need to outweigh the risks, but there is limited knowledge about the factors affecting this balance in the work environment of physicians. To achieve the benefits of digitalization, a more comprehensive understanding of this complex phenomenon related to the digitalization of physicians’ work is needed. Objective The aim of this study was to examine physicians’ perceptions of the effects of health care digitalization on their work and to analyze how these perceptions are associated with multiple factors related to work and digital health usage. Methods A representative sample of 4630 (response rate 24.46%) Finnish physicians (2960/4617, 64.11% women) was used. Statements measuring the perceived effects of digitalization on work included the patients’ active role, preventive work, interprofessional cooperation, decision support, access to patient information, and faster consultations. Network analysis of the perceived effects of digitalization and factors related to work and digital health usage was conducted using mixed graphical modeling. Adjusted and standardized regression coefficients are denoted by b. Centrality statistics were examined to evaluate the relative influence of each variable in terms of node strength. Results Nearly half of physicians considered that digitalization has promoted an active role for patients in their own care (2104/4537, 46.37%) and easier access to patient information (1986/4551, 43.64%), but only 1 in 10 (445/4529, 9.82%) felt that the impact has been positive on consultation times with patients. Almost half of the respondents estimated that digitalization has neither increased nor decreased the possibilities for preventive work (2036/4506, 45.18%) and supportiveness of clinical decision support systems (1941/4458, 43.54%). When all variables were integrated into the network, the most influential variables were purpose of using health information systems, employment sector, and specialization status. However, the grade given to the electronic health record (EHR) system that was primarily used had the strongest direct links to faster consultations (b=0.32) and facilitated access to patient information (b=0.28). At least 6 months of use of the main EHR was associated with facilitated access to patient information (b=0.18). Conclusions The results highlight the complex interdependence of multiple factors associated with the perceived effects of digitalization on physicians’ work. It seems that a high-quality EHR system is critical for promoting smooth clinical practice. In addition, work-related factors may influence other factors that affect digital health success. These factors should be considered when developing and implementing new digital health technologies or services for physicians’ work. The adoption of digital health is not just a technological project but a project that changes existing work practices.

show abstract

Section: Discussionmentioning

confidence: 99%

The Interplay of Work, Digital Health Usage, and the Perceived Effects of Digitalization on Physicians’ Work: Network Analysis Approach

Saukkonen¹,

Elovainio²,

Virtanen³

et al. 2022

J Med Internet Res

View full text Add to dashboard Cite

show abstract

“…Maximum SML-based analytics (especially deep learning) relies on access to large datasets for healthcare data analysis, and all supervised learning requires a labeled training set. Access to high-quality labeled data is crucial and difficult to achieved in the implementation and assessment of SML methods for the co-clinical decision-making process [ 108 ]. Creating training labels from known archives data/records requires skilled medical personnel to review patient charts for meaningful label creation.…”

Section: Challenges From the Sml Implementation Sidementioning

confidence: 99%

Demystifying Supervised Learning in Healthcare 4.0: A New Reality of Transforming Diagnostic Medicine

Roy¹,

Meena²,

Lim

2022

Diagnostics

View full text Add to dashboard Cite

The global healthcare sector continues to grow rapidly and is reflected as one of the fastest-growing sectors in the fourth industrial revolution (4.0). The majority of the healthcare industry still uses labor-intensive, time-consuming, and error-prone traditional, manual, and manpower-based methods. This review addresses the current paradigm, the potential for new scientific discoveries, the technological state of preparation, the potential for supervised machine learning (SML) prospects in various healthcare sectors, and ethical issues. The effectiveness and potential for innovation of disease diagnosis, personalized medicine, clinical trials, non-invasive image analysis, drug discovery, patient care services, remote patient monitoring, hospital data, and nanotechnology in various learning-based automation in healthcare along with the requirement for explainable artificial intelligence (AI) in healthcare are evaluated. In order to understand the potential architecture of non-invasive treatment, a thorough study of medical imaging analysis from a technical point of view is presented. This study also represents new thinking and developments that will push the boundaries and increase the opportunity for healthcare through AI and SML in the near future. Nowadays, SML-based applications require a lot of data quality awareness as healthcare is data-heavy, and knowledge management is paramount. Nowadays, SML in biomedical and healthcare developments needs skills, quality data consciousness for data-intensive study, and a knowledge-centric health management system. As a result, the merits, demerits, and precautions need to take ethics and the other effects of AI and SML into consideration. The overall insight in this paper will help researchers in academia and industry to understand and address the future research that needs to be discussed on SML in the healthcare and biomedical sectors.

show abstract

“…Clinical decision support systems (CDSS) are designed to utilize medical data, knowledge, and analysis engines to generate patient-specific assessments or recommendations to health professionals in order to assist decision making ( 27 ). Artificial intelligence can enable CDSS that aid the decision-making process for thyroid diseases through an intelligent component.…”

Section: The Application Of Ai To Laboratory Medicine: Considerations...mentioning

confidence: 99%

Artificial intelligence and thyroid disease management

Gruson

Dabla²,

Stanković

et al. 2022

Biochem. med. (Online)

View full text Add to dashboard Cite

Artificial intelligence (AI) is transforming healthcare and offers new tools in clinical research, personalized medicine, and medical diagnostics. Thyroid function tests represent an important asset for physicians in the diagnosis and monitoring of pathologies. Artificial intelligence tools can clearly assist physicians and specialists in laboratory medicine to optimize test prescription, tests interpretation, decision making, process optimization, and assay design. Our article is reviewing several of these aspects. As thyroid AI models rely on large data sets, which often requires distributed learning from multi-center contributions, this article also briefly discusses this issue.

show abstract

Evaluation Framework for Successful Artificial Intelligence–Enabled Clinical Decision Support Systems: Mixed Methods Study

Cited by 29 publications

References 60 publications

The Interplay of Work, Digital Health Usage, and the Perceived Effects of Digitalization on Physicians’ Work: Network Analysis Approach

The Interplay of Work, Digital Health Usage, and the Perceived Effects of Digitalization on Physicians’ Work: Network Analysis Approach

Demystifying Supervised Learning in Healthcare 4.0: A New Reality of Transforming Diagnostic Medicine

Artificial intelligence and thyroid disease management

Contact Info

Product

Resources

About