P1465Artificial intelligence in echocardiography - Steps to automatic cardiac measurements in routine practice

Abstract

Introduction The growth of artificial intelligence (AI) use in echocardiography over the past years has been exponential, proposing new paths to overcome inter-operator variability and experience of the operator. Even though the applications of AI are still in their infancy within the field of echocardiography, the potential of AI implies future directions and is eager to assist for accuracy and efficiency of manual tracings. Deep learning, a subset of machine learning algorithms, is gaining popularity in echocardiography as a state of the art in visual data analysis. Purpose To evaluate deep learning for two initial tasks in automated cardiac measurements: view recognition and end-systolic (ES) and end-diastolic (ED) frame detection. Methods A total of 230 patients' (with various indications for study) 2D echocardiography data was used to train and validate neural networks. Raw pixel data was extracted from EPIQ 7G, Vivid E95 and Vivid 7 imaging platforms. Images were labeled according to their view: parasternal long axis (PLA), basal short axis, short axis at mitral level, apical two, three and four chambers (A4C). Additionally, ES and ED frames were labeled for A4C and PLA views. Images were de-identified by applying black pixel masks to non-anatomical data and removing metadata. Convolutional Neural Network (CNN) architecture was used for the classification of 6 different views. A total of 34752 and 3972 (5792 and 662 per view) frames were used to train and validate the network, respectively. Long-term Recurrent Convolutional Network (LRCN) combining temporal and spatial cognition was used for ES and ED frame detection. A total of 195 and 35 sequences with a length of 92 frames were used to train the LRCN. Results CNN for view classification had an AUC of 0.95 (sensitivity 95%, specificity 97%). Accuracy was lower for visually similar views, namely apical three-chamber and apical two-chamber. Training for ES and ED detection was achieved when training LRCN for regression instead of classification of each frame. LRCN for cardiac cycle evaluation had an average Framed Difference (aFD) of 2.31 (SD±2.15) for ED and 1.97 (SD±2.04) frames for ES detection which corresponds to error rate of about 0.04 s. Conclusion Determining echocardiographic view and evaluating cardiac cycle are the first steps in automating cardiac measurements. We have demonstrated the potential of two deep learning algorithms in accomplishing these tasks. Initial results are promising for the development of neural networks for cardiac segmentation and measuring of anatomical structures.

An Accurate and Fast Cardio-Views Classification System Based on Fused Deep Features and LSTM

“…AI generally aims to increase the diagnostic capabilities of echocardiography computer assisted-systems such as detection of pathological cardio-diseases, quantification of cardio-motion [47], and computing echo image quality [48].…”

“…The echocardioviews classification systems were based on traditional features extraction or even spatial CNN features extraction, lack of accuracy, and consumed a lot of processing time [47][48][49]. Therefore, the employment of several deep learning architectures that have successfully increased the video recognition systems is very important to enhance echocardiography views classification systems.…”

Predicting Cardiac Issues From Echocardiograms: A Literature Review Using Deep Learning and Machine Learning Techniques

“…Researchers have recently made strides in employing new technologies, such as Artificial Intelligence (AI), to improve the clinical assessment of echocardiography using echocardiographs [19]. An appealing alternative for early detection and treatment of cardiovascular diseases, especially for lower complexities, is Machine Learning (ML) and Deep Learning (DL) models, which are AI tools that automatically segment and categorize a variety of cardio-pathological disorders.…”

Novel approach for automatic mid‐diastole frame detection in 2D echocardiography sequences for performing planimetry of the mitral valve orifice

“…The real‐time estimation of the cardiac cycle phase was the advantage of the introduced methods of these authors. In [11], the authors evaluated the deep learning algorithms for view recognition and end‐systolic and end‐diastolic frame detection in 2D echocardiography sequences. They demonstrated the potential of the deep learning algorithms in accomplishing the mentioned tasks.…”