Deep Learning-Based Methodology for Recognition of Fetal Brain Standard Scan Planes in 2D Ultrasound Images

Abstract

Two-dimensional ultrasound scanning (US) has become a highly recommended examination in prenatal diagnosis in many countries. Accurate detection of abnormalities and correct fetal brain standard planes is the most necessary precondition for successful diagnosis and measurement. In the past few years, support vector machine (SVM) and other machine learning methods have been devoted to automatic recognition of 2D ultrasonic images, but the performance of recognition is not satisfactory due to the wide diversity of fetal postures, shortage of data, similarities between standard planes and other reasons. Especially in the recognition of fetal brain images, the features of fetal brain images such as shape, texture, color and others are very similar, which presents great challenges to the recognition work. In this study, we proposed two main methods based on deep convolutional neural networks to automatically recognize six standard planes of fetal brains. One is a deep convolutional neural network (CNN), and the other one is CNN-based domain transfer learning. To examine the performance of these algorithms, we constructed two datasets. Dataset 1 consists of 30,000 2D ultrasound images from 155 subjects between 16 and 34 weeks. Dataset 2, containing 1,200 images, was acquired from a research participant throughout 40 weeks, which is the entire pregnancy. Experimental results show that the proposed solutions achieve promising results and that the frameworks based on deep convolutional neural networks generally outperform the ones using other classical deep learning methods, thus demonstrating the great potential of convolutional neural networks in this area. INDEX TERMS Medical image processing, CNN, transfer learning. CHUNXIA DING received the Bachelor of Medicine degree from the Zhangjiakou Medical College, in 2003. She has been engaged in ultrasound diagnosis for 16 years and worked on prenatal screening for more than ten years. She is skilled in gynecology and obstetrics, heart, blood vessels, abdomen, superficial small organs, and neonatal brain, and other conventional diagnosis, prenatal screening, and fetal malformation diagnosis.

Recognition of Thyroid Ultrasound Standard Plane Images Based on Residual Network

“…In the end, they achieved a classification accuracy of 99.5% and an average positioning error of 3.45 mm. Qu et al [ 25 ] proposed a Deep Convolutional Neural Network (DCNN) method to automatically identify six fetal brain standard planes. Through methods such as data enhancement and transfer learning, both datasets obtained good experimental results.…”

Detection and Classification of Pregnancy StateUsing Deep Learning Technique

“…In CNN, image pixels could be straightforwardly utilized as a contribution to the standard feedforward neural networks. Although many pixels from even little image patches bring about an enormous number of association weight boundaries to be prepared, CNN models consolidate loads into a lot more modest bit channels that drastically rearrange the learning model (Qu, Xu, Ding, Jia, & Sun, 2019).In clinical imaging, the most ordinarily utilized deep learning strategies are convolutional neural networks (CNN) Compared features inside the information itself. By and large, CNN are preferable ready to distinguish features over the human eye (Diniz, 2020).…”

Technology trends and applications of deep learning in ultrasonography: image quality enhancement, diagnostic support, and improving workflow efficiency

“…Recognizing the six standard planes in the fetal brain, which is necessary for the accurate detection of fetal brain abnormalities, has also been very difficult due to wide diversity of fetal postures, insufficient data, and similarities between the standard planes. Qu et al [ 82 ] introduced a domain transfer learning method based on deep CNN. This framework generally outperformed those using other classical deep learning methods.…”

“…Fast R-CNN[82], was utilized to recognize the ROI, and ASM[83] identified parameters that best expressed the shape of left ventricle precisely.Recognizing the six standard planes in the fetal brain, required for accurate detection of fetal brain abnormalities, has also been very difficult due to wide diversity of fetal postures, insufficient data, and similarities between standard planes. Qu et al[84] introduced a domain Transfer learning based on deep CNN. The frameworks generally outperformed the ones using other classical deep learning methods.…”