Gender Recognition from Human-Body Images Using Visible-Light and Thermal Camera Videos Based on a Convolutional Neural Network for Image Feature Extraction

Nguyen, Dat Tien; Kim, Ki Wan; Hong, Hyung Gil; Koo, Ja Hyung; Kim, Min Cheol; Park, Kang Ryoung

doi:10.3390/s17030637

Cited by 38 publications

(32 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Third, we only analyzed the conventional methods for feature calculation. Some more advanced features, which many ongoing studies have focused, were not investigated in discriminating HER2 2+ status, such as Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), Histogram of Oriented Gradient (HOG), Local Binary Pattern (LBP), Local Self Similarity (LSS) (58)(59)(60). Meanwhile, because each kind of feature has its own limitations, a consensus was reached that no single feature has a perfect performance in radiomic analysis.…”

Section: Discussionmentioning

confidence: 99%

Texture Analysis of Breast DCE-MRI Based on Intratumoral Subregions for Predicting HER2 2+ Status

Yin

2020

Front. Oncol.

View full text Add to dashboard Cite

Background: Breast tumor heterogeneity is related to risk factors that lead to aggressive tumor growth; however, such heterogeneity has not been thoroughly investigated.Purpose: To evaluate the performance of texture features extracted from heterogeneity subregions on subtraction MRI images for identifying human epidermal growth factor receptor 2 (HER2) 2+ status of breast cancers.Materials and Methods: Seventy-six patients with HER2 2+ breast cancer who underwent dynamic contrast-enhanced magnetic resonance imaging were enrolled, including 42 HER2 positive and 34 negative cases confirmed by fluorescence in situ hybridization. The lesion area was delineated semi-automatically on the subtraction MRI images at the second, fourth, and sixth phases (P-1, P-2, and P-3). A regionalization method was used to segment the lesion area into three subregions (rapid, medium, and slow) according to peak arrival time of the contrast agent. We extracted 488 texture features from the whole lesion area and three subregions independently. Wrapper, least absolute shrinkage and selection operator (LASSO), and stepwise methods were used to identify the optimal feature subsets. Univariate analysis was performed as well as support vector machine (SVM) with a leave-one-out-based cross-validation method. The area under the receiver operating characteristic curve (AUC) was calculated to evaluate the performance of the classifiers.Results: In univariate analysis, the variance from medium subregion at P-2 was the best-performing feature for distinguishing HER2 2+ status (AUC = 0.836); for the whole lesion region, the variance at P-2 achieved the best performance (AUC = 0.798). There was no significant difference between the two methods (P = 0.271). In the machine learning with SVM, the best performance (AUC = 0.929) was achieved with LASSO from rapid subregion at P-2; for the whole region, the highest AUC value was 0.847 obtained at P-2 with LASSO. The difference was significant between the two methods (P = 0.021). Conclusion:The texture analysis of heterogeneity subregions based on intratumoral regionalization method showed potential value for recognizing HER2 2+ status in breast cancer.

show abstract

Section: Discussionmentioning

confidence: 99%

Texture Analysis of Breast DCE-MRI Based on Intratumoral Subregions for Predicting HER2 2+ Status

Yin

2020

Front. Oncol.

View full text Add to dashboard Cite

show abstract

“…The deep learning framework has shown very high classification accuracies compared to handcrafted features on many computer vision systems and has been successfully applied to various computer vision problems such as image classification [ 24 , 25 , 26 , 27 ], object detection [ 28 , 29 ], and face-based age estimation [ 30 , 31 ]. It has also been used for extracting image features for computer vision systems [ 32 , 33 ]. This method uses the image filtering technique to extract the image features and a neural network to classify the extracted image features into several desired classes.…”

Section: Introductionmentioning

confidence: 99%

Combining Deep and Handcrafted Image Features for Presentation Attack Detection in Face Recognition Systems Using Visible-Light Camera Sensors

Nguyen

Pham

Baek

et al. 2018

Sensors

View full text Add to dashboard Cite

Although face recognition systems have wide application, they are vulnerable to presentation attack samples (fake samples). Therefore, a presentation attack detection (PAD) method is required to enhance the security level of face recognition systems. Most of the previously proposed PAD methods for face recognition systems have focused on using handcrafted image features, which are designed by expert knowledge of designers, such as Gabor filter, local binary pattern (LBP), local ternary pattern (LTP), and histogram of oriented gradients (HOG). As a result, the extracted features reflect limited aspects of the problem, yielding a detection accuracy that is low and varies with the characteristics of presentation attack face images. The deep learning method has been developed in the computer vision research community, which is proven to be suitable for automatically training a feature extractor that can be used to enhance the ability of handcrafted features. To overcome the limitations of previously proposed PAD methods, we propose a new PAD method that uses a combination of deep and handcrafted features extracted from the images by visible-light camera sensor. Our proposed method uses the convolutional neural network (CNN) method to extract deep image features and the multi-level local binary pattern (MLBP) method to extract skin detail features from face images to discriminate the real and presentation attack face images. By combining the two types of image features, we form a new type of image features, called hybrid features, which has stronger discrimination ability than single image features. Finally, we use the support vector machine (SVM) method to classify the image features into real or presentation attack class. Our experimental results indicate that our proposed method outperforms previous PAD methods by yielding the smallest error rates on the same image databases.

show abstract

“…The use of high-dimensional feature vectors increases the processing time of SVM and makes the SVM classifier become complex. To overcome this problem, we propose the use of the PCA method for dimensionality reduction of feature space before using the SVM for classification [ 48 ].…”

Section: Proposed Methods For Pad Based On Cnn With Transfer Learnimentioning

confidence: 99%

Spoof Detection for Finger-Vein Recognition System Using NIR Camera

Nguyen

Yoon

Pham

et al. 2017

Sensors

View full text Add to dashboard Cite

Finger-vein recognition, a new and advanced biometrics recognition method, is attracting the attention of researchers because of its advantages such as high recognition performance and lesser likelihood of theft and inaccuracies occurring on account of skin condition defects. However, as reported by previous researchers, it is possible to attack a finger-vein recognition system by using presentation attack (fake) finger-vein images. As a result, spoof detection, named as presentation attack detection (PAD), is necessary in such recognition systems. Previous attempts to establish PAD methods primarily focused on designing feature extractors by hand (handcrafted feature extractor) based on the observations of the researchers about the difference between real (live) and presentation attack finger-vein images. Therefore, the detection performance was limited. Recently, the deep learning framework has been successfully applied in computer vision and delivered superior results compared to traditional handcrafted methods on various computer vision applications such as image-based face recognition, gender recognition and image classification. In this paper, we propose a PAD method for near-infrared (NIR) camera-based finger-vein recognition system using convolutional neural network (CNN) to enhance the detection ability of previous handcrafted methods. Using the CNN method, we can derive a more suitable feature extractor for PAD than the other handcrafted methods using a training procedure. We further process the extracted image features to enhance the presentation attack finger-vein image detection ability of the CNN method using principal component analysis method (PCA) for dimensionality reduction of feature space and support vector machine (SVM) for classification. Through extensive experimental results, we confirm that our proposed method is adequate for presentation attack finger-vein image detection and it can deliver superior detection results compared to CNN-based methods and other previous handcrafted methods.

show abstract

Gender Recognition from Human-Body Images Using Visible-Light and Thermal Camera Videos Based on a Convolutional Neural Network for Image Feature Extraction

Cited by 38 publications

References 41 publications

Texture Analysis of Breast DCE-MRI Based on Intratumoral Subregions for Predicting HER2 2+ Status

Texture Analysis of Breast DCE-MRI Based on Intratumoral Subregions for Predicting HER2 2+ Status

Combining Deep and Handcrafted Image Features for Presentation Attack Detection in Face Recognition Systems Using Visible-Light Camera Sensors

Spoof Detection for Finger-Vein Recognition System Using NIR Camera

Contact Info

Product

Resources

About