Comparison of Fully Convolutional Networks (FCN) and U-Net for Road Segmentation from High Resolution Imageries

Abstract

Segmentation is one of the most popular classification techniques which still have semantic labels. In this context, the segmentation of different objects such as cars, airplanes, ships, and buildings that are independent of background and objects such as land use and vegetation classes, which are difficult to discriminate from the background is considered. However, in image segmentation studies, various difficulties such as shadow, image blockage, a disorder of background, lighting, shading that cause fundamental modifications in the appearance of features are often encountered. With the development of technology, obtaining high spatial resolution satellite imageries and aerial photographs contain detailed texture information have been facilitated easily. Parallel to these improvements, deep learning architectures have widely been used to solved several computer vision tasks with an increasing level of difficulty. Thus, the regional characteristics, artificial and natural objects, can be perceived and interpreted precisely. In this study, two different subset data that were produced from a great open-source labeled image sets were used to segmentation of roads. The used labeled data set consists of 150 satellite images of size 1500 x 1500 pixels at a 1.2 m resolution, which was not efficient for training. In order to avoid any problem, the imageries were divided into smaller dimensions. Selected images from the data set divided into small patches of 256 x 256 pixels and 512 x 512 pixels to train the system, and comparisons between them were carried out. To train the system using these datasets, two different artificial neural network architectures U-Net and Fully Convolutional Networks (FCN), which are used for object segmentation on high-resolution images, were selected. When the test data with the same size as the training data set were analyzed, approximately 97% extraction accuracy was obtained from high-resolution imageries trained by FCN in 512 x 512 dimensions.

SlypNet: Spikelet-based yield prediction of wheat using advanced plant phenotyping and computer vision techniques

“…Therefore, it is a prerequisite to obtaining the total number of spikelets (present in a zigzag pattern) in each spike. Mostly semantic segmentation (U-Nets and FCNs) is used for this type of object detection ( Ozturk et al, 2020 ), and at the same time, in the case of using small dimensional input data, U-Net performed better than FCN. Therefore, a set of architectures of U-Net models were used to detect the spikelet in the spikes.…”

Improving Depth Estimation by Embedding Semantic Segmentation: A Hybrid CNN Model

“…This is a 2D CNN with layers ordered as an auto-encoder architecture. We selected this model because it has shown good results in previous semantic segmentation works [22,23]. Additionally, it can also be adapted to any input and output size.…”

A modified DeepLabV3+ based semantic segmentation of chest computed tomography images for COVID‐19 lung infections

“… 21 , 22 This detailed pixel‐level understanding plays a key role for numerous AI based systems that include scene understanding, human‐machine interaction, medical image analysis, and autonomous driving. 21 , 23 , 24 In the medical field, the SS can help to detect and assess the severity of the disease. The overall methodology of SS approach is to design a structure that extracts features through successive convolutions (encoder part) and uses that information to create a segmentation map as a segmented map (decoder part).…”

“…It is a crucial part of the image processing task and allows pixel‐wise understanding of the whole image 21,22 . This detailed pixel‐level understanding plays a key role for numerous AI based systems that include scene understanding, human‐machine interaction, medical image analysis, and autonomous driving 21,23,24 . In the medical field, the SS can help to detect and assess the severity of the disease.…”