Object Removal and Inpainting from Image using Combined GANs

Pyo, Jeong-Won; Rocha, Yuri Goncalves; Ghosh, Arpan; Lee, Kwang-Hee; In, Gun-Gyo; Kuc, Tae-Young

doi:10.23919/iccas50221.2020.9268330

Cited by 3 publications

(1 citation statement)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Color values were calculated via exemplar-based synthesis. Pyo et al [74] suggested utilizing GANs to remove the desired item from an image. They designed the network that combines two GANs: The first GAN removes the target item from the input frame, while the second GAN creates a frame with the backdrop filling up the empty area.…”

Section: Object Removalmentioning

confidence: 99%

Pareto Optimized Large Mask Approach for Efficient and Background Humanoid Shape Removal

et al. 2023

View full text Add to dashboard Cite

We introduce deep learning-based methodology for removing unwanted human-like shapes in videos. The method uses Pareto-optimized Generative Adversarial Networks (GANs) technology, which is a novel contribution. The system automatically selects the Region of Interest (ROI) for each humanoid shape and uses a skeleton detection module to determine which humanoid shape to retain. The semantic masks of human like shapes are created using a semantic-aware occlusion-robust model that has four primary components: feature extraction, and local, global, and semantic branches. The global branch encodes occlusion-aware information to make the extracted features resistant to occlusion, while the local branch retrieves fine-grained local characteristics. A modified big mask inpainting approach is employed to eliminate a person from the image, leveraging Fast Fourier convolutions and utilizing polygonal chains and rectangles with unpredictable aspect ratios. The inpainter network takes the input image and the mask to create an output image excluding the background humanoid shapes. The generator uses an encoder-decoder structure with included skip connections to recover spatial information and dilated convolution and squeeze and excitation blocks to make the regions behind the humanoid shapes consistent with their surroundings. The discriminator avoids dissimilar structure at the patch scale, and the refiner network catches features around the boundaries of each background humanoid shape. The method is evaluated on two video object segmentation datasets (DAVIS and YouTube-VOS) and a database of 66 distinct video sequences of people behind a desk in an office environment. The efficiency was assessed using the Structural Similarity Index Measure (SSIM), Frechet Inception Distance (FID), and Learned Perceptual Image Patch Similarity (LPIPS) metrics and showed promising results in fully automated background person removal task.

show abstract

Section: Object Removalmentioning

confidence: 99%