Real-world images usually contain multiple objects, as a result, generating an image from a multi-instance sketch is an attractive research topic. However, existing generative networks usually produce a similar texture on different instances for those methods focus on learning the distribution of the whole image. To address this problem, we propose a progressive instance texture reserved generative approach to generate more convincible images by decoupling the generation of the instances and the whole image. Specifically, we create an instance generator to synthesize the primitive color distribution and the detailed texture for each instance. Then, an image generator is designed to combine all of these instances to synthesize an image retaining texture and color. Besides, to generate more significant details, such as eyes, ears, and so on, we propose a novel technique called discriminative sketch augmentation, which can provide structural constraint by obtaining the sketch of the discriminative region. The extensive experiments demonstrate that our model not only generates convincing images but also achieves higher inception score and lower Fréchet Inception Distance on the MS-COCO dataset.INDEX TERMS Multi-instance sketch to image, image processing, image generation.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.