CartoonGAN: generative adversarial networks for photo cartoonization

Chen, Yang, Lai, Yukun ORCID: https://orcid.org/0000-0002-2094-5680 and Liu, Yong-Jin 2018. CartoonGAN: generative adversarial networks for photo cartoonization. Presented at: IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Lake Salt City, USA, 18-22 Jun 2018.

Preview

PDF - Accepted Post-Print Version Download (5MB) | Preview

Abstract

In this paper, we propose a solution to transforming photos of real-world scenes into cartoon style images, which is valuable and challenging in computer vision and computer graphics. Our solution belongs to learning based methods, which have recently become popular to stylize images in artistic forms such as painting. However, existing methods do not produce satisfactory results for cartoonization, due to the fact that (1) cartoon styles have unique characteristics with high level simplification and abstraction, and (2) cartoon images tend to have clear edges, smooth color shading and relatively simple textures, which exhibit significant challenges for texture-descriptor-based loss functions used in existing methods. In this paper, we propose CartoonGAN, a generative adversarial network (GAN) framework for cartoon stylization. Our method takes unpaired photos and cartoon images for training, which is easy to use. Two novel losses suitable for cartoonization are proposed: (1) a semantic content loss, which is formulated as a sparse regularization in the high-level feature maps of the VGG network to cope with substantial style variation between photos and cartoons, and (2) an edge-promoting adversarial loss for preserving clear edges. We further introduce an initialization phase, to improve the convergence of the network to the target manifold. Our method is also much more efficient to train than existing methods. Experimental results show that our method is able to generate high-quality cartoon images from real-world photos (i.e., following specific artists’ styles and with clear edges and smooth shading) and outperforms state-of-the-art methods.

Item Type:	Conference or Workshop Item (Paper)
Date Type:	Completion
Status:	In Press
Schools:	Computer Science & Informatics
Funders:	Royal Society
Date of First Compliant Deposit:	29 March 2018
Last Modified:	23 Oct 2022 13:20
URI:	https://orca.cardiff.ac.uk/id/eprint/110341

Citation Data

Cited 193 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item