SketchGAN: Joint sketch completion and recognition with generative adversarial network

Liu, Fang, Deng, Xiaoming, Lai, Yukun ORCID: https://orcid.org/0000-0002-2094-5680, Liu, Yong-Jin, Ma, Cuixia and Wang, Hongan 2019. SketchGAN: Joint sketch completion and recognition with generative adversarial network. Presented at: CVPR, Long Beach, California, USA, 16-20 June 2019.

Preview

PDF - Accepted Post-Print Version Download (4MB) | Preview

Abstract

Hand-drawn sketch recognition is a fundamental problem in computer vision, widely used in sketch-based image and video retrieval, editing, and reorganization. Previous methods often assume that a complete sketch is used as input; however, hand-drawn sketches in common application scenarios are often incomplete, which makes sketch recognition a challenging problem. In this paper, we propose SketchGAN, a new generative adversarial network (GAN) based approach that jointly completes and recognizes a sketch, boosting the performance of both tasks. Specifically, we use a cascade Encode-Decoder network to complete the input sketch in an iterative manner, and employ an auxiliary sketch recognition task to recognize the completed sketch. Experiments on the Sketchy database benchmark demonstrate that our joint learning approach achieves competitive sketch completion and recognition performance compared with the state-of-the-art methods. Further experiments using several sketch-based applications also validate the performance of our method.

Item Type:	Conference or Workshop Item (Paper)
Status:	Unpublished
Schools:	Computer Science & Informatics
Funders:	Royal Society
Date of First Compliant Deposit:	5 April 2019
Last Modified:	25 Oct 2022 14:05
URI:	https://orca.cardiff.ac.uk/id/eprint/121532

Citation Data

Cited 45 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item