Ning, Shuliang, Wang, Duomin, Qin, Yipeng  ORCID: https://orcid.org/0000-0002-1551-9126, Jin, Zirong, Wang, Baoyuan and Han, Xiaoguang
2024.
PICTURE: PhotorealistIC virtual Try-on from UnconstRained dEsign.
Presented at: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024,
Seattle, USA,
16-22 June 2024.
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
IEEE,
pp. 6976-6985.
10.1109/CVPR52733.2024.00666
|
Preview |
PDF
- Accepted Post-Print Version
Download (12MB) | Preview |
Abstract
In this paper, we propose a novel virtual try-on from unconstrained designs (ucVTON) task to enable photorealistic synthesis of personalized composite clothing on input human images. Unlike prior arts constrained by specific input types, our method allows flexible specification of style (text or image) and texture (full garment, cropped sections, or texture patches) conditions. To address the entanglement challenge when using full garment images as conditions, we develop a two-stage pipeline with explicit disentanglement of style and texture. In the first stage, we generate a human parsing map reflecting the desired style conditioned on the input. In the second stage, we composite textures onto the parsing map areas based on the texture input. To represent complex and non-stationary textures that have never been achieved in previous fashion editing works, we first propose extracting hierarchical and balanced CLIP features and applying position encoding in VTON. Experiments demonstrate superior synthesis quality and personalization enabled by our method. The flexible control over style and texture mixing brings virtual try-on to a new level of user experience for online shopping and fashion design.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Date Type: | Published Online |
| Status: | Published |
| Schools: | Schools > Computer Science & Informatics |
| Publisher: | IEEE |
| ISBN: | 9798350353013 |
| ISSN: | 1063-6919 |
| Date of First Compliant Deposit: | 9 April 2024 |
| Date of Acceptance: | 27 February 2024 |
| Last Modified: | 28 Aug 2025 09:40 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/167582 |
Actions (repository staff only)
 |
Edit Item |
Dimensions
Dimensions