He, Zijian, Ning, Yuwei, Qin, Yipeng  ORCID: https://orcid.org/0000-0002-1551-9126, Wang, Guangrun, Yang, Sibei, Lin, Liang and Li, Guanbin
2025.
VTON 360: High-fidelity virtual try-on from any viewing direction.
Presented at: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025,
Nashville, USA,
11-15 June 2025.
Proceedings of the Conference on Computer Vision and Pattern Recognition.
IEEE,
pp. 26388-26398.
10.1109/CVPR52734.2025.02457
|
Preview |
PDF
- Accepted Post-Print Version
Download (9MB) | Preview |
Abstract
Virtual Try-On (VTON) is a transformative technology in e-commerce and fashion design, enabling realistic digital visualization of clothing on individuals. In this work, we propose VTON 360, a novel 3D VTON method that addresses the open challenge of achieving high-fidelity VTON that supports any-view rendering. Specifically, we leverage the equivalence between a 3D model and its rendered multi-view 2D images, and reformulate 3D VTON as an extension of 2D VTON that ensures 3D consistent results across multiple views. To achieve this, we extend 2D VTON models to include multi-view garments and clothing-agnostic human body images as input, and propose several novel techniques to enhance them, including: i) a pseudo-3D pose representation using normal maps derived from the SMPL-X 3D human model, ii) a multi-view spatial attention mechanism that models the correlations between features from different viewing angles, and iii) a multi-view CLIP embedding that enhances the garment CLIP features used in 2D VTON with camera information. Extensive experiments on large-scale real datasets and clothing images from e-commerce platforms demonstrate the effectiveness of our approach. Project page: https://scnuhealthy.github.io/VTON360.
| Item Type: | Conference or Workshop Item (Paper) |
|---|---|
| Date Type: | Published Online |
| Status: | Published |
| Schools: | Schools > Computer Science & Informatics |
| Publisher: | IEEE |
| ISBN: | 9798331543655 |
| ISSN: | 1063-6919 |
| Date of First Compliant Deposit: | 20 March 2025 |
| Date of Acceptance: | 26 February 2025 |
| Last Modified: | 28 Aug 2025 12:48 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/176933 |
Actions (repository staff only)
 |
Edit Item |
Dimensions
Dimensions