Exploiting inter-sample affinity for knowability-aware universal domain adaptation

Wang, Yifan, Zhang, Lin, Song, Ran, Li, Hongliang, Rosin, Paul L. ORCID: https://orcid.org/0000-0002-4965-3884 and Zhang, Wei 2024. Exploiting inter-sample affinity for knowability-aware universal domain adaptation. International Journal of Computer Vision 132 (5) , pp. 1800-1816. 10.1007/s11263-023-01955-y Item availability restricted.

PDF - Accepted Post-Print Version Restricted to Repository staff only until 8 December 2024 due to copyright restrictions. Download (10MB)

Abstract

Universal domain adaptation aims to transfer the knowledge of common classes from the source domain to the target domain without any prior knowledge on the label set, which requires distinguishing in the target domain the unknown samples from the known ones. Recent methods usually focused on categorizing a target sample into one of the source classes rather than distinguishing known and unknown samples, which ignores the inter-sample affinity between known and unknown samples, and may lead to suboptimal performance. Aiming at this issue, we propose a novel UniDA framework where such inter-sample affinity is exploited. Specifically, we introduce a knowability-based labeling scheme which can be divided into two steps: (1) Knowability-guided detection of known and unknown samples based on the intrinsic structure of the neighborhoods of samples, where we leverage the first singular vectors of the affinity matrix to obtain the knowability of every target sample. (2) Label refinement based on neighborhood consistency to relabel the target samples, where we refine the labels of each target sample based on its neighborhood consistency of predictions. Then, auxiliary losses based on the two steps are used to reduce the inter-sample affinity between the unknown and the known target samples. Finally, experiments on four public datasets demonstrate that our method significantly outperforms existing state-of-the-art methods.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Springer
ISSN:	0920-5691
Date of First Compliant Deposit:	11 December 2023
Date of Acceptance:	30 October 2023
Last Modified:	09 Nov 2024 23:15
URI:	https://orca.cardiff.ac.uk/id/eprint/164656

Actions (repository staff only)

Edit Item