Yao, Xingxu, She, Dongyu, Zhao, Sicheng, Liang, Jie, Lai, Yukun  ORCID: https://orcid.org/0000-0002-2094-5680 and Yang, Jufeng
2019.
Attention-aware polarity sensitive embedding for affective image retrieval.
Presented at: IEEE International Conference on Computer Vision (ICCV),
Seoul, Korea,
27 October - 2 November 2019.
2019 IEEE/CVF International Conference on Computer Vision (ICCV).
IEEE,
pp. 1140-1150.
10.1109/ICCV.2019.00123
|
Preview |
PDF
- Accepted Post-Print Version
Download (651kB) | Preview |
Abstract
Images play a crucial role for people to express their opinions online due to the increasing popularity of social networks. While an affective image retrieval system is useful for obtaining visual contents with desired emotions from a massive repository, the abstract and subjective characteristics make the task challenging. To address the problem, this paper introduces an Attention-aware Polarity Sensitive Embedding (APSE) network to learn affective representations in an end-to-end manner. First, to automatically discover and model the informative regions of interest, we develop a hierarchical attention mechanism, in which both polarity- and emotion-specific attended representations are aggregated for discriminative feature embedding. Second, we present a weighted emotion-pair loss to take the inter- and intra-polarity relationships of the emotional labels into consideration. Guided by attention module, we weight the sample pairs adaptively which further improves the performance of feature embedding. Extensive experiments on four popular benchmark datasets show that the proposed method performs favorably against the state-of-the-art approaches.
| Item Type: | Conference or Workshop Item - published (Paper) |
|---|---|
| Date Type: | Publication |
| Status: | Published |
| Schools: | Schools > Computer Science & Informatics |
| Publisher: | IEEE |
| ISBN: | 978-1-7281-4804-5 |
| ISSN: | 1550-5499 |
| Related URLs: | |
| Date of First Compliant Deposit: | 19 August 2019 |
| Date of Acceptance: | 22 July 2019 |
| Last Modified: | 23 Jun 2026 09:56 |
| URI: | https://orca.cardiff.ac.uk/id/eprint/125009 |
Citation Data
Cited 22 times in Scopus. View in Scopus. Powered By Scopus® Data
Actions (repository staff only)
 |
Edit Item |
Altmetric
Altmetric