Dynamic hypergraph convolutional network for no-reference point cloud quality assessment

Chen, Wu, Jiang, Qiuping, Zhou, Wei, Xu, Long and Lin, Weisi 2024. Dynamic hypergraph convolutional network for no-reference point cloud quality assessment. IEEE Transactions on Circuits and Systems for Video Technology 34 (10) , pp. 10479-10493. 10.1109/TCSVT.2024.3410052

Preview

PDF - Accepted Post-Print Version Download (8MB) | Preview

Abstract

With the rapid advancement of three-dimensional (3D) sensing technology, point cloud has emerged as one of the most important approaches for representing 3D data. However, quality degradation inevitably occurs during the acquisition, transmission, and process of point clouds. Therefore, point cloud quality assessment (PCQA) with automatic visual quality perception is particularly critical. In the literature, the graph convolutional networks (GCNs) have achieved certain performance in point cloud-related tasks. However, they cannot fully characterize the nonlinear high-order relationship of such complex data. In this paper, we propose a novel no-reference (NR) PCQA method with hypergraph learning. Specifically, a dynamic hypergraph convolutional network (DHCN) composing of a projected image encoder, a point group encoder, a dynamic hypergraph generator, and a perceptual quality predictor, is devised. First, a projected image encoder and a point group encoder are used to extract feature representations from projected images and point groups, respectively. Then, using the feature representations obtained by the two encoders, dynamic hypergraphs are generated during each iteration, aiming to constantly update the interactive information between the vertices of hypergraphs. Finally, we design the perceptual quality predictor to conduct quality reasoning on the generated hypergraphs. By leveraging the interactive information among hypergraph vertices, feature representations are well aggregated, resulting in a notable improvement in the accuracy of quality pediction. Experimental results on several point cloud quality assessment databases demonstrate that our proposed DHCN can achieve state-of-the-art performance. The code will be available at: https://github.com/chenwuwq/DHCN.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Institute of Electrical and Electronics Engineers
ISSN:	1051-8215
Date of First Compliant Deposit:	7 June 2024
Date of Acceptance:	31 May 2024
Last Modified:	16 Dec 2024 15:00
URI:	https://orca.cardiff.ac.uk/id/eprint/169617

Actions (repository staff only)

Edit Item