Deep point-based scene labeling with depth mapping and geometric patch feature encoding

Cai, Jun-Xiong, Ma, Tai-Jiang, Lai, Yukun ORCID: https://orcid.org/0000-0002-2094-5680 and Hu, Shi-Min 2019. Deep point-based scene labeling with depth mapping and geometric patch feature encoding. Graphical Models 104 , 101033. 10.1016/j.gmod.2019.101033

Preview

PDF - Accepted Post-Print Version Download (5MB) | Preview

Abstract

This paper presents a deep CNN approach for point-based semantic scene labeling. This is challenging because 3D point clouds do not have a canonical domain and can have complex geometry and substantial variation of sampling densities. We propose a novel framework where the convolution operator is defined on depth maps around sampled points, which captures characteristics of local surface regions. We introduce Depth Mapping (DM) and Reverse Depth Mapping (RDM) operators to transform between the point domain and the depth map domain. Our depth map based convolution is computationally efficient, robust to scene scales and sampling densities, and can capture rich surface characteristics. We further propose to augment each point with feature encoding of the local geometric patches resulted from multi-method through patch pooling network (PPN). The patch features provide complementary information and are fed into our classification network to achieve semantic segmentation.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Elsevier
ISSN:	1524-0703
Date of First Compliant Deposit:	29 May 2019
Date of Acceptance:	28 May 2019
Last Modified:	28 Nov 2024 01:45
URI:	https://orca.cardiff.ac.uk/id/eprint/122926

Citation Data

Cited 3 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item