Cardiff University | Prifysgol Caerdydd ORCA
Online Research @ Cardiff 
WelshClear Cookie - decide language by browser settings

Deep point-based scene labeling with depth mapping and geometric patch feature encoding

Cai, Jun-Xiong, Ma, Tai-Jiang, Lai, Yukun ORCID: and Hu, Shi-Min 2019. Deep point-based scene labeling with depth mapping and geometric patch feature encoding. Graphical Models 104 , 101033. 10.1016/j.gmod.2019.101033

[thumbnail of SceneLabelingGMOD.pdf]
PDF - Accepted Post-Print Version
Download (5MB) | Preview


This paper presents a deep CNN approach for point-based semantic scene labeling. This is challenging because 3D point clouds do not have a canonical domain and can have complex geometry and substantial variation of sampling densities. We propose a novel framework where the convolution operator is defined on depth maps around sampled points, which captures characteristics of local surface regions. We introduce Depth Mapping (DM) and Reverse Depth Mapping (RDM) operators to transform between the point domain and the depth map domain. Our depth map based convolution is computationally efficient, robust to scene scales and sampling densities, and can capture rich surface characteristics. We further propose to augment each point with feature encoding of the local geometric patches resulted from multi-method through patch pooling network (PPN). The patch features provide complementary information and are fed into our classification network to achieve semantic segmentation.

Item Type: Article
Date Type: Publication
Status: Published
Schools: Computer Science & Informatics
Publisher: Elsevier
ISSN: 1524-0703
Date of First Compliant Deposit: 29 May 2019
Date of Acceptance: 28 May 2019
Last Modified: 07 Nov 2023 03:35

Citation Data

Cited 3 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item Edit Item


Downloads per month over past year

View more statistics