Efficient propagation of sparse edits on 360 panoramas

Zhang, Yun, Zhang, Fang-Lue, Lai, Yu-Kun ORCID: https://orcid.org/0000-0002-2094-5680 and Zhu, Zhe 2021. Efficient propagation of sparse edits on 360 panoramas. Computers and Graphics 96 , pp. 61-70. 10.1016/j.cag.2021.03.005

Preview

PDF - Accepted Post-Print Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (3MB) | Preview

Abstract

We present an efficient method to propagate sparse user edits indicated by strokes on 360 panoramas. Our algorithm first projects each equirectangular pixel to its corresponding position on a 3D unit sphere, so each pixel can be characterized by a feature vector consisting of its 3D coordinates and RGB color values. We formulate edit propagation as an optimization problem that aims to satisfy the user edit constraints while preserving the manifold structure of the image at the same time. To solve the problem using a linear system efficiently, we first construct the K-D tree structure in the feature space to cluster pixels. Then we optimize the manifold structure where both the number of nearest neighbors and their corresponding weights are determined by the feature distributions. We further apply a multiresolution strategy to speedup the edit propagation. Our method is the first to perform interactive edit propagation on 360 panoramas. Experiments show that our method is able to generate seam-free and visually pleasing results, and users can receive instant feedback during interactive editing.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Publisher:	Elsevier
ISSN:	0097-8493
Funders:	Royal Society
Date of First Compliant Deposit:	20 April 2021
Date of Acceptance:	30 March 2021
Last Modified:	26 Nov 2024 00:30
URI:	https://orca.cardiff.ac.uk/id/eprint/140563

Citation Data

Cited 2 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item