PlenoPatch: patch-based plenoptic image manipulation

Zhang, Fang-Lue, Wang, Jue, Shechtman, Eli, Zhou, Zi-Ye, Shi, Jia-Xin and Hu, Shi-Min ORCID: https://orcid.org/0000-0001-7507-6542 2016. PlenoPatch: patch-based plenoptic image manipulation. IEEE Transactions on Visualization and Computer Graphics 23 (5) , pp. 1561-1573. 10.1109/TVCG.2016.2532329

Preview

PDF - Accepted Post-Print Version Download (3MB) | Preview

Abstract

Patch-based image synthesis methods have been successfully applied for various editing tasks on still images, videos and stereo pairs. In this work we extend patch-based synthesis to plenoptic images captured by consumer-level lenselet-based devices for interactive, efficient light field editing. In our method the light field is represented as a set of images captured from different viewpoints. We decompose the central view into different depth layers, and present it to the user for specifying the editing goals. Given an editing task, our method performs patch-based image synthesis on all affected layers of the central view, and then propagates the edits to all other views. Interaction is done through a conventional 2D image editing user interface that is familiar to novice users. Our method correctly handles object boundary occlusion with semi-transparency, thus can generate more realistic results than previous methods. We demonstrate compelling results on a wide range of applications such as hole-filling, object reshuffling and resizing, changing object depth, light field upscaling and parallax magnification.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Additional Information:	PDF uploaded in accordance with publisher's policies at http://www.sherpa.ac.uk/romeo/issn/1077-2626/ (accessed 14.7.16).
Publisher:	IEEE
ISSN:	1077-2626
Date of First Compliant Deposit:	13 July 2016
Date of Acceptance:	8 February 2016
Last Modified:	04 Dec 2024 17:15
URI:	https://orca.cardiff.ac.uk/id/eprint/92536

Citation Data

Cited 51 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item