Simultaneous camera path optimization and distraction removal for improving amateur video

Zhang, Fang-Lue, Wang, Jue, Zhao, Han, Martin, Ralph Robert and Hu, Shi-Min 2015. Simultaneous camera path optimization and distraction removal for improving amateur video. IEEE Transactions on Image Processing 24 (12) , pp. 5982-5994. 10.1109/TIP.2015.2493959

Preview

PDF - Accepted Post-Print Version Download (17MB) | Preview

Abstract

A major difference between amateur and professional video lies in the quality of camera paths. Previous work on video stabilization has considered how to improve amateur video by smoothing the camera path. In this paper, we show that additional changes to the camera path can further improve video aesthetics. Our new optimization method achieves multiple simultaneous goals: 1) stabilizing video content over short time scales; 2) ensuring simple and consistent camera paths over longer time scales; and 3) improving scene composition by automatically removing distractions, a common occurrence in amateur video. Our approach uses an L1 camera path optimization framework, extended to handle multiple constraints. Two passes of optimization are used to address both low-level and high-level constraints on the camera path. The experimental and user study results show that our approach outputs video that is perceptually better than the input, or the results of using stabilization only.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Computer Science & Informatics
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Publisher:	Institute of Electrical & Electronic Engineers
ISSN:	1057-7149
Funders:	Engineering and Physical Sciences Research Council
Date of First Compliant Deposit:	25 April 2016
Date of Acceptance:	9 October 2015
Last Modified:	02 May 2023 22:25
URI:	https://orca.cardiff.ac.uk/id/eprint/89888

Citation Data

Cited 25 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item