Details

Autor(en) / Beteiligte

• Wu, Jin-Liang
• Shi, Jun-Jie
• Zhang, Lei

Titel

Rectangling irregular videos by optimal spatio-temporal warping

Ist Teil von

• Computational visual media (Beijing), 2022-03, Vol.8 (1), p.93-103

Ort / Verlag

Beijing: Tsinghua University Press

Erscheinungsjahr

2022

Link zum Volltext

Quelle

Free E-Journal (出版社公開部分のみ）

Beschreibungen/Notizen

• Image and video processing based on geometric principles typically changes the rectangular shape of video frames to an irregular shape. This paper presents a warping based approach for rectangling such irregular frame boundaries in space and time, i.e., making them rectangular again. To reduce geometric distortion in the rectangling process, we employ content-preserving deformation of a mesh grid with line structures as constraints to warp the frames. To conform to the original inter-frame motion, we keep feature trajectory distribution as constraints during motion compensation to ensure stability after warping the frames. Such spatially and temporally optimized warps enable the output of regular rectangular boundaries for the video frames with low geometric distortion and jitter. Our experiments demonstrate that our approach can generate plausible video rectangling results in a variety of applications.