Dynamic Video Stitching via Shakiness Removing
Publication in refereed journal


Times Cited

Other information
AbstractStitching videos captured by hand-held mobile cameras can essentially enhance entertainment experience of ordinary users. However, such videos usually contain heavy shakiness and large parallax, which are challenging to stitch. In this paper, we propose a novel approach of video stitching and stabilization for videos captured by mobile devices. The main component of our method is a unified video stitching and stabilization optimization that computes stitching and stabilization simultaneously rather than does each one individually. In this way, we can obtain the best stitching and stabilization results relative to each other without any bias to one of them. To make the optimization robust, we propose a method to identify background of input videos, and also common background of them. This allows us to apply our optimization on background regions only, which is the key to handle large parallax problem. Since stitching relies on feature matches between input videos, and there inevitably exist false matches, we thus propose a method to distinguish between right and false matches, and encapsulate the false match elimination scheme and our optimization into a loop, to prevent the optimization from being affected by bad feature matches. We test the proposed approach on videos that are causally captured by smartphones when walking along busy streets, and use stitching and stability scores to evaluate the produced panoramic videos quantitatively. Experiments on a diverse of examples show that our results are much better than (challenging cases) or at least on par with (simple cases) the results of previous approaches.
Acceptance Date07/08/2017
All Author(s) ListYongwei Nie, Tan Su, Zhensong Zhang, Hanqiu Sun, Guiqing Li
Journal nameIEEE Transactions on Image Processing
Year2018
Month1
Volume Number27
Issue Number1
PublisherIEEE
Pages164 - 178
ISSN1057-7149
eISSN1941-0042
LanguagesEnglish-United States

Last updated on 2018-17-11 at 04:36