本論文提出了一個影片穩定 (video stabilization) 演算法：以 階層式搜尋 (pyramid-based search) 作為計算影像移動向量 (frame motion vector) 的主要架構，輔以畫面的明亮度 (luminance) 為特徵，並加上區塊分割 (block segmentation) 分析，最後依據使用者的需求及應用來使用不同的穩定模式 (stabilizer) 來產生結果。本論文最主要的貢獻是：結合階層式架構與相似搜尋技術 (template matching)，提出一個能應用到許多不同背景，隨場景變化即時更新參考影像 (reference image)，以及適應性移動向量 (adaptive shifting vector) 平滑技術。為了解決不同背景的問題，我們針對輸入影像建立參考影像，並且隨時更新，用以準確計算出每個時間點的影像移動向量。此外，我們針對固定及移動式攝影機使用不同的穩定模式來補償，去除不自然的攝影機晃動，以追求最佳的穩定影像序列。實驗結果證明，這個方法可以有效的穩定影像，並能夠容許一定程度的光影變化以及攝影機晃動。

This thesis proposes a video stabilization algorithm: estimating the frame motion vectors with a main structure based on pyramid approach integrating the luminance of image, block segmentation analysis and reproducing different results by two stabilization stabilizers for different user demands and applications. The contributions of this thesis are: combining pyramid structure and template matching, dealing with different scenes, updating reference image as time goes by and a smoothing method named adaptive shifting vector. To deal with scene changing, the reference image is built up by the sequences and updated frame by frame to accurately estimate the motion vectors of frames. Moreover, for fixed camera or handheld digital camcorder, two stabilization stabilizers are applied to compensate the motions for eliminating annoying camera motions and reproducing better result sequences. Experimental results showed that the proposed algorithm is able to stabilize jiggle sequences with a small range of luminance changing and camera shaking.

[1] S. Battiato, G. Gallo, G. Puglisi, and S. Scellato, “Fuzzy-Based Motion Estimation for Video Stabilization Using SIFT Interest Points”, Digital Photography V, Proceedings of SPIE-IS&T Electronic Imaging, Vol. 7250, pp. 72500T-1-8, 2009.
[2] S. Battiato, G. Puglisi, and A. R. Bruna, “A Robust Video Stabilization System by Adaptive Motion Vectors Filtering”, in proceeding of the IEEE International Conference on Multimedia and Expo, pp. 373-376, 2008.
[3] A. U. Batur, and B. Flinchbaugh, “Video Stabilization with Optimized Motion Estimation Resolution”, in proceeding of the IEEE International Conference on Image Processing, pp. 465-468, 2006.
[4] A. Bosco, A. Bruna, S. Battiato, G. Bella, and G. Puglisi, “Digital Video Stabilization Through Curve Warping Techniques”, IEEE Transactions on Consumer Eletronics, Vol. 54, No. 2, pp. 220-224, 2008.
[5] A. Broggi, P. Grisleri, T. Graf, and M. Meinecke, “A Software Video Stabilization System for Automotive Oriented Applications”, in proceeding of the IEEE 61st Vehicular Technology Conference, Vol. 5, pp. 2760-2764, 2005.
[6] H.-C. Chang, S.-H. Lai, and K.-R. Lu, “A Robust and Efficient Video Stabilization Algorithm”, in proceeding of the IEEE International Conference on Multimedia and Expo, Vol. 1, pp. 29-32, 2004.
[7] C.-H. Chen, C.-W. Hsu, and C.-H. Chen, “Video Stabilization by Feature-Block Motion Estimation”, in proceeding of the Eighth International Conference on Intelligent Systems Design and Applications, Vol. 3, pp. 557-560, 2008.
[8] H. H. Chen, C.-K. Liang, Y.-C. Peng, and H.-A. Chang, “Integration of Digital Stabilizer with Video Codec for Digital Video Cameras,” IEEE Transactions on Circuits and Systems Society, vol. 17, no. 7, pp. 801-813, 2007.
[9] S. Choi, T. Kim, and W. Yu, “Robust Video Stabilization to Outlier Motion using Adaptive RANSAC”, in proceeding of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1897-1902, 2009.
[10] A. J. Crawford, H. Denman, F. Kelly, F. Pitie, and A. C. Kokaram, “Gradient Based Dominant Motion Estimation with Integral Projections for Real Time Video Stabilisation”, in proceeding of the International Conference on Image Processing, Vol. 5, pp. 3371-3374, 2004.
[11] R. Hu, R. Shi, I-F. Shen, and W. Chen, “Video Stabilization using Scale-Invariant Features”, in proceeding of the 11th International Conference on Information Visualization, pp. 871-877, 2007.
[12] J.-A Im, D.-W. Kim, and K.-S. Hong, “Digital Video Stabilization Algorithm for CMOS Image Sensor”, in proceeding of the IEEE International Conference on Image Processing, pp. 3261-3264, 2006.
[13] R. Jia, H. Zhang, L. Wang, and J. Li, “Digital Image Stabilization Based on Phase Correlation”, in proceeding of the IEEE International Conference on Artificial Intelligence and Computational Intelligence, pp.485-489, 2009.
[14] S.-J. Ko, S.-H. Lee, S.-W. Jeon, and E.-S. Kang, “Fast Digital Image Stabilizer Based on Gray-Coded Bit-Plane Matching”, IEEE Transactions on Consumer Electronics, Vol. 45, No. 3, pp. 598-603, 1999.
[15] C. Kurz, T. Thormahlen, and H.-P. Seidel, “Scene-Aware Video Stabilization by Visual Fixation”, in proceeding of the Conference for Visual Media Production, pp.1-6, 2009.
[16] K.-Y. Lee, Y.-Y. Chuang, B.-Y. Chen, and M. Ouhyoung, “Video Stabilization Using Robust Feature Trajectories”, in proceeding of the IEEE International Conference on Computer Vision, pp. 1397-1404, 2009.
[17] K. K. Lee, K. H. Wong, M. M. Y. Chang, Y. K. Yu, and M. K. Leung, “Extended Kalman Filtering Approach to Stereo Video Stabilization”, in proceeding of the International Conference on Pattern Recognition, pp. 1-4, 2008.
[18] L. Liu, Z. Fu, J. Xie, and W. Qian, “Edge Mapping: A New Motion Estimation Method for Video Stabilization”, in proceeding of the International Symposium on Computer Science and Computational Technology, Vol. 2, pp. 440-444, 2008.
[19] J. S. Lin, W. T. Huang, B. Y. Chen, and M. Ouhyoung, “Full-Frame Video Stabilization with A Polyline-Fitted Camcorder Path”, in proceeding of the 20th Conference on Computer Vision, Graphics, and Image Processing, pp.486-493, 2007.
[20] A. Litvin, J. Konrad, and W. Karl, “Probabilistic Video Stabilization Using Kalman Filtering and Mosaicking,” in Proceeding of the SPIE Image and Video Communications and Process, vol. 5022, pp. 663–674, 2003.
[21] Q. Luo, and T. M. Khoshgoftaar, “An Empirical Study on Estimating Motions in Video Stabilization”, in proceeding of the IEEE International Conference on Information Reuse and Integration, pp. 360-366, 2007
[22] L. Marcenaro, G. Vernazza, and C. S. Regazzoni, “Image Stabilization Algorithms for Video-Surveillance Applications”, in proceeding of the International Conference on Image Processing, Vol. 1, pp. 349-352, 2001.
[23] Y. Matsushita, E. Ofek, W. Ge, X. Tang, and H.-Y. Shum, “Full-Frame Video Stabilization with Motion Inpainting”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 7, pp. 1150-1163, 2006.
[24] Y. Matsushita, E. Ofek, X. Tang, and H.-Y. Shum, “Full-Frame Video Stabilization”, in proceeding of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 1, pp. 50-57, 2005.
[25] M. Niskanen, O. Silven, and M. Tico, “Video Stabilization Performance Assessment”, in proceeding of the IEEE International Conference on Multimedia and Expo, pp. 405-408, 2006.
[26] H. Okuda, M. Hashimoto, and K. Sumi, “Optimum Motion Estimation Algorithm for Fast and Robust Digital Image Stabilization”, IEEE Transactions on Consumer Electronics, Vol. 52, No. 1, 2006.
[27] Z. Pan, and C.-W. Ngo, “Selective Object Stabilization for Home Video Consumers”, IEEE Transactions on Consumer Electronics, Vol. 51, No. 4, pp. 1074-1084, 2005.
[28] M. Pilu, “Video Stabilization as A Variational Problem and Numerical Solution with the Viterbi Method”, in proceeding of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol.1, pp. 625-630, 2004.
[29] N. Rabinowitz, and I. Dvir, “Image Stabilizer”, Human Monitoring LTD, United States Patent Application Publication, US 2009/0256918 A1, 2009.
[30] K. Ratakonda, “Real-Time Digital Video Stabilization for Multi-Media Applications”, in proceeding of the IEEE International Symposium on Circuits and Systems, Vol.4, pp. 69-72, 1998.
[31] Y. Shen, P. Guturu, T. Damarla, B. Buckles, and K. Namuduri, “Video Stabilization Using Principal Component Analysis and Scale Invariant Feature Transform in Particle Filter Framework”, IEEE Transactions on Consumer Electronics, Vol. 55, No. 3, pp. 1714-1721, 2009.
[32] H. Shen, Q. Pan, Y. Cheng, and Y. Yu, “Fast Video Stabilization Algorithm for UAV”, in proceeding of the IEEE International Conference on Intelligent Computing and Intelligent Systems, Vol. 4, pp. 542-546, 2009.
[33] P. Shi, Y. Zhu, and S. Tong, “Video Stabilization in Visual Prosthetics”, in proceeding of the IEEE/ICME International Conference on Complex Medical Engineering, pp. 782-785, 2007.
[34] M. Tico, and M. Vehvilainen, “Constraint Motion Filtering for Video Stabilization”, in proceeding of the IEEE International Conference on Image Processing, Vol. 3, pp. 569-572, 2005.
[35] J. M. Wang, H. P. Chou, S. W. Chen, and C. S. Fuh, “Video Stabilization for A Hand-Held Camera Based on 3D Motion Model”, in proceeding of the IEEE International Conference on Image Processing, pp. 3477-3480, 2009.
[36] S. Wu, and Z. Ren, “Video Stabilization by Multi-Trajectory Mapping and Smoothing”, in proceeding of the Fifth International Conference on Information, Communications and Signal Processing, pp. 542-545, 2005.
[37] J. Yang, D. Schonfeld, C. Chen, and M. Mohamed, “Online Video Stabilization Based on Particle Filters”, in proceeding of the IEEE International Conference on Image Processing, pp. 1545-1548, 2006.
[38] J. Yang; D. Schonfeld, and M. Mohamed, “Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion”, IEEE Transactions on Circuits and System for Video Technology, Vol. 19, No. 7, pp. 945-954, 2009.
[39] Y.-M. Yeh, S.-J. Wang, and H.-C. Chiang, “A Digital Camcorder Image Stabilizer Based on Gray-Coded Bit-Plane Block Matching”, in proceeding of the SPIE conference on Input/Output and Imaging Technologies II, Vol. 4080, pp.2172-2178, 2001.