簡易檢索 / 詳目顯示

研究生: 王美雅
Wang, Mei-Ya
論文名稱: 以運動特徵為基礎之影片檢索研究
A Study on Motion-Based Video Retrieval in MPEG Domain
指導教授: 王明習
Wang, Ming-Shi
學位類別: 碩士
Master
系所名稱: 工學院 - 工程科學系
Department of Engineering Science
論文出版年: 2007
畢業學年度: 95
語文別: 中文
論文頁數: 64
中文關鍵詞: 攝影機運動影片檢索
外文關鍵詞: video retrieval, camera motion
相關次數: 點閱:159下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 目前影片檢索系統,大部分都是在未壓縮領域下,並且利用顏色、形狀、紋理等做檢索。而在壓縮領域下的檢索系統,都會先作前景分割處理。本論文提出一個快速影片檢索方法,希望能達到不需要分割前景,就能搜尋到所需要的影片。
    本論文中,利用攝影機運動估測所得到的參數,建立「攝影機運動特徵」,即為每段影片建立一個攝影機運動序列。另外將畫面的運動向量,扣除攝影機運動部份,加上時間軸的資訊,將殘餘的運動向量連接起來,稱為「運動流」,並利用此運動流建立「運動流特徵」。本論文將實驗分為三部份作比較,第一部份為利用攝影機運動特徵的檢索,第二部份為利用運動流特徵的檢索,第三部份為結合攝影機運動特徵與運動流特徵的檢索。而結果顯示,以運動為主的檢索,正確率為50%,但回收率為100%,可以利用此作進一步的檢索。而攝影機運動特徵與運動流特徵檢索效果的比較上,可以看出運動流特徵的結果是比較準確的。

    In this paper, we propose the method to combine the use of motion vector embedded in MPEG bitstream to generate ”motion flow”, and the use of camera motion parameter of camera motion estimation to generate “camera motion sequence”, which are applied them to perform quick video retrieved. We want to implement the system which we can retrieved the video in compressed domain without segmenting the moving object..
    There are three sections in our experiment. One is retrieved by “camera motion sequence”, One is retrieved by “motion flow”, and the last is retrieved by both these features. From the experiment, we can know that the retrieval by motion flow is better. The precision of our method is 50%, but the recall is 100%, and we can use the system to do more detail searching.

    摘要...................................................................................................................I ABSTRACT....................................................................................................II 目錄................................................................................................................III 圖目錄..............................................................................................................V 第1章 緒論.....................................................................................................1 1.1 研究動機.................................................................................................1 1.2 研究目標.................................................................................................2 1.3 論文架構.................................................................................................4 第2章 文獻探討與背景知識.........................................................................5 2.1 MPEG-1串流簡介..................................................................................5 2.1.1 MPEG-1的背景知識........................................................................5 2.1.2 MPEG-1 Video壓縮模型...............................................................6 2.1.3 MPEG 串流結構............................................................................15 2.2 攝影機運動估測...................................................................................17 2.2.1 攝影機運動....................................................................................17 2.2.2 攝影機簡化模型............................................................................18 2.2.3 參數估測........................................................................................25 2.3 影片檢索相關研究...............................................................................25 第3章 建立影片檢索系統...........................................................................29 3.1 攝影機參數估測...................................................................................29 3.2 建立運動流...........................................................................................34 3.3 擷取局部運動特徵...............................................................................39 3.4 擷取攝影機運動特徵...........................................................................44 3.5 特徵比較方法.......................................................................................47 第4章 系統實作與實驗結果.......................................................................49 4.1 系統環境及操作介面...........................................................................49 4.2 測試影片...............................................................................................50 4.3 攝影機運動閾值選擇與運動流閾值表示...........................................51 4.4 實驗結果...............................................................................................51 4.4.1 相同類型影片檢索結果................................................................52 4.4.2 不同影片類型影片檢索................................................................56 4.4.3 實驗結果評估................................................................................59 第5章 結論與未來研究方向.......................................................................60 5.1 結論.......................................................................................................60 5.2 未來研究方向.......................................................................................60 參考資料.........................................................................................................62

    [1] Yahoo Video Search, http://search.yahoo.com
    [2] Google Video, http://video.google.com/
    [3] Youtube Video Search, http://www.youtube.com
    [4] The MPEG Home Page, http://www.chiariglione.org/mpeg/
    [5] P. Bouthemy, M. Gelgon, F. Ganansia, and R. Irisa, "A unified approach to shot change detection and camera motioncharacterization," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 9, pp. 1030-1044, 1999.
    [6] H. S. Chang, S. Sull, and S. U. Lee, "Efficient video indexing scheme for content-based retrieval," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 9, pp. 1269-1279, 1999.
    [7] S. F. Chang, W. Chen, H. J. Meng, H. Sundaram, and a. D. Zhong, "VideoQ: An Automated Content Based Video Search System Using Visual Cues," Proceedings of the fifth ACM international conference on Multimedia, pp. 313-324, 1997.
    [8] L. Y. Duan, M. Xu, Q. Tian, C. S. Xu, and J. S. Jin, "A Unified Framework for Semantic Shot Classification in Sports Video," IEEE TRANSACTIONS ON MULTIMEDIA, vol. 7, 2005.
    [9] R. Ewerth, M. Schwalb, P. Tessmann, and B. Freisleben, "Estimation of arbitrary camera motion in MPEG videos," Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, vol. 1, 2004.
    [10] M. S. Flickner, H. Niblack, W. Ashley, J. Q. H. Dom, B. Gorkani, M. Hafner, J. Lee, D. Petkovic, D. Steele, and D. Yanker, "Query by image and video content: the QBIC system," Computer, vol. 28, pp. 23-32, 1995.
    [11] A. Hampapur, A. Gupta, B. Horowitz, C. F. Shu, C. Fuller, J. Bach, M. Gorkani, and R. Jain, "Virage video engine," Proc. SPIE, vol. 3022, pp. 188–200, 1997.
    [12] J. Lee and B. W. Dickinson, "Hierarchical video indexing and retrieval for subband-coded video," IEEE Transactions on Circuits and Systems for Video Technology, vol. 10, pp. 824-829, 2000.
    [13] P. Muneesawang and L. Guan, "Automatic Machine Interactions for Content-Based Image Retrieval Using a Self-Organizing Tree Map Architecture," IEEE TRANSACTIONS ON NEURAL NETWORKS, vol. 13, p. 821, 2002.
    [14] P. Munesawang and L. Guan, "Adaptive video indexing and automatic/semi-automatic relevance feedback," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 15, pp. 1032-1046, 2005.
    [15] C. W. Ngo, T. C. Pong, and H. J. Zhang, "On clustering and retrieval of video shots," ACM
    Multimedia, pp. 51–60, 2001.
    [16] J. M. Odobez and P. Bouthemy, "Robust multiresolution estimation of parametric motion models," Journal of Visual Communication and Image Representation, vol. 6, pp. 348-365, 1995.
    [17] J. I. Park, N. Yagi, K. Enami, K. Aizawa, and M. Hatori, "Estimation of camera parameters from image sequence for model-basedvideo coding," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 4, pp. 288-296, 1994.
    [18] A. Pentland, R. W. Picard, and S. Sclaroff, "Photobook: Content-based manipulation of image databases," International Journal of Computer Vision, vol. 18, pp. 233-254, Jun 1996.
    [19] E. Sahouria and A. Zakhor, "Content analysis of video using principal components," Circuits and Systems for Video Technology, IEEE Transactions on, vol. 9, pp. 1290-1298, 1999.
    [20] J. R. Smith and S. F. Chang, "VisualSEEk: a fully automated content-based image query system," Proceedings of the fourth ACM international conference on Multimedia, pp. 87-98, Nov. 1996.
    [21] C. W. Su, H. Y. M. Liao, and K. C. Fan, "A motion-flow-based fast video retrieval system," Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval, pp. 105-112, 2005.
    [22] R. Wang and T. Huang, "Fast camera motion analysis in MPEG domain," Image Processing, 1999. ICIP 99. Proceedings. 1999 International Conference on, vol. 3, 1999.
    [23] Z. Xiong, X. S. Zhou, Q. Tian, Y. Rui, and H. Ts, "Semantic retrieval of video-review of research on video retrieval in meetings, movies and broadcast news, and sports," Signal Processing Magazine, IEEE, vol. 23, pp. 18-27, 2006.
    [24] B. L. Yeo and B. Liu, "A Unified Approach to Temporal Segmentation of Motion JPEG and MPEG Compressed Video," IEEE Int. Conf. on Multimedia Computing and Systems, 1995.
    [25] H. J. Zhang, A. Kankanhalli, and S. W. Smoliar, "Automatic partitioning of full-motion video," Multimedia Systems, vol. 1, pp. 10-28, 1993.
    [26] 賴建明, "MPEG影片中攝影機運動參數估測之研究," 國立成功大學工程科學研究所碩士論文, 2006.

    下載圖示 校內:2008-08-16公開
    校外:2008-08-16公開
    QR CODE