簡易檢索 / 詳目顯示

研究生: 郭宇軒
Kuo, Yu-Hsuan
論文名稱: 採用靈活邊界的一致三維縮放
Consistent Three-dimensional Warping Using Flexible Boundaries for Stereoscopic Video Retargeting
指導教授: 李同益
Lee, Tong-Yee
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 英文
論文頁數: 34
中文關鍵詞: 立體影片解析度調整網格變形最佳化
外文關鍵詞: Content-aware media retargeting, mesh warping, cropping, optimization
相關次數: 點閱:75下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本篇論文提出了一種新穎的立體影片重定向,能夠適應影片,以適應具有不同的尺寸和長寬比顯示,同時保持顯著物體的形狀,立體視差一致性和時間相干性。大部分縮放的研究是透過保持每一幀非均勻變形的時空一致性和立體視差。然而,此縮放結果有時忽略物體變形一致性造成的立體視差和物體形狀的失真或浮動假象。我們提出一個三維物體導向的變形和裁剪方案既減少這些令人厭惡的扭曲和保持顯著內容的形狀。其基本思想是結合變形和裁剪兩者的技術達到近似最佳解的解決方案,其中,變形採用了相同的物體內一致的變形和裁剪除去非顯著影片內容,以保持顯著對象的形狀,立體視差一致性和時間相干性結合。與相關立體影像的學術論文做比較,可以發現我們的結果在那些具有結構線條和明顯前景物體的影片內容,在相機定性與量化分析的結果明顯較好,在那些具有結構線條和明顯的前景物體的圖像。

    This paper presents a novel stereoscopic video retargeting that adapts videos to fit displays with varied sizes and aspect ratios while preserving the shape of prominent objects, disparity consistency and temporal coherence.Most retargeting researches make an effort to reserve the spatio-temporal coherence and disparity via non-uniform warping in each frame.However,the retargeting results sometimes cause apparent distortions or waving artifacts in both disparities and shapes of objects by ignoring the consistency of object deformation.We propose an object-driven warping-and-cropping
    scheme to both reduce these repulsive distortions and keep the shape of salient contents. The basic idea is to combine both warping and cropping techniques,where the warping employs consistent deformation within the same object and the cropping removes non-significant content, to preserve the shape of salient objects,disparity consistency, and temporal coherence.Qualitative and quantitative analyses on stereoscopic videos with diverse camera and considerable motions demonstrate a clear superiority of the proposed method over related methods in terms of retargeting quality.

    中文摘要 I ABSTRACT II 誌謝 III CONTENTS IV Chapter 1 Introduction 1 Chapter 2 Methodology 5 2.1 Significance map generation 5 2.2 Volumetric warping using floating boundaries 7 2.21 Shape and motion preservation constraint 7 2.22 Disparity preservation constraint 8 2.23 Boundary constraint 9 2.24 Optimization with floating boundary 13 2.3 Cropping 13 Chapter 3 Experimental Results and Discussion 14 Chapter 4 Conclusions 22 Supplemental1: Comparison with temporal motion preservation 23 Supplemental2: Comparison with disparity preservation 28 REFERENCES 33

    [WFS*09] Y.-S. Wang, H. Fu, O. Sorkine, T.-Y. Lee, and H.-P. Seidel: Motion-aware temporal coherence for video resizing. ACM Trans. Graph. (Proceedings of ACM SIGGRAPH ASIA) 28, 5, 2009.
    [SA09] A. Shamir and S. Avidan: Seam carving for media retargeting. Commun. ACM 52, 1 (2009), 77–85.
    [CLC11] C.-H. Chang, C.-K. Liang, and Y.-Y. Chuang: Content-Aware Display Adaptation and Interactive Editing for Stereoscopic Images. IEEE Transactions on Multimedia 13(4): 589-601, 2011.
    [WLLL10] Y.-S. Wang, H.-C. Lin, O. Sorkine, and T.-Y. Lee: Motion-based Video Retargeting with Optimized Crop-and-Warp, ACM Transactions on Graphics, Vol. 29, No. 4, Article No. 90, 2010.
    [WHSL11] Y.-S. Wang, J.-H. Hsiao, O. Sorkine, and T.-Y. Lee: Scalable and coherent video resizing with per-frame optimization, ACM Trans. Graph., vol. 30, no. 4, pp. 88:1--88:8, 2011.
    [LLYCYL13] Shih-Syun Lin, Chao-Hung Lin, I-Cheng Yeh, Shu-Huai Chang, Chih-Kuo Yeh, Tong-Yee Lee: Content-aware Video Retargeting Using Object-preserving Warping, IEEE Transactions on Visualization and Computer Graphics, Vol. 19, No. 10, Oct. 2013, pp. 1677-1688
    [GKHE10] M. Grundmann, V. Kwatra, M. Han, and I. Essa: Efficient hierarchical graph-based video segmentation, in Proceedings of IEEE CVPR, pp.2141-2148, 2010.
    [GZT10] S. Goferman, L. Zelnik-Manor, and A. Tal: Context-aware saliency detection, CVPR, pp. 2376-2383, 2010.
    [WTSL08] Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27, 5 (2008), pp. 1–8, 2008.
    [BMA11] Tali Basha, Yael Moses, Shai Avidan: Geometrically consistent stereo seam carving. ICCV 2011: 1816-1823.
    [RSA08] M. Rubinstein, A. Shamir, and S. Avidan, “Improved seam carving for video retargeting,” ACM Trans. Graph., vol. 27, no. 3, pp. 16:1–16:9, 2008.
    [NLH12] Y. Niu, F. Liu, W. Chi Feng, and H. Jin, “Aesthetics-based stereoscopic photo cropping for heterogeneous displays,” IEEE Trans. Multi., vol. 14, pp. 783–796, 2012.
    [AS07] S. Avidan and A. Shamir, “Seam carving for content-aware image resizing,” ACM Trans. Graph., vol. 26, no. 3, 2007.
    [LCC12] K.-Y. Lee, C.-D. Chung, and Y.-Y. Chuang, “Scene warping: Layer-based stereoscopic image resizing,” in Proceedings of IEEE Computer Vision and Pattern Recognition, 2012, pp. 49–56.
    [LDW*14] Bing Li, Ling-Yu Duan, Jinqiao Wang, Rongrong Ji, Chia-Wen Lin, Wen Gao, “Spatiotemporal Grid Flow for Video Retargeting”, IEEE Transactions on Image Processing, Vol. 23, pp. 1615-1628, 2014.
    [YSL13] Bo Yan, Kairan Sun, and Liu Liu, Matching-Area-Based Seam Carving for Video Retargeting, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 23, NO. 2, FEBRUARY 2013.
    [KLHG09] P. Krähenbühl, M. Lang, A. Hornung, and M. Gross, “A system for retargeting of streaming video,” ACM Trans. Graph., vol. 28, no. 5, pp. 126:1–126:10, 2009.
    [NFL12] Y. Niu, W.-C. Feng, and F. Liu, “Enabling warping on stereoscopic images,” ACM Trans. Graph., vol. 31, no. 6, pp. 183:1–183:7, 2012.
    [LHW*10] M. Lang, A. Hornung, O. Wang, S. Poulakos, A. Smolic, and M. Gross, “Nonlinear disparity mapping for stereoscopic 3d,” ACM Trans. Graph., vol. 29, pp. 75:1–75:10, 2010.
    [LSC*12] S.-J. Luo, I.-C. Shen, B.-Y. Chen, W.-H. Cheng, and Y.-Y. Chuang, “Perspective-aware warping for seamless stereoscopic image cloning,” ACM Trans. Graph., vol. 31, no. 6, pp. 182:1–182:8, 2012.
    [RSA09] Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. 28(3), 1–11 (2009).
    [SAD*06] A. Santella, M. Agrawala, D. DeCarlo, D. Salesin, and M. Cohen, “Gaze-based interaction for semi-automatic photo cropping,” in Proceedings of the SIGCHI conference on Human Factors in computing systems, 2006, pp. 771–780.
    [ZCHM09] G.-X. Zhang, M.-M. Cheng, S.-M. Hu, and R. R. Martin, “A shape preserving approach to image resizing,” Comput. Graph. Forum, vol. 28, no. 7, pp. 1897–1906, 2009.
    [HMC09] Q. xing Huang, R. Mech, and N. Carr, “Optimizing structure preserving embedded deformation for resizing images and vector art,” Comput. Graph. Forum, vol. 29, no. 7, pp. 1887–1896, 2009.
    [LYLL13] Shih-Syun Lin, I-Cheng Yeh, Chao-Hung Lin and Tong-Yee Lee, 2013, February, "Patch-based Image Warping for Content-aware Retargeting," IEEE Transactions on Multimedia,Vol.15, No.2. Page 359-368.
    [DKHW07] Daszykowski, M., Kaczmarek, K., Heyden, Y. V., Walczak, B., 2007. Robust statistics in data analysis - a review: basic concept. Chemometrics and Intelligent Laboratory System. 85(2), 203–219.

    無法下載圖示 校內:2019-08-18公開
    校外:不公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE