簡易檢索 / 詳目顯示

研究生: 胡雅涵
Hu, Ya-Han
論文名稱: 適用於雙視角影片之物件立體度調整系統
An Object-based 3D Effect Adjustment System for Stereoscopic Videos
指導教授: 楊家輝
Yang, Jar-Ferr
陳進興
Chen, Chin-Hsing
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電腦與通信工程研究所
Institute of Computer & Communication Engineering
論文出版年: 2015
畢業學年度: 103
語文別: 英文
論文頁數: 68
中文關鍵詞: 立體效果調整視差調整深度調整立體影像修補
外文關鍵詞: 3D effect adjustment, post-processing, stereoscopic inpainting
相關次數: 點閱:63下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近年來,隨著三維影像錄製與顯示技術的快速發展,使得立體雙視角影像製作越來越普及。其中,在影片後製程序中針對已拍攝完成之雙視角影像進行物件的三維立體效果調整是值得研究的議題。無論是降低物件的立體效果以減緩觀賞者視覺疲勞或是加強物件的立體效果以強調其臨場感,後製立體效果調整將是低成本、省時,及可行的方式。因此,本論文提出適用於雙視角影片之物件立體度調整系統,此系統可依據立體特效導演設定以達到不同的立體效果之調整。然而,依據視差與深度的關係調整立體效果時,物間邊緣可能會遺失資訊。因此,我們進一步提出立體影像修補演算法,有別於一般二維影像修補法,我們提出之立體修補演算法可利用深度資訊、視角間相關性及時域一致性而達到更好的修補結果。實驗結果證明本系統可同時達成立體度調整的目標並保留良好觀賞品質。此外,本系統可相容於其他物件切割與立體匹配演算法。

    Recently, the developments of three-dimension (3D) capture and display techniques grow rapidly, which bring in mass production of stereoscopic 3D contents. The 3D effect adjustment for stereoscopic images in post processes is a worth exploring issue. We could reduce the 3D depth of an object to restrain viewer visual exhaustion, or increase the 3D depth of an object to achieve better 3D perception for 3D contents. The post processing of 3D effect becomes a low-cost, adjustable, and feasible solution. To achieve this purpose, we proposed a framework which can adjust the 3D effect of a specific object according to the preference of the 3D effect director. However, the disparity and depth adjustments of the object could inevitably cause the view incompletion and the temporal discontinuity. Hence, we proposed a stereoscopic inpainting algorithm which can change the depth information and keep stereoscopic consistency and temporal continuity to achieve better viewing performance. Simulation results show that the proposed framework can reach the target of the 3D effect adjustment and maintain the viewing quality simultaneously. Furthermore, the framework is also compatible to other stereo matching and object segmentation methods.

    摘 要 I Abstract II 誌 謝 III Contents IV List of Figures VII Chapter 1 Introduction 1 1.1 Background 1 1.1.1 Stereoscopic Vision 1 1.1.2 Binocular Parallax 2 1.1.3 Zero Parallax Setting 3 1.1.4 Production of 3D Contents 5 1.2 Motivations 7 1.3 Organization 8 Chapter 2 Fundamentals 9 2.1 Disparity 9 2.1.1 Stereo Matching 10 2.1.2 Depth Computation 12 2.2 Depth Adjustment 13 2.2.1 Parallax Adjustment 14 2.2.2 Virtual Planar Projection 15 2.3 Image Inpainting 17 Chapter 3 The Proposed System 21 3.1 System Overview 22 3.2 Stereo Matching 23 3.3 Object Segmentation 24 3.4 Automatic Object Segmentation 25 3.4.1 Pre-rectification of the Object Masks 26 3.4.2 Production of Another Object Masks 29 3.4.3 Rectification of the Depth Maps 31 3.5 Object Shifting 33 3.6 Object Scaling 35 3.7 Stereoscopic Inpainting 39 3.7.1 Filling of Depth Maps 40 3.7.2 Consistency Completion 42 3.7.3 Inpainting of Color Images 43 3.8 Temporal Smooth 46 Chapter 4 Experimental Results 49 4.1 Results of The Proposed Framework 49 4.1.1 Object Segmentation Results 49 4.1.2 Stereoscopic Inpainting 51 4.1.3 Temporal Smooth 55 4.2 Comparisons With Other Inpainting Algorithms 56 4.3 Results of Stersoscopic Images 59 Chapter 5 Conclusions 64 Chapter 6 Future Work 65 References 66

    [1] B. Mendiburu, 3D Movie Making, United States: Focal Press Publications, 2009.
    [2] S. Reeve and J. Flack, "Basic Principles of Stereoscopic 3D," BSKYB, 2010.
    [3] L. Zhang and W. J. Tam, "Stereoscopic Image Generation Based on Depth Images for 3D TV," IEEE Transactions on Broadcasting, vol. 51, no. 2, pp. 191–199, 2005.
    [4] N. Hemenway, "Stereoscopy Production," Stereoscopy.co, 2008. [Online]. Available: http://stereoscopy.co/more/methods/production. [Accessed 10 05 2015].
    [5] Y. Feng, J. Ren and J. Jiang, "Object-Based 2D-to-3D Video Conversion for Effective Stereoscopic Content Generation in 3D-TV Applications," IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 500–509, 21 April 2011.
    [6] N. Lazaros, G. C. Sirakoulis and A. Gasteratos, "Review of Stereo Vision Algorithms: From Software to Hardware," International Journal of Optomechatronics, vol. 2, no. 4, pp. 435–462, 2008.
    [7] K. J. Yoon and I. S. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 650–656, 2006.
    [8] J. W. Shi, "Fast Disparity Estimation Based on Cost-Reproduced Local Stereo Matching for High Resolution Video Sequence," M.S. thesis, Inst. Comput. Commun. Eng., Natl. Cheng Kung Univ., Tainan, Taiwan, 2014.
    [9] B. Price and S. Cohen, "StereoCut: Consistent interactive object selection in stereo image pairs," in IEEE International Conference on Computer Vision (ICCV), Barcelona, 2011.
    [10] A. T. Chiang, "Image Segmentation for Depth Estimation of Single View Images," M.S. thesis, Inst. Comput. Commun. Eng., Natl. Cheng Kung Univ., Tainan, Taiwan 2009.
    [11] Z. Arican, S. Yea, A. Sullivan and A. Vetro, "Intermediate View Generation for Perceived Depth Adjustment of Stereo Video," in SPIE Conference on Applications of Digital Image Processing, San Diego, CA, 2009.
    [12] H. Park, H. Lee and S. Sull, "Object Depth Adjustment Based on Planar Approximation in Stereo Images," in IEEE International Conference on Consumer Electronics, Berlin, 2011.
    [13] H. Park, H. Lee and S. Sull, "Efficient Viewer-Centric Depth Adjustment Based on Virtual Fronto-Parallel Planar Projection in Stereo 3D Images," IEEE Transactions on Multimedia, vol. 16, no. 2, pp. 326–336, 2014.
    [14] C. Guillemot and O. L. Meur, "Image Inpainting : Overview and Recent Advances," IEEE Signal Processing Magazine, vol. 31, no. 1, pp. 127–144, 2014.
    [15] A. Telea, "An Image Inpainting Technique Based on the Fast Marching Method," J. Graphics Tools, vol. 9, no. 1, pp. 25–36, 2004.
    [16] C. Barnes, E. Shechtman, A. Finkelstein and D. B. Goldman, "PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing," ACM Transactions on Graphics, vol. 28, no. 3, pp. 1–11, 2009.
    [17] A. Criminisi, P. Perez and K. Toyama, "Region Filling and Object Removal by Exemplar-Based Image Inpainting," IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 1200–1212, 2004.
    [18] Y. Liu and V. Caselles, "Exemplar-Based Image Inpainting Using Multiscale Graph Cuts," IEEE Transactions on Image Processing, vol. 22, no. 5, pp. 1699–1711, 2013.
    [19] I. Daribo and H. Saito, "A Novel Inpainting-Based Layered Depth Video for 3DTV," IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 533–541, 2011.
    [20] L. Ma, L. Do and P. H. N. d. With, "Depth-Guided Inpainting Algorithm for Free-Viewpoint Video," in IEEE International Conference on Image Processing (ICIP), Orlando, FL, 2012.
    [21] I. Ahn and C. Kim, "A Novel Depth-Based Virtual View Synthesis Method for Free Viewpoint Video," IEEE Transactions on Broadcasting, vol. 59, no. 4, pp. 614–626, 2013.
    [22] S. Muddala, M. Sjostrom and R. Olsson, "Depth-Based Inpainting for Disocclusion Filling," in 3DTV-Conference, Budapest, 2014.
    [23] L. Wang, H. Jin, R. Yang and M. Gong, "Stereoscopic Inpainting: Joint Color and Depth Completion From Stereo Images," in IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008.
    [24] A. Hervieu, N. Papadakis, A. Bugeau, P. Gargallo and V. Caselles, "Stereoscopic Image Inpainting: Distinct Depth Maps and Images Inpainting," in International Conference on Pattern Recognition (ICPR), Istanbul, 2010.
    [25] A. Hervieux, N. Papadakis, A. Bugeau, P. Gargallo and V. Caselles, "Stereoscopic Image Inpainting Using Scene Geometry," in IEEE International Conference on Multimedia and Expo (ICME), Barcelona, Spain, 2011.
    [26] F. H. Cheng and M. D. Loo, "An Image Inpainting Method for Stereoscopic Images Based on Hole Classification," in International Conference on Ubi-Media Computing and Workshops (UMEDIA), Ulaanbaatar, 2014.
    [27] F. Raimbault and A. Kokaram, "Stereo Video Inpainting," J. Electron. Imaging, 2012.

    無法下載圖示 校內:2020-08-06公開
    校外:不公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE