簡易檢索 / 詳目顯示

研究生: 廖偉丞
Liao, Wei-Chen
論文名稱: 基於紋理與深度一致性深度重建於CTDP封裝格式之應用
Efficient Depth Reconstruction Based on Texture and Depth Consistency for CTDP Format
指導教授: 楊家輝
Yang, Jar-Ferr
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電腦與通信工程研究所
Institute of Computer & Communication Engineering
論文出版年: 2015
畢業學年度: 103
語文別: 英文
論文頁數: 77
中文關鍵詞: 幀兼容格式單視角單景深深度校正深度內插
外文關鍵詞: Frame compatible, 2D-plus-depth, Depth calibration, Depth interpolation
相關次數: 點閱:74下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近幾十年來,多視角立體電視的需求日漸提高,然而,目前立體視訊廣播仍然使用舊有的裝置,幀兼容格式是第一個會遇到的問題,其中紋理搭配對應景深的格式被認為是可能的選項之一,但是這樣的封裝格式卻因為景深的縮放,導致再接收端得到不正確的景深資訊,而影響最後合成視角的品質。因此,為了克服這個問題,我們提出了一個基於紋理與深度一致性的封裝格式,利用此方法,我們可以在接收端得到較正確的景深,尤其是在靠近邊界的區域,近而使的合成視角的影像品質得到提升。最後,在實驗設計上,利用3組MPEG的立體測試序列模擬影像封裝的過程,我們證實提出的方法相較於現有的格式更能擁有正確的景深。此外,也藉由深度影像繪圖的方法產生合成視角的影像,由我們方法中重建的景深所合成的視角亦能獲得較佳的影像品質。

    In recent decades, the requirement of the multi-view 3D TV rises. The 3D videos service, which is widespread to everywhere through cable, terrestrial channels and the Internet, becomes the important issue recently. The frame compatible format is the first difficulty. The texture and corresponding depth are considered to be one of the possible options. However, such packing formats have depth errors at the receiver side due to the sampling of the depth images, which leads to poor image quality of the synthesis views. To overcome the depth errors problem, in this thesis, we propose a packing format, which reconstructs the depth images based on texture and depth consistency. Experimental results, which were carried out with three 3D MPEG test sequences in simulation of packing procedure, show that we can obtain more correct reconstructed depth images at receiver side, especially in the area near the border. In addition, the proposed method can also have better image quality of synthesis views by DIBR technique.

    摘 要 I Abstract II 誌謝 III Contents IV List of Tables VI List of Figures VII Chapter 1 Introduction 1 1.1 RESEARCH BACKGROUND 1 1.2 MOTIVATIONS 2 1.3 LITERATURE REVIEW 3 1.3.1 Problem Statement: 5 1.3.2 Contribution Summary: 6 1.4 THESIS ORGANIZATION 7 Chapter 2 Related Work 8 2.1 CURRENT FRAME COMPATIBLE FORMATS 8 2.2 TILE FORMAT (TF) 10 2.3 CENTRALIZED TEXTURE-DEPTH PACKING FORMAT (CTDP) 11 Chapter 3 Image Interpolation 16 3.1 BILINEAR INTERPOLATION (BI) 16 3.2 BI-CUBIC CONVOLUTION INTERPOLATION (BC) 18 3.3 NEW EDGE DIRECTED INTERPOLATION (NEDI) 19 3.4 JOINT BILATERAL UP-SAMPLING (JBU) 22 Chapter 4 The Proposed Method 24 4.1 OVERVIEW OF THE PROPOSED SYSTEM 24 4.2 YCBCR CALIBRATION 26 4.3 DE-PACKING WITH TEXTURE SIMILARITY 32 4.4 PACKING WITH THE SAMPLE PATTERNS 41 4.4.1 Direct Line Pattern 41 4.4.2 Slant Line Pattern 44 Chapter 5 Experimental Results 46 5.1 EXPERIMENTAL ENVIRONMENT 46 5.2 SIMULATION RESULTS OF RECONSTRUCTED DEPTH 49 5.2.1 YCbCr Calibration 49 5.2.2 Depth Up-sampling 53 5.2.3 Sampling Patterns 59 5.2.4 Comparison between Refined CTDP and Original CTDP 61 5.3 SIMULATION RESULTS OF SYNTHESIS VIEWS 65 5.4 COMPARISON WITH OTHER DEPTH INTERPOLATION METHODS 71 Chapter 6 Conclusions 73 Chapter 7 Future Works 74 References 75

    [1] T. Kanade and M. Okutomi, “A Stereo Matching Algorithm with and Adaptive Window: Theory and Experiment,” IEEE Trans. on Pattern Analysis and Matching Intelligence, vol. 16, no. 9, pp.920-932, Sept. 1994.
    [2] K. Zhang, J Lu and G. Lafruit, “Cross-based Local Stereo Matching Using Orthogonal Integral Images,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 19, no. 7, pp.1073-1079, July 2009.
    [3] S.-C. Chan, H.-Y. Shum, and K.-T. Ng, “Image-based Rendering and Synthesis,” IEEE Signal Process. Mag., vol. 24, no. 6, pp. 22–33, Nov. 2007.
    [4] T.-C. Yang, B.-D. Liu, and J.-F. Yang, “Depth Image-based Rendering with Edge-oriented Hole Filling for Multiview Synthesis,” Proc. of International Conference of 3D Systems and Applications, Shin-Chu, June 2012.
    [5] I. Sexton, “Parallax Barrier 3-D TV”, SPIE Proceeding, Vol. 1083, p. 84 (1989).
    [6] Ai-Hong Wanga, Qiong-Hua Wang, Xiao-Fang Li and Da-Hai Li, “Combined lenticular lens for autostereoscopic three dimensional display,” Optik 123 (2012) 827–830.
    [7] Dolby Open Specification for Frame-Compatible 3D systems, http://www.dolby.com/ , Dolby Laboratories, Inc.
    [8] Advanced Video Coding for Generic Audio‐Visual Services, available for download at http://www.itu.int.
    [9] ISO/IEC JTC 1/SC 29/WG11, Text of ISO/IEC 14496 10 Advanced Video Coding (Third Edition), Sullivan, Wiegand, Marpe, and Luthra, Doc. N6540, July 2004.
    [10] ISO/IEC JTC 1/SC 29/WG11, ISO/IEC 14496‐10:200X/FPDAM 1, G. J. Sullivan, A. M. Tourapis, Yamakage, and Lim, April 2009.
    [11] Sisvel Technology. 3D Tile Format for Broadcasters (2012, Jul.)
    [Online].Available:http://www.sisveltechnology.it/media/files/3dtv/3DTile-Format-for-Broadcasters.pdf.
    [12] Sisvel Technology. 3D Tile Format Implementation Notes (2012, Jul.)
    [Online]. Available: http://www.sisveltechnology.it/media/files/3dtv/3DTile-
    Format-implementation-notes.pdf.
    [13] Phil Blanchfield and Demin Wang, “Improved Tile Format of Stereoscopic Video for 3-D TV Broadcasting,” IEEE TRANSACTIONS ON BROADCASTING, VOL. 60, NO. 1, MARCH 2014.
    [14] Philips 3D Solutions: 3D Interface Specifications White Paper.
    [15] Jar-Ferr Yang, Hung-Ming Wang, Key-Ing Liao, Xin Jin, Lu Yu, “Centralized Texture-Depth Packing Formats for Effective 3D Video Transmission over Current Video Broadcasting Systems,”
    [16] J.-F. Yang, K.-Y. Liao, H.-M. Wang and C.-Y. Chen, “Centralized Texture-Depth Packing (CTDP) SEI Message,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document no. JCT3V-K0027, Geneva, Feb. 2015.
    [17] E. Angel and A. Jain, “A Nearest Neighbors Approach to Multidmnsional Filtering,” IEEE Conf. on Decision and Control, pp. 84-88, 1972.
    [18] R. G. Keys, “Cubic Convolution Interpolation for Digital Image Processing,” IEEE Trans. on Acoust., Speech, Signal Process., vol. ASSP-29, pp. 1153-1160, 1981.
    [19] H. C. Andrews, C. L. Patterson, “Digital Interpolation of Discrete Images,” IEEE Trans. on Computers, vol. 25, no. 2, 1976.
    [20] X. Li and M. T. Orchard, “New Edge-Directed Interpolation,” IEEE Trans. on Image Process., vol. 10, no. 10, pp. 1521-1527, 2001.
    [21] N. Jayant and P. Noll, “Digital Coding of Waveforms: Principles and Applications to Speech and Video,” Prentice-Hall, 1984.
    [22] Y. Yun, J. Bae, and J. Kim, “Adaptive Multidirectional Edge Directed Interpolation for Selected Edge Regions,” IEEE Conf. on TENCON, pp. 385-388, 2011.
    [23] N. Asuni and A. Giachetti, “Accuracy Improvements and Artifacts Removal in Edge Based Image Interpolation,” International Conf. on Computer Vision Theory and Applications, pp. 58-65, 2008.
    [24] W. S. Tam, C. W. Kok, and W. C. Siu, “Modified Edge-Directed Interpolation for Images,” Journal of Electronic Imaging, vol. 19, no. 1, 2010.
    [25] C. S. Wong and W. C. Siu, “Further Improved Edge-Directed Interpolation and Fast EDI for SDTV to HDTV Conversion,” international Conf. on European Signal Processing, pp. 309-313, 2010.
    [26] Yang-Ting Chou, Wei-Chen Liao, Ya-Han Hu, and Jar-Ferr Yang “Accuracy Improvements Based On Edge Directed Interpolation with Variable-Block” Conf. in CVGIP 2014.
    [27] J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele. “Joint bilateral upsampling”. ACM Transaction on Graphics, 26(3), 2007.
    [28] Dongbo Min, Jiangbo Lu, Viet-Anh Nguyent and Minh N. Do. “Weighted mode filtering and its applications to depth video enhancement and coding”. International Conf on IEEE ICASSP2012, pp 5433-5436.

    [29] Xinxin Zuo, Jiangbin Zheng. “A Refined Weighted Mode Filtering Approach for Depth Video Enhancement” International Conf on Virtual Reality and Visualization, pp 138-144, 2013.
    [30] Sung-Yeol Kim and Yo-Sung Ho. “Fast Edge-Preserving Depth Image Upsampler” Journal of Consumer Electronics vol. 58, no. 3, pp 971-977, 2012.
    [31] Ming-Yu Liu, Oncel Tuzel, and Yuichi Taguchi. “Joint Geodesic Upsampling of Depth Images” International Conf on Computer Vision and Pattern Recognition, pp 169-176, 2013.
    [32] AVS coders http://www.avs.org.cn/fruits/softList.asp
    [33] HEVC coders http://hevc.hhi.fraunhofer.de/

    無法下載圖示 校內:2025-12-31公開
    校外:不公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE