| 研究生: |
廖偉丞 Liao, Wei-Chen |
|---|---|
| 論文名稱: |
基於紋理與深度一致性深度重建於CTDP封裝格式之應用 Efficient Depth Reconstruction Based on Texture and Depth Consistency for CTDP Format |
| 指導教授: |
楊家輝
Yang, Jar-Ferr |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering |
| 論文出版年: | 2015 |
| 畢業學年度: | 103 |
| 語文別: | 英文 |
| 論文頁數: | 77 |
| 中文關鍵詞: | 幀兼容格式 、單視角單景深 、深度校正 、深度內插 |
| 外文關鍵詞: | Frame compatible, 2D-plus-depth, Depth calibration, Depth interpolation |
| 相關次數: | 點閱:74 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近幾十年來,多視角立體電視的需求日漸提高,然而,目前立體視訊廣播仍然使用舊有的裝置,幀兼容格式是第一個會遇到的問題,其中紋理搭配對應景深的格式被認為是可能的選項之一,但是這樣的封裝格式卻因為景深的縮放,導致再接收端得到不正確的景深資訊,而影響最後合成視角的品質。因此,為了克服這個問題,我們提出了一個基於紋理與深度一致性的封裝格式,利用此方法,我們可以在接收端得到較正確的景深,尤其是在靠近邊界的區域,近而使的合成視角的影像品質得到提升。最後,在實驗設計上,利用3組MPEG的立體測試序列模擬影像封裝的過程,我們證實提出的方法相較於現有的格式更能擁有正確的景深。此外,也藉由深度影像繪圖的方法產生合成視角的影像,由我們方法中重建的景深所合成的視角亦能獲得較佳的影像品質。
In recent decades, the requirement of the multi-view 3D TV rises. The 3D videos service, which is widespread to everywhere through cable, terrestrial channels and the Internet, becomes the important issue recently. The frame compatible format is the first difficulty. The texture and corresponding depth are considered to be one of the possible options. However, such packing formats have depth errors at the receiver side due to the sampling of the depth images, which leads to poor image quality of the synthesis views. To overcome the depth errors problem, in this thesis, we propose a packing format, which reconstructs the depth images based on texture and depth consistency. Experimental results, which were carried out with three 3D MPEG test sequences in simulation of packing procedure, show that we can obtain more correct reconstructed depth images at receiver side, especially in the area near the border. In addition, the proposed method can also have better image quality of synthesis views by DIBR technique.
[1] T. Kanade and M. Okutomi, “A Stereo Matching Algorithm with and Adaptive Window: Theory and Experiment,” IEEE Trans. on Pattern Analysis and Matching Intelligence, vol. 16, no. 9, pp.920-932, Sept. 1994.
[2] K. Zhang, J Lu and G. Lafruit, “Cross-based Local Stereo Matching Using Orthogonal Integral Images,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 19, no. 7, pp.1073-1079, July 2009.
[3] S.-C. Chan, H.-Y. Shum, and K.-T. Ng, “Image-based Rendering and Synthesis,” IEEE Signal Process. Mag., vol. 24, no. 6, pp. 22–33, Nov. 2007.
[4] T.-C. Yang, B.-D. Liu, and J.-F. Yang, “Depth Image-based Rendering with Edge-oriented Hole Filling for Multiview Synthesis,” Proc. of International Conference of 3D Systems and Applications, Shin-Chu, June 2012.
[5] I. Sexton, “Parallax Barrier 3-D TV”, SPIE Proceeding, Vol. 1083, p. 84 (1989).
[6] Ai-Hong Wanga, Qiong-Hua Wang, Xiao-Fang Li and Da-Hai Li, “Combined lenticular lens for autostereoscopic three dimensional display,” Optik 123 (2012) 827–830.
[7] Dolby Open Specification for Frame-Compatible 3D systems, http://www.dolby.com/ , Dolby Laboratories, Inc.
[8] Advanced Video Coding for Generic Audio‐Visual Services, available for download at http://www.itu.int.
[9] ISO/IEC JTC 1/SC 29/WG11, Text of ISO/IEC 14496 10 Advanced Video Coding (Third Edition), Sullivan, Wiegand, Marpe, and Luthra, Doc. N6540, July 2004.
[10] ISO/IEC JTC 1/SC 29/WG11, ISO/IEC 14496‐10:200X/FPDAM 1, G. J. Sullivan, A. M. Tourapis, Yamakage, and Lim, April 2009.
[11] Sisvel Technology. 3D Tile Format for Broadcasters (2012, Jul.)
[Online].Available:http://www.sisveltechnology.it/media/files/3dtv/3DTile-Format-for-Broadcasters.pdf.
[12] Sisvel Technology. 3D Tile Format Implementation Notes (2012, Jul.)
[Online]. Available: http://www.sisveltechnology.it/media/files/3dtv/3DTile-
Format-implementation-notes.pdf.
[13] Phil Blanchfield and Demin Wang, “Improved Tile Format of Stereoscopic Video for 3-D TV Broadcasting,” IEEE TRANSACTIONS ON BROADCASTING, VOL. 60, NO. 1, MARCH 2014.
[14] Philips 3D Solutions: 3D Interface Specifications White Paper.
[15] Jar-Ferr Yang, Hung-Ming Wang, Key-Ing Liao, Xin Jin, Lu Yu, “Centralized Texture-Depth Packing Formats for Effective 3D Video Transmission over Current Video Broadcasting Systems,”
[16] J.-F. Yang, K.-Y. Liao, H.-M. Wang and C.-Y. Chen, “Centralized Texture-Depth Packing (CTDP) SEI Message,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document no. JCT3V-K0027, Geneva, Feb. 2015.
[17] E. Angel and A. Jain, “A Nearest Neighbors Approach to Multidmnsional Filtering,” IEEE Conf. on Decision and Control, pp. 84-88, 1972.
[18] R. G. Keys, “Cubic Convolution Interpolation for Digital Image Processing,” IEEE Trans. on Acoust., Speech, Signal Process., vol. ASSP-29, pp. 1153-1160, 1981.
[19] H. C. Andrews, C. L. Patterson, “Digital Interpolation of Discrete Images,” IEEE Trans. on Computers, vol. 25, no. 2, 1976.
[20] X. Li and M. T. Orchard, “New Edge-Directed Interpolation,” IEEE Trans. on Image Process., vol. 10, no. 10, pp. 1521-1527, 2001.
[21] N. Jayant and P. Noll, “Digital Coding of Waveforms: Principles and Applications to Speech and Video,” Prentice-Hall, 1984.
[22] Y. Yun, J. Bae, and J. Kim, “Adaptive Multidirectional Edge Directed Interpolation for Selected Edge Regions,” IEEE Conf. on TENCON, pp. 385-388, 2011.
[23] N. Asuni and A. Giachetti, “Accuracy Improvements and Artifacts Removal in Edge Based Image Interpolation,” International Conf. on Computer Vision Theory and Applications, pp. 58-65, 2008.
[24] W. S. Tam, C. W. Kok, and W. C. Siu, “Modified Edge-Directed Interpolation for Images,” Journal of Electronic Imaging, vol. 19, no. 1, 2010.
[25] C. S. Wong and W. C. Siu, “Further Improved Edge-Directed Interpolation and Fast EDI for SDTV to HDTV Conversion,” international Conf. on European Signal Processing, pp. 309-313, 2010.
[26] Yang-Ting Chou, Wei-Chen Liao, Ya-Han Hu, and Jar-Ferr Yang “Accuracy Improvements Based On Edge Directed Interpolation with Variable-Block” Conf. in CVGIP 2014.
[27] J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele. “Joint bilateral upsampling”. ACM Transaction on Graphics, 26(3), 2007.
[28] Dongbo Min, Jiangbo Lu, Viet-Anh Nguyent and Minh N. Do. “Weighted mode filtering and its applications to depth video enhancement and coding”. International Conf on IEEE ICASSP2012, pp 5433-5436.
[29] Xinxin Zuo, Jiangbin Zheng. “A Refined Weighted Mode Filtering Approach for Depth Video Enhancement” International Conf on Virtual Reality and Visualization, pp 138-144, 2013.
[30] Sung-Yeol Kim and Yo-Sung Ho. “Fast Edge-Preserving Depth Image Upsampler” Journal of Consumer Electronics vol. 58, no. 3, pp 971-977, 2012.
[31] Ming-Yu Liu, Oncel Tuzel, and Yuichi Taguchi. “Joint Geodesic Upsampling of Depth Images” International Conf on Computer Vision and Pattern Recognition, pp 169-176, 2013.
[32] AVS coders http://www.avs.org.cn/fruits/softList.asp
[33] HEVC coders http://hevc.hhi.fraunhofer.de/
校內:2025-12-31公開