在過去幾十年來，人們對3D娛樂的需求日益增長，為了在現有的2D電視廣播系統中傳輸3D影像資訊，框兼容3D格式設計已被用來作為傳輸的媒介。於框兼容3D格式中，使用彩圖加深度圖之格式被視為對多視角3D電視的解決方案。然而，編解包裝的彩圖及深度圖縮放過程中，上下採樣會大量降低其品質，直接彩圖與景深的包裝格式會大量降低其解封裝3D影像的品質。因此，影像置中深度包裝格式(CTDP)被提出來以提升編解包裝後的影像品質。本論文乃基於原來的影像置中深度包裝格式系統，提出RGB重調法及階層式權重上採樣方法已改算其品質。RGB重調法是目的為減少因廣播壓縮產生的失真;而階層式權重上採樣目的在還原原始深度圖解析度。本論文中的實驗主要分為兩個部分，分別針對未壓縮與已壓縮的測試CTDP 3D影像做模擬實驗，不論是在未壓縮還是已壓縮的模擬實驗中，其實驗結果皆顯示修改過後的影像置中深度包裝格式系統與原來的系統相比，可以得到有更佳品質的重建深度圖以及合成虛擬圖。

In the past decades, the demand of the 3D entertainment grows intensively. To fit the existing 2DTV broadcasting channels, frame compatible 3D formats are utilized to deliver 3D video information. Among these frame compatible 3D formats, the formats including texture frame and its depth map are considered as a good solution for multi-view 3DTV displays. Due to down and up sampling procedures, which reduce the quality of the depacked 3D videos, the 2D-plus-depth packing formats bring seriously degradation both in the depacked texture frame and depth map. Hence, to improve the quality of the depacked 3D videos, the centralized texture and depth packing (CTDP) formats were proposed [1]. In this thesis, the performances of the CTDP formats are further improved by an adjusted RGB color depth packing method and a hierarchical evolution weighted (HEW) depth sampling method. The purpose of adjusted RGB method is to reduce the distortions caused by broadcasting compression. The hierarchical evolution weighted upsampling method is to recover the spike distortion in upsampled depth map. The simulations are conducted for uncoded and coded CTDP 3D video sequences and the results show the refined CTDP system gives better quality of the reconstructed depth as well as the synthesized view than the original CTDP system.

[1] T. Kanade and M. Okutomi, “A Stereo Matching Algorithm with and Adaptive Window: Theory and Experiment,” IEEE Transaction on Pattern Analysis and Matching Intelligence, vol. 16, no. 9, pp.920-932, Sept. 1994.
[2] K. Zhang, J. Lu, and G. Lafruit, “Cross-based Local Stereo Matching Using Orthogonal Integral Images,” IEEE Transaction on Circuits and Systems for Video Technology, vol. 19, no. 7, pp.1073-1079, July 2009.
[3] H. Hirschmuller and S. Daniel, “Evaluation of stereo matching costs and images with radiometric difference,” IEEE trans. on pattern analysis and machine intelligence, vol. 31, no. 9, pp. 1582-1599, 2009.
[4] S.-C. Chan, H.-Y. Shum, and K.-T. Ng, “Image-based Rendering and Synthesis,” IEEE Signal Processing Magazine, vol. 24, no. 6, pp. 22–33, Nov. 2007.
[5] T.-C. Yang, P.-C. Kuo, B.-D. Liu, and J.-F. Yang, “Depth Image-based Rendering with Edge-oriented Hole Filling for Multiview Synthesis,” Proc. of International Conference of Communications, Circuits, and Systems, vol. 1, pp. 50-53, June 2013.
[6] I. Sexton, “Parallax Barrier 3-D TV,” Proc. of SPIE, vol. 1083, pp. 84 (1989).
[7] A.-H. Wanga, Q.-H. Wang, X.-F. Li, and D.-H. Li, “Combined Lenticular Lens for Autostereoscopic Three Dimensional Display,” Optik-International Journal for Light and Electron Optics, vol. 123, no. 3, pp. 827-830, May 2012.
[8] “Dolby Open Specification for Frame-compatible 3D Systems,” Dolby Laboratories, Inc.: http://www.dolby.com/
[9] J.-V. Team, “Advanced Video Coding for Generic Audio-visual Services,” ITU-T Rec. H 264, 14496-10.
[10] Sullivan, Wiegand, Marpe, and Luthra, “Advanced Video Coding (Third Edition),” ISO/IEC JTC 1/SC 29/WG11, Text of ISO/IEC 14496 10, Doc. N6540, July 2004.
[11] G. J. Sullivan, A. M. Tourapis, Yamakage, and Lim, ISO/IEC JTC 1/SC 29/WG11, ISO/IEC 14496‐10:200X/FPDAM 1, April 2009.
[12] Sisvel Technology. 3D Tile Format for Broadcasters (July 2012)
[Online]. Available:http://www.sisveltechnology.it/media/files/3dtv/3DTile-Format-for-Broadcasters.pdf.
[13] Sisvel Technology. 3D Tile Format Implementation Notes (July 2012)
[Online]. Available:http://www.sisveltechnology.it/media/files/3dtv/3DTile-Format-implementation-notes.pdf.
[14] P. Blanchfield and D. Wang, “Improved Tile Format of Stereoscopic Video for 3-D TV Broadcasting,” IEEE Transaction on Broadcasting, vol. 60, no. 1, pp. 134-140, March 2014.
[15] G. Tech, K. Wegner, Y. Chen, and S. Yea, “Draft of 3D- HEVC test model description,” ITU-T SG 16 WP 3 & ISO/IEC JTC 1/SC 29/WG 11 JCT3V-B1005, Oct. 2012.
[16] SMPTE, http://www.smpte.org
[17] 3D@home consortium, http://www.3dathome.org
[18] Philips 3D Solutions: 3D Interface Specifications White Paper.
[19] Philips, Whitepaper WOWvx BlueBox.
[20] J.-F. Yang, K.-Y. Liao, H.-M. Wang and Y.-H. Hu, “Centralized Texture-Depth Packing (CTDP) SEI Message Syntax,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document no. JCT3V-J0108, Strasbourg, Oct. 2014.
[21] J.-F. Yang, K.-Y. Liao, H.-M. Wang, and C.-Y. Chen, “Centralized Texture-Depth Packing (CTDP) SEI Message,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 11th Meeting: Document: JCT3V-K0027, Geneva, CH, Feb. 2015.
[22] J.-F. Yang, H.-M. Wang, and C.-Y. Chen, “Revised Centralized Texture-Depth Packing (CTDP) SEI Message and Its Performance Improvement by Depth Enhancement,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 12th Meeting: Document: JCT3V-L0022, Warsaw, PL, June. 2015.
[23] J.-F. Yang, H.-M. Wang, and C.-Y. Chen, “Centralized Texture-Depth Packing SEI Message for HEVC,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 13th Meeting: Document: JCT3V-M0022, Geneva, CH, Oct. 2015.
[24] Poynton, C. A. “A Technical Introduction to Digital Video.” John Wiley & Sons, Inc., pp. 175-176, 1996.
[25] E. Angel and A. Jain, “A Nearest Neighbors Approach to Multidmnsional Filtering,” IEEE Conference. on Decision and Control, pp. 84-88, Dec. 1972.
[26] R. G. Keys, “Cubic Convolution Interpolation for Digital Image Processing,” IEEE Transactions on Acoustics, Speech, and Signal Processing., vol. 29, pp. 1153-1160, Dec. 1981.
[27] Duchon, C. E. "Lanczos Filtering in One and Two Dimensions." Journal of Applied Meteorology 18.8 (1979): 1016-1022.
[28] AVS coders http://www.avs.org.cn/fruits/softList.asp
[29] HEVC coders http://hevc.hhi.fraunhofer.de/
[30] M. Solh and G. AlRegib, “Hierarchical Hole-filling for Depth-based View Synthesis in FTV and 3D video,” IEEE J. Sel. Topics Signal Process., vol. 6, no. 5, pp. 495–504, Sept. 2012.
[31] T.-C. Yang, B.-D. Liu, and J.-F. Yang, “Depth Image-based Rendering with Edge-oriented Hole Filling for Multiview Synthesis,” Proc. of International Conference of 3D Systems and Applications, Shin-Chu, June 2012.
[32] D. Kim, R. Seungchul and S. Kwanghoon, "Depth boundary reconstruction based on similarity of adjacent pixels for efficient 3-D video coding," IEEE Trans. on Consumer Electronics, vol. 59, no. 2, pp. 400-406, 2013.
[33] J.-F. Yang, K. Y. Liao, H.-M. Wang and C.-Y. Chen, “Centralized texture-depth packing (CTDP) SEI message”, ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JCT3V-K0027, Geneva, Feb. 2015.
[34] J.-F. Yang, H.-M. Wang and Y.-A. Chiang, “2D backwards compatible centralized color-depth packing”, ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JCT3VF0087, Geneva, Nov. 2013.
[35] J.-F. Yang and Gary Sullivan, “Conceptual study of potential centralized texture depth packing SEI message”, ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document: JCTVCAA1008, Hobart, April 2017.
[36] M. Tanimoto, T. Fujii, and K. Suzuki, “View synthesis algorithm in view synthesis reference software 3.0 (VSRS3.0),” Tech. Rep. Document M16090, ISO/IEC JTC1/SC29/WG11, 2009.
[37] B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, Y.-K. Wang, T. Wiegand, “High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Consent),” Document no. JCTVC-L1003, Jan. 2013.