在過去幾十年來，人們對3D娛樂的需求日益增長，為了在現有的2D電視廣播系統中傳輸3D影像資訊，框兼容3D格式設計已被用來作為傳輸的媒介。於不同的框兼容3D格式中，使用彩圖與其對應的深度圖被視為對多視角3D電視的解決方案。然而，一般直接封裝的彩圖搭配對應景深格式在其縮放的過程中，在解封裝的彩圖及深度圖上皆會大量降低品質，進而降低其解封裝3D影像的品質。因此，影像置中深度封裝格式被提出來以提升解封裝後的影像品質。本論文乃基於原來的影像置中深度封裝(CTDP)格式系統，提出仿YCbCr轉換以及鄰近次像素深度重建等方法，前者主要利用梅花狀的交錯格式描述深度像素，而後者則根據未知景深之鄰近已知景深及圖像資訊，計算出最佳未知景深值。本篇論文中的實驗主要分為兩個部分，分別針對未壓縮與已壓縮的測試CTDP 3D影像做模擬實驗，不論是在未壓縮還是已壓縮的模擬實驗中，其實驗結果皆顯示修改過後的影像置中深度封裝格式系統與原來的系統相比，可以得到有更佳品質的重建深度圖以及合成虛擬圖。

In the past decades, the demand of the 3D entertainment grows intensively. To fit the existing 2DTV broadcasting channels, frame compatible 3D formats are utilized to deliver the 3D video information. Among these frame compatible 3D formats, those using texture and its corresponding depth map are considered as a good solution for multi-view 3DTV displays. Due to subsampling procedures, 2D-plus-depth packing formats bring seriously image degradation both in the depacked texture frame and depth map, which reduce the quality of the depacked 3D videos. Hence, to improve the quality of the depacked 3D video, the centralized texture and depth packing (CTDP) formats were proposed. In this thesis, the CTDP formats are further modified both with the emulated YCbCr transform and the adjacent sub-pixel depth rebuilding. The former utilizes the quincunx arrangement of the depth pixels. The latter is applied to interpolate the unknown depth pixel with its adjacent known texture and depth pixels to achieve the best interpolated unknown depth pixel. The simulations are conducted for uncoded and coded CTDP 3D video sequences and the results show the refined CTDP system gives better quality of the reconstructed depth as well as the synthesized view than the original CTDP system.

[1] T. Kanade and M. Okutomi, “A Stereo Matching Algorithm with and Adaptive Window: Theory and Experiment,” IEEE Transaction on Pattern Analysis and Matching Intelligence, vol. 16, no. 9, pp.920-932, Sept. 1994.
[2] K. Zhang, J. Lu, and G. Lafruit, “Cross-based Local Stereo Matching Using Orthogonal Integral Images,” IEEE Transaction on Circuits and Systems for Video Technology, vol. 19, no. 7, pp.1073-1079, July 2009.
[3] S.-C. Chan, H.-Y. Shum, and K.-T. Ng, “Image-based Rendering and Synthesis,” IEEE Signal Processing Magazine, vol. 24, no. 6, pp. 22–33, Nov. 2007.
[4] T.-C. Yang, P.-C. Kuo, B.-D. Liu, and J.-F. Yang, “Depth Image-based Rendering with Edge-oriented Hole Filling for Multiview Synthesis,” Proc. of International Conference of Communications, Circuits, and Systems, vol. 1, pp. 50-53, June 2013.
[5] I. Sexton, “Parallax Barrier 3-D TV,” Proc. of SPIE, vol. 1083, pp. 84 (1989).
[6] A.-H. Wanga, Q.-H. Wang, X.-F. Li, and D.-H. Li, “Combined Lenticular Lens for Autostereoscopic Three Dimensional Display,” Optik-International Journal for Light and Electron Optics, vol. 123, no. 3, pp. 827-830, May 2012.
[7] “Dolby Open Specification for Frame-compatible 3D Systems,” Dolby Laboratories, Inc.: http://www.dolby.com/
[8] J.-V. Team, “Advanced Video Coding for Generic Audio-visual Services,” ITU-T Rec. H 264, 14496-10.
[9] Sullivan, Wiegand, Marpe, and Luthra, “Advanced Video Coding (Third Edition),” ISO/IEC JTC 1/SC 29/WG11, Text of ISO/IEC 14496 10, Doc. N6540, July 2004.
[10] G. J. Sullivan, A. M. Tourapis, Yamakage, and Lim, ISO/IEC JTC 1/SC 29/WG11, ISO/IEC 14496‐10:200X/FPDAM 1, April 2009.
[11] Sisvel Technology. 3D Tile Format for Broadcasters (July 2012)
[Online]. Available:http://www.sisveltechnology.it/media/files/3dtv/3DTile-Format-for-Broadcasters.pdf.
[12] Sisvel Technology. 3D Tile Format Implementation Notes (July 2012)
[Online]. Available:http://www.sisveltechnology.it/media/files/3dtv/3DTile-Format-implementation-notes.pdf.
[13] P. Blanchfield and D. Wang, “Improved Tile Format of Stereoscopic Video for 3-D TV Broadcasting,” IEEE Transaction on Broadcasting, vol. 60, no. 1, pp. 134-140, March 2014.
[14] G. Tech, K. Wegner, Y. Chen, and S. Yea, “Draft of 3D- HEVC test model description,” ITU-T SG 16 WP 3 & ISO/IEC JTC 1/SC 29/WG 11 JCT3V-B1005, Oct. 2012.
[15] SMPTE, http://www.smpte.org
[16] 3D@home consortium, http://www.3dathome.org
[17] Philips 3D Solutions: 3D Interface Specifications White Paper.
[18] Philips, Whitepaper WOWvx BlueBox.
[19] J.-F. Yang, K.-Y. Liao, H.-M. Wang and Y.-H. Hu, “Centralized Texture-Depth Packing (CTDP) SEI Message Syntax,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, Document no. JCT3V-J0108, Strasbourg, Oct. 2014.
[20] J.-F. Yang, K.-Y. Liao, H.-M. Wang, and C.-Y. Chen, “Centralized Texture-Depth Packing (CTDP) SEI Message,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 11th Meeting: Document: JCT3V-K0027, Geneva, CH, Feb. 2015.
[21] J.-F. Yang, H.-M. Wang, and C.-Y. Chen, “Revised Centralized Texture-Depth Packing (CTDP) SEI Message and Its Performance Improvement by Depth Enhancement,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 12th Meeting: Document: JCT3V-L0022, Warsaw, PL, June. 2015.
[22] J.-F. Yang, H.-M. Wang, and C.-Y. Chen, “Centralized Texture-Depth Packing SEI Message for HEVC,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 13th Meeting: Document: JCT3V-M0022, Geneva, CH, Oct. 2015.
[23] Poynton, C. A. “A Technical Introduction to Digital Video.” John Wiley & Sons, Inc., pp. 175-176, 1996.
[24] E. Angel and A. Jain, “A Nearest Neighbors Approach to Multidmnsional Filtering,” IEEE Conference. on Decision and Control, pp. 84-88, Dec. 1972.
[25] R. G. Keys, “Cubic Convolution Interpolation for Digital Image Processing,” IEEE Transactions on Acoustics, Speech, and Signal Processing., vol. 29, pp. 1153-1160, Dec. 1981.
[26] Duchon, C. E. "Lanczos Filtering in One and Two Dimensions." Journal of Applied Meteorology 18.8 (1979): 1016-1022.
[27] AVS coders http://www.avs.org.cn/fruits/softList.asp
[28] HEVC coders http://hevc.hhi.fraunhofer.de/
[29] B. Bross, W.-J. Han, J.-R. Ohm, G. J. Sullivan, Y.-K. Wang, T. Wiegand, “High Efficiency Video Coding (HEVC) text specification draft 10 (for FDIS & Consent),” Document no. JCTVC-L1003, Jan. 2013.
[30] J.-F. Yang, H.-M. Wang, C.-Y. Chen, and T.-A. Chang, “Centralized Texture-Depth Packing SEI Message for HEVC,” Joint Collaborative Team on 3D Video Coding Extensions of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, the 14th Meeting: Document: JCT3V-N0022, San Diego, USA, Feb. 2016.