本論文提出一種對於新色彩深度解包裝之深度圖像生成的硬體架構實現。相較於一般的幀兼容格式，新色彩深度包裝格式對於彩圖以及深度圖在垂直方向皆將採樣降至四分之三的解析度再進行處理，當此格式解包裝時，則需對於彩圖以及深度圖在垂直方向做採樣提升。
本硬體架構採用Lanczos濾波器來進行兩階段的升採樣和降採樣。為了簡化硬體實現起見，本論文將濾波器的係數調整為以移位方式就可達成的係數。藉由十二列的記憶體空間，將每三個垂直方向的像素升採樣為四個像素，而經由深度圖像生成演算法，解包裝後的影像可生成出不同視角之虛擬影像。
硬體架構方面，本設計以TSMC 0.18 μm製程合成的結果，共需要6.34 k個邏輯閘，系統操作頻率可達到100 MHz，可支援包裝影像格式至1920 × 1088，而解包裝後影像之峰值信噪比平均值可達到41 dB。

In this thesis, a hardware architecture of depth image-based rendering (DIBR) for new video and depth de-packing is proposed. Unlike the format of one view plus one depth, the advanced 2D compatible format reduces the bitrates of both color and depth frames.
In the proposed architecture, the Lancos filter is adopted for the proposed two-stage resizing. For hardware implementation, the coefficients of lanczos filter are modified to the coefficients which can be achieved by shifting. For every three pixels in vertical direction, total twelve line buffers are used to store the information and output four pixels. Then the DIBR system can synthesize the other viewpoints for the 3D display.
Simulation result shows that the proposed system requires 6.34k gates. The proposed architecture can achieve 100 MHz. The maximum frame size achieves FHD (1920 × 1088). The proposed architecture achieves 41 dB in the average PSNR.

[1] C. Fehn, K. Hopf, and B. Quante, “Key technologies for an advanced 3D TV system,” in Proc. SPIE Three-Dimensional TV, Video, and Display Ⅲ, Oct. 2004, pp. 66–80.
[2] C. Fehn, R. D. L. Barre, and S. Pastoor, “Interactive 3-DTV: concepts and key technologies,” Proc. IEEE, vol. 94, pp. 524–538, 2006.
[3] C. Fehn, “Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV,” in Proc. SPIE Stereoscopic Displays and Virtual Reality Syst., Jan. 2004, pp. 93–104.
[4] K. J. Yoon and S. Kweon, “Adaptive support-weight approach for correspondence search,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, pp. 650–656, Apr. 2006.
[5] M. C. Yang, J. Y. Liu, Y. C. Yang, and K. H. Chen, “A quality-improved stereo matching by using incrementally-averaging orthogonally-scanned edge detection,” in Proc. Int. Conf. 3DSA, June 2012, pp. 489–491.
[6] K. Zhang, J. Lu, and G. Lafruit, “Cross-based local stereo matching using orthogonal integral images,” IEEE Trans. Circuits Syst. Video Technol., vol. 19, pp. 1073–1079, July 2009.
[7] D. Kim, D. Min, and K. Sohn, “A stereoscopic video generation method using stereoscopic display characterization and motion analysis,” IEEE Trans. Broadcast., vol. 54, pp. 188–197, June 2008.
[8] J. Lee, S. Yoo, M. Kang, C. Chun, and C. Kim, “Depth estimation from a single image using salient objects detection,” in Proc. Int. Conf. 3DSA, June 2012, pp. 264–267.
[9] M. T. Pourazad, P. Nasiopoulos, and R. K. Ward, “An H.264-based scheme for 2D to 3D video conversion,” IEEE Trans. Consum. Electron., vol. 55, pp. 742–748, May 2009.
[10] Y. Feng, J. Ren, and J. Jiang, “Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications,” IEEE Trans. Broadcast., vol. 57, pp. 500–509, June 2011.
[11] Y. C. Fan and T. C. Chi, “The novel non-hole-filling approach of depth image based rendering,” in Proc. IEEE 3DTV, May 2008, pp. 325–328.
[12] C. Fehn, “A 3D-TV approach using depth-image-based rendering (DIBR),” in Proc. Vis., Imaging, and Image Process., Sept. 2003, pp. 482–487.
[13] A. Redert, M. O. de Beeck, C. Fehn, W. Ijsselsteijn, M. Pollefeys, L. V. Gool, E. Ofek, I. Sexton, and P. Surman, “ATTEST-advanced three-dimensional television system technologies,” in Proc. IEEE 3DPVT, Jan. 2002, pp. 313–319.
[14] A. Woods, T. Docherty, and R. Koch, “Image distortions in stereoscopic video systems,” in Proc. SPIE Stereoscopic Displays Appl., Feb. 1993, pp. 36–48
[15] W. A. IJsselsteijn, H. de Ridder, and J. Vliegen, “Effects of stereoscopic filming parameters and display duration on the subjective assessment of eye strain,” in Proc. SPIE Stereoscopic Displays Virtual Reality Syst., Apr. 2000, pp. 12–22.
[16] I. Daribo and H. Saito, “A novel inpainting-based layered depth video for 3DTV,” IEEE Trans. Broadcast., vol. 57, pp. 533–541, June 2011.
[17] P. Ndjiki-Nya, M. Koppel, D. Doshkov, H. Lakshman, P. Merkle, K. Muller, and T. Wiegand, “Depth image-based rendering with advanced texture synthesis for 3-D video,” IEEE Trans. Multimedia, vol. 13, pp. 453–465, June 2011.
[18] M. Solh and G. AlRegib, “Hierarchical hole-filling (HHF): depth image based rendering without depth map filtering for 3D-TV,” in Proc. IEEE MMSP, Oct. 2010, pp. 87–92.
[19] M. S. Ko, D. W. Kim, D. L. Jones, and J. Yoo, “A new common-hole filling algorithm for arbitrary view synthesis,” in Proc. Int. Conf. 3DSA, June 2012, pp. 242–245.
[20] A. Criminisi, P. Perez, and K. Toyama, “Region filling and object removal by exemplar-based image inpainting,” IEEE Trans. Image Process., vol. 13, pp. 1200–1212, Sept. 2004.
[21] W. J. Tam, G. Alain, L. Zhang, T. Martin, and R. Renaud, “Smoothing depth maps for improved stereoscopic image quality,” in Proc. SPIE Three-Dimensional TV, Video, and Display Ⅲ, Oct. 2004, pp. 162–172.
[22] L. Zhang and W. J. Tam, “Stereoscopic image generation based on depth images for 3DTV,” IEEE Trans. Broadcast., vol. 51, pp. 191–199, June 2005.
[23] W. Y. Chen, Y. L. Chang, S. F. Lin, L. F. Ding, and L. G. Chen, “Efficient depth image based rendering with edge dependent depth filter and interpolation,” in Proc. IEEE ICME, July 2005, pp. 1314–1317.
[24] T. C. Lin, H. C. Huang, and Y. M. Huang, “Preserving depth resolution of synthesized images using parallax-map-based DIBR for 3D-TV,” IEEE Trans. Consum. Electron., vol. 56, pp. 720–727, May 2010.
[25] H. Dong, S. Jianfei, and X. Ping, “Improvement of virtual view rendering based on depth image,” in Proc. IEEE ICIG, Aug. 2011, pp. 254–257.
[26] P. J. Lee and Effendi, “Nongeometric distortion smoothing approach for depth map preprocessing,” IEEE Trans. Multimedia, vol. 13, pp. 246–254, Apr. 2011.
[27] L. H. Wang, X. J. Huang, M. Xi, D. X. Li, and M. Zhang, “An asymmetric edge adaptive filter for depth generation and hole filling in 3DTV,” IEEE Trans. Broadcast., vol. 56, pp. 425–431, Sept. 2010.
[28] Jar-Ferr Yang, Hung-Ming Wang, and Yi-An Chiang, "2D Backwards Compatible Centralized Color-Depth Packing (JCT3V-F0087)", Oct. 2013.
[29] E. Angel and A. Jain, “A nearest neighbors approach to multidimensional filtering,” in Proc. IEEE CDC, Dec. 1972, pp.13–15.
[30] H. C. Andrews, C. L. Patterson, “Digital interpolation of discrete images,” IEEE Trans. Comput. Soc, vol. C-25, pp. 196–202, Feb. 1976.
[31] R. Keys, “Cubic convolution interpolation for digital image processing,” IEEE Trans. Acoust. speech signal proc, vol. 29, pp. 1153–1160, Dec. 2010.
[32] S.E. Recichenbach and F. Geng, “Two-dimensional cubic convolution,” IEEE Trans. Image Process., vol.12, pp. 857–865, Aug. 2003.
[33] H. S. Hou and H. C. Andrews, “Cubic splines for image interpolation and digital filtering,” IEEE Trans. Acoust., speech and signal proc., vol. 26, pp. 508–517, Dec. 1978.
[34] A. S. Glassner, Graphics Gems. California, U.S.A.: Academic Press, 1990, pp. 147–165.