| 研究生: |
陳宇航 Chen, Yu-Hang |
|---|---|
| 論文名稱: |
支援超高解析度3D顯示器的高效率GPU多視角合成系統 A High Efficient GPU-based Multiview Rendering System for Ultra High Definition 3D Displays |
| 指導教授: |
楊家輝
Yang, Gu-Hui |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering |
| 論文出版年: | 2014 |
| 畢業學年度: | 102 |
| 語文別: | 英文 |
| 論文頁數: | 71 |
| 中文關鍵詞: | 深度繪圖 、多視角立體影像 、二維至三維影像轉換 |
| 外文關鍵詞: | DIBR, multiview stereo image, 2D-to-3D conversion, ultra HD |
| 相關次數: | 點閱:111 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
從2014年美國消費性電子展(CES)的展出中,超高解析度(3840x2160)已經成為下一代螢幕的主流解析度,搭配裸眼立體顯示器不需配戴眼鏡即可瀏覽多視角立體影像的觀賞模式,能夠給予人們更舒適的視聽環境,因此超高解析度的裸眼立體顯示器被視為下一個世代的主流立體顯示技術。本論文旨在提出一個支援超高解析度和符合多樣性立體螢幕的即時視訊撥放系統,這個系統以深度繪圖演算法為基礎,開發一個適應性多視角合成系統,透過不同的樣板影像輔助可將一單視角單深度視訊接近即時合成出符合各種顯示輸出的多視角合成影像。另外本系統除有根據人因實驗之3D設定外,亦可以隨時根據使用者的喜好調整立體顯像效果,提供更多3D效果的觀賞選擇。
The naked-eye 3D display provides a revolution of vision experiences, compared to traditional stereo displays: audiences can enjoy more comfortable and unrestricted environment for multi-view 3D entertainment without the support of stereo glasses, therefore the naked-eye display is considered as a powerful and potential 3D displaying technique in the future. Due to the shortage of the native source for ultra HD multi-view displays, efficiently converting the conventional 2D color image with the depth information to the exact pattern that the auto-stereo display utilizes is a challenging research topic. The goal of this thesis is to build a near real-time system which could synthesize multi-view 3D images satisfying a variety of stereo displays; the proposed system modifies a template-based adaptive multi-view rendering ( TAMR ) algorithm to fit the ultra HD screen size. The system gives the initial 3D setting after an experiment of human factors, however, it can adjust 3D effects according to viewer’s demand immediately.
References
________________________________________
[1] Rotten Tomato http://www.rottentomatoes.com
[2] Masayuki Tanimoto, "Overview of FTV(free-viewpoint television)", Proc. of Multimedia and Expo(ICME), pp. 1552–1553, July 2009
[3] L. Lipton, Stereo Graphics Developers’ Handbook, StereoGraphics Corporation, San Rafael, C A, 1997.
[4] S. A. Valencia and R. M. Rodriguez-Dagnino, "Synthesizing stereo 3D views from focus cues in monoscopic 2D images", Proceedings of SPIE, Vol. 5006, pp. 377-388, 2003.
[5] Y. Feng, J. Ren , "Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications", IEEE Transactions on Broadcasting, Vol. 57, No. 2, June 2011
[6] H. M, Wang, C. H. Huang and J. F. Yang, "Depth maps interpolation from existing pairs of keyframes and depth maps for 3D video generation", Proc. of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), pp. 3248-3251, May 30-June 2, 2010.
[7] K.J. Yoon, I.S. Kweon, "Adaptive support-weight approach for correspondence search", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, No. 4, April 2006
[8] Jiangbo Lu, Rogmans, Sammy, "Stream-centric stereo matching and view synthesis: a high-speed approach on GPUs", IEEE Transactions on Circuits and System Society, pp. 1598-1611, July 07, 2009
[9] JeongMok Ha, Hong Jeong, "Modelsim simulation for real-time stereo matching using DP algorithm", Proc. of 2012 IEEE International Conference on Internet Technology And Secured Transactions, pp.244-248, Dec 10-12, 2012
[10] C. Fehn , "Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV", Proc. of SPIE 5291, Stereoscopic Displays and Virtual Reality Systems XI, May 21, 2004
[11] L. Zhang and W. J. Tam, "Stereoscopic image generation based on depth images for 3DTV", IEEE Trans. on Broadcasting, vol. 51, no. 2, pp.191–199, Jun, 2005.
[12] L.H. Wang, X.J. Huang, Ming Xi, Dong-Xiao Li and Ming Zhang, "An asymmetric edge adaptive filter for depth generation and hole filling in 3D-TV", IEEE Trans on Broadcasting, vol. 56, no. 3, September, 2010.
[13] Xiao-Han Lu, Fang Wei and Fang-Min Chen, "Foreground-object-protected depth map smoothing for DIBR", Proc. of IEEE International Conference on Multimedia and Expo, pp.339-343, July 9-13, 2012
[14] 劉楷哲,吳其霖, "基於3D顯示器格式之即時3D內容合成技術", 工業技術研究院 電子與光電研究所, 影像與識別, 2010, Vol. 16 No. 2
[15] Y.M. Feng, DX Li, K Luo and M Zhang, "Asymmetric bidirectional view synthesis for free viewpoint and three-dimensional video", IEEE Trans. on Consumer Electronics, no.4, pp.2349-2355, Nov. 2009.
[16] Li Yu, Sen Xiang, Huiping Deng and Peng Zhou, "Depth based view synthesis with artifacts removal for FTV", Image and Graphics (ICIG), pp. 506-510, 12-15 Aug. 2011.
[17] N. Greene, M. Kass, G Miller, "Hierarchical Z-buffer visibility", Proc. of ACM SIGGRAPH 93 Conf. Comput. Graphics, pp.231-238, 1993.
[18] Xuyuan Xu, Lai-Man Po, Chun-Ho Cheung, Litong Feng, Ka-Ho Ng and Kwok-wai Cheung, "Depth-aided exemplar-based hole filling for DIBR view synthesis", Proc. of IEEE international Symposium on Circuits and System (ISCAS), 2840-2843, May. 19-23 2013.
[19] L. Azzari, F. Battisti, and A. Gotchev, "Comparative analysis of occlusion-filling techniques in depth image-based rendering for 3D videos", Proc. of 3rd Workshop Mobile Video Delivery, New York, pp.57–62, 2010.
[20] M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester, "Image inpainting", Proc. of SIGGRAPH ACM 27th Conf. on Computer Graphics and Interactive Techniques, (New York, NY), pp. 417–424, July. 2000
[21] C. Vázquez, W. J. Tam, and F. Speranza, "Stereoscopic imaging: filling disoccluded areas in depth image-based rendering", Proc. of SPIE 6392, vol.6392, pp.63920D, Oct. 2006.
[22] Lai-Man Po, Shihang Zhang, Xuyuan Xu, Yuesheng Zhu, "A new multidirectional extrapolation hole-filling method for depth-image-based rendering", Proc. of 18th IEEE International Conference on Image Processing (ICIP), pp. 2589-2592, 11-14 Sept. 2011
[23] Hung-Wei Tsai and Jar-Ferr Yang, Template-based adaptive multi-view rendering for versatile 3D displays with GPU realization, Master Thesis, National Cheng Kung University, July. 2013
[24] 成大CUDA課程:CUDAC程式設計教學 林郁翔
[25] Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux "KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera", Research Conducted at Microsoft Research Cambridge, UK, 16-19 October. 2011
[26] Svitlana Zinger, Daniel Ruijters, Luat Do, and Peter H. N. de With, "View interpolation for medical images on autostereoscopic displays", IEEE Trans. on Circuits and Systems for Video Technology, pp.128-137, Jan. 2012
[27] Jeong-Woo Lee, Bumho Kim and Ki-Song Yoon, "CUDA-based JPEG2000 encoding scheme", Proc. of 16th IEEE International Conference on Advanced Communication Technology (ICACT), pp671-674, Feb. 2014
[28] Meng Ren, Shengbing Zhang, Yi Lei and Meng Zhang , "CUDA-based real-time face recognition system", Proc. of 4th IEEE International Conference on Digital Information and Communication Technology and it’s Application (DICTAP), pp.237-241, May. 2014
[29] NVIDIA DEVELOPER ZONE: CUDA C Programming Guide http://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#axzz34Vc9Eacv
[30] His-chu Tseng and Jar-Ferr Yang, Efficient 3D Video Packing and Comfort Disparity Modification for Traditional Broadcasting Systems , Master Thesis, National Cheng Kung University, July 2013
[31] OpenCV http://opencv.org/
[32] Direct show library
http://msdn.microsoft.com/en-us/library/windows/desktop/dd375454(v=vs.85).aspx
[33] Microsoft Developer Network http://msdn.microsoft.com/en-US/
[34] WIKIPEDIA http://en.wikipedia.org/wiki/Main_Page
校內:2024-09-01公開