| 研究生: |
葉仁宏 Yeh, Jen-Hung |
|---|---|
| 論文名稱: |
基於視差調整與模糊化之舒適多視角影像合成演算法 Disparity Modification and Blur Operation for Comfortable DIBR Systems |
| 指導教授: |
楊家輝
Yang, Jar-Ferr |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering |
| 論文出版年: | 2012 |
| 畢業學年度: | 100 |
| 語文別: | 英文 |
| 論文頁數: | 62 |
| 中文關鍵詞: | DIBR 、視覺疲勞 、深度圖與視差轉換 、模糊處理 |
| 外文關鍵詞: | DIBR, Visual discomfort, Disparity modification, Blur operation |
| 相關次數: | 點閱:74 下載:3 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近來隨著3D電影以及3D電視越來越蓬勃發展,特別是裸視立體螢幕的技術逐漸進步,人們將不再需要配戴立體眼鏡即可透過螢幕欣賞立體影像。為了製作立體的影像內容,最常見的方法就是利用原本的2D影像內容以及其相對應的深度圖,透過基於深度繪圖 (Depth-Image-Based Rendering, DIBR) 的技術來產生多視角的立體影像。但到目前為止,大部分的研究論文所提出來的DIBR系統都只專注在改善影像的品質,以及減少生成影像當中的假影和幻象,而沒有考慮到視覺疲勞的問題。一般影響人眼視覺不舒服的較大致病因素有:調節輻輳作用衝突,過大的雙眼視差,以及立體影像失真。本論文旨在提供一個舒適度改善的演算法,使用主要物件偵測,深度圖與視差轉換,視差圖調整機制,背景模糊處理有效地改善視覺舒適度,並且盡量減少人眼不舒服的致病因素。
To deliver the multiview videos, the possible transmission format of future 3DTV broadcasting systems could be one monoscopic video plus its associated depth information. Therefore, a high-quality depth-image-based rendering (DIBR) technique is desired at the receiver side to generate multiview contents. So far, most researches focus on how to prevent the synthesized artifacts in DIBR systems, but only a few discuss the issue of visual discomfort. To enhance the comfort 3D visualization, a comfortable DIBR system based on disparity modification and blur operation is presented in this thesis. The former is developed to avoid the accommodation-convergence conflict and excessive binocular disparity, while the latter is designed to deal with the unnatural amounts of blur. Experimental results reveal that by using our proposed methods, the disparity can be adjusted suitably and the blur effect can be modeled well, which will be a great help for existing DIBR systems to generate comfortable 3D videos.
[1] Despite challenges, heady growth seen for 3-D TV.
http://www.eetimes.com/showArticle.jhtml?articleID=225200161
[2] J. T. Thomas, J. Y. Son,”depth cues in human visual perception and their realization in 3d displays," Three-Dimensional Imaging, Visualization, and Display 2010 and Display Technologies and Applications for Defense, Security, and Avionics IV, 2010.
[3] Marc T.M. Lambooij, “Visual Discomfort in Stereoscopic Displays: A Review,” J. Imaging Sci. Technol. vol. 53, 030201, 2009.
[4] D. Minoli , "Analytical 3D Aspects of the Human Visual System," 3D Television (3DTV) Technology, Systems, and Deployment: Rolling Out the Infrastructure for Next-Generation Entertainment, pp.55-73, Boca Raton: CRC Press, 2011.
[5] K. N. Ogle, "Researches in binocular vision," Saunders, 1950.
[6] P. Didyk, T. Ritschel, E. Eisemann, K. Myszkowski, H. P. Seidel, "A Perceptual Model for Disparity" ACM Transactions on Graphics 30(4) (Proceedings SIGGRAPH 2011, Vancouver), 2011
[7] Disparity
http://www.3d-forums.com/threads/stereoscopic-parallax.4/
[8] C. Fehn and R. Pastoor, "Interactive 3-DTV-concepts and key technologies," Proceedings of the IEEE, vol. 94, pp. 524-538, 2006.
[9] P. Benzie, P. Surman, and H. Urey, "A survey of 3DTV displays: techniques and technologies," IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, pp. 1647-1658, 2007.
[10] T. Dekker, S. T. de Zwart, O. H. Willemsen, M. G. H. Hiddink, and W. L. IJzerman, "2D/3D switchable displays," Proceedings of SPIE, vol. 6135, 2006
[11] D. Scharstein; R. Szeliski, "A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms," International Journal of Computer Vision (ICJV), vol.47, no.1-3, pp.7-42, Apr.-Jun. 2002.
[12] M. Beeck, C. Fehn and I. Sexton, "Advanced three-dimensional television system technologies," First International Symposium on 3D Data Processing Visualization and Transmission (IEEE 3DPVT), pp. 313-319, June 19, 2002.
[13] G. Yahav, G.J. Iddan, and D. Mandelboum, "3D Imaging camera for gaming application," IEEE International Conference on Consumer Electronics, pp. 1-2, Apr. 2007.
[14] S. J. Lin , "Spatio-Temporally Consistent Multi-View Video Synthesis for Autostereoscopic Display," Master’s Thesis, Department of Computer Science, National Tsing Hua University, Hsinchu, 2009.
[15] M. Tanimoto, "Overview of Free Viewpoint Television," Signal Processing: Image Communication, vol.21, no.6, pp.454-461, Jul. 2006.
[16] William R. Mark; L. McMillan; G. Bishop, "Post-Rendering 3D Warping," Proceedings of the 1997 Symposium on Interactive 3D Graphics, pp.7-16, 27-30 Apr. 1997..
[17] L. Zhang and W. James Tam, “Stereoscopic Image Generation Based on Depth Images for 3D TV,” IEEE Transactions on Broadcasting, vol. 51, no. 2, pp. 191-199, June 2005.
[18] P. J. Lee. , Effendi, "Adaptive Edge-oriented Depth Image Smoothing Approach for Depth Image Based Rendering," IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), pp.1-5, March 2010.
[19] L.M. Po , S. Zhang, X. Xu, Y. Zhu, "A New Multidirectional Extrapolation Hole-filling Method for Depth-Image-Based Rendering," IEEE International Conference on Image Processing, pp.2589-2592, Sept. 2011.
[20] W. Mackenzie, "Asthenopia", Annales d'Ocul: 97-115 (1843).
[21] S. Yano, M. Emoto, and T. Mitsuhashi, "Two factors in visual fatigue caused by stereoscopic HDTV images" Proceedings of the SPIE, Volume 4864, pp. 157-166 (2002).
[22] K. J. MacKenzie; Simon J. Watt," Eliminating accommodation-convergence conflicts in stereoscopic displays: can multiple-focal-plane displays elicit continuous and consistent vergence and accommodation responses? ", Stereoscopic Displays and Applications XXI, 2010
[23] C. Fehn, "Depth-Image-Based Rendering (DIBR), Compression and Transmission for a New Approach on 3D-TV", Proceedings of the SPIE, Volume 5291, pp. 93-104 (2004).
[24] Wei Z. ;Wai-Kuen C. , " Single Image Refocusing and Defocusing," IEEE Transactions on Image Processing, vol. 21,no. 2, pp. 873 - 882, 2012.
[25] Ciuffreda KJ, Wang B, Vasudevan B "Conceptual model of human blur perception, "Vision Res. 2007 Apr;47(9):1245-52. Epub 2007.
[26] C. Fehn, K. Hopf and Q. Quante, “Key Technologies for an Advanced 3D-TV System ” In Proceedings of SPIE Three-Dimensional TV, Video and Display III, Philadephia, PA, USA, pp. 66-80, 2004.