| 研究生: |
胡雅涵 Hu, Ya-Han |
|---|---|
| 論文名稱: |
適用於雙視角影片之物件立體度調整系統 An Object-based 3D Effect Adjustment System for Stereoscopic Videos |
| 指導教授: |
楊家輝
Yang, Jar-Ferr 陳進興 Chen, Chin-Hsing |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering |
| 論文出版年: | 2015 |
| 畢業學年度: | 103 |
| 語文別: | 英文 |
| 論文頁數: | 68 |
| 中文關鍵詞: | 立體效果調整 、視差調整 、深度調整 、立體影像修補 |
| 外文關鍵詞: | 3D effect adjustment, post-processing, stereoscopic inpainting |
| 相關次數: | 點閱:63 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近年來,隨著三維影像錄製與顯示技術的快速發展,使得立體雙視角影像製作越來越普及。其中,在影片後製程序中針對已拍攝完成之雙視角影像進行物件的三維立體效果調整是值得研究的議題。無論是降低物件的立體效果以減緩觀賞者視覺疲勞或是加強物件的立體效果以強調其臨場感,後製立體效果調整將是低成本、省時,及可行的方式。因此,本論文提出適用於雙視角影片之物件立體度調整系統,此系統可依據立體特效導演設定以達到不同的立體效果之調整。然而,依據視差與深度的關係調整立體效果時,物間邊緣可能會遺失資訊。因此,我們進一步提出立體影像修補演算法,有別於一般二維影像修補法,我們提出之立體修補演算法可利用深度資訊、視角間相關性及時域一致性而達到更好的修補結果。實驗結果證明本系統可同時達成立體度調整的目標並保留良好觀賞品質。此外,本系統可相容於其他物件切割與立體匹配演算法。
Recently, the developments of three-dimension (3D) capture and display techniques grow rapidly, which bring in mass production of stereoscopic 3D contents. The 3D effect adjustment for stereoscopic images in post processes is a worth exploring issue. We could reduce the 3D depth of an object to restrain viewer visual exhaustion, or increase the 3D depth of an object to achieve better 3D perception for 3D contents. The post processing of 3D effect becomes a low-cost, adjustable, and feasible solution. To achieve this purpose, we proposed a framework which can adjust the 3D effect of a specific object according to the preference of the 3D effect director. However, the disparity and depth adjustments of the object could inevitably cause the view incompletion and the temporal discontinuity. Hence, we proposed a stereoscopic inpainting algorithm which can change the depth information and keep stereoscopic consistency and temporal continuity to achieve better viewing performance. Simulation results show that the proposed framework can reach the target of the 3D effect adjustment and maintain the viewing quality simultaneously. Furthermore, the framework is also compatible to other stereo matching and object segmentation methods.
[1] B. Mendiburu, 3D Movie Making, United States: Focal Press Publications, 2009.
[2] S. Reeve and J. Flack, "Basic Principles of Stereoscopic 3D," BSKYB, 2010.
[3] L. Zhang and W. J. Tam, "Stereoscopic Image Generation Based on Depth Images for 3D TV," IEEE Transactions on Broadcasting, vol. 51, no. 2, pp. 191–199, 2005.
[4] N. Hemenway, "Stereoscopy Production," Stereoscopy.co, 2008. [Online]. Available: http://stereoscopy.co/more/methods/production. [Accessed 10 05 2015].
[5] Y. Feng, J. Ren and J. Jiang, "Object-Based 2D-to-3D Video Conversion for Effective Stereoscopic Content Generation in 3D-TV Applications," IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 500–509, 21 April 2011.
[6] N. Lazaros, G. C. Sirakoulis and A. Gasteratos, "Review of Stereo Vision Algorithms: From Software to Hardware," International Journal of Optomechatronics, vol. 2, no. 4, pp. 435–462, 2008.
[7] K. J. Yoon and I. S. Kweon, "Adaptive support-weight approach for correspondence search," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 650–656, 2006.
[8] J. W. Shi, "Fast Disparity Estimation Based on Cost-Reproduced Local Stereo Matching for High Resolution Video Sequence," M.S. thesis, Inst. Comput. Commun. Eng., Natl. Cheng Kung Univ., Tainan, Taiwan, 2014.
[9] B. Price and S. Cohen, "StereoCut: Consistent interactive object selection in stereo image pairs," in IEEE International Conference on Computer Vision (ICCV), Barcelona, 2011.
[10] A. T. Chiang, "Image Segmentation for Depth Estimation of Single View Images," M.S. thesis, Inst. Comput. Commun. Eng., Natl. Cheng Kung Univ., Tainan, Taiwan 2009.
[11] Z. Arican, S. Yea, A. Sullivan and A. Vetro, "Intermediate View Generation for Perceived Depth Adjustment of Stereo Video," in SPIE Conference on Applications of Digital Image Processing, San Diego, CA, 2009.
[12] H. Park, H. Lee and S. Sull, "Object Depth Adjustment Based on Planar Approximation in Stereo Images," in IEEE International Conference on Consumer Electronics, Berlin, 2011.
[13] H. Park, H. Lee and S. Sull, "Efficient Viewer-Centric Depth Adjustment Based on Virtual Fronto-Parallel Planar Projection in Stereo 3D Images," IEEE Transactions on Multimedia, vol. 16, no. 2, pp. 326–336, 2014.
[14] C. Guillemot and O. L. Meur, "Image Inpainting : Overview and Recent Advances," IEEE Signal Processing Magazine, vol. 31, no. 1, pp. 127–144, 2014.
[15] A. Telea, "An Image Inpainting Technique Based on the Fast Marching Method," J. Graphics Tools, vol. 9, no. 1, pp. 25–36, 2004.
[16] C. Barnes, E. Shechtman, A. Finkelstein and D. B. Goldman, "PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing," ACM Transactions on Graphics, vol. 28, no. 3, pp. 1–11, 2009.
[17] A. Criminisi, P. Perez and K. Toyama, "Region Filling and Object Removal by Exemplar-Based Image Inpainting," IEEE Transactions on Image Processing, vol. 19, no. 9, pp. 1200–1212, 2004.
[18] Y. Liu and V. Caselles, "Exemplar-Based Image Inpainting Using Multiscale Graph Cuts," IEEE Transactions on Image Processing, vol. 22, no. 5, pp. 1699–1711, 2013.
[19] I. Daribo and H. Saito, "A Novel Inpainting-Based Layered Depth Video for 3DTV," IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 533–541, 2011.
[20] L. Ma, L. Do and P. H. N. d. With, "Depth-Guided Inpainting Algorithm for Free-Viewpoint Video," in IEEE International Conference on Image Processing (ICIP), Orlando, FL, 2012.
[21] I. Ahn and C. Kim, "A Novel Depth-Based Virtual View Synthesis Method for Free Viewpoint Video," IEEE Transactions on Broadcasting, vol. 59, no. 4, pp. 614–626, 2013.
[22] S. Muddala, M. Sjostrom and R. Olsson, "Depth-Based Inpainting for Disocclusion Filling," in 3DTV-Conference, Budapest, 2014.
[23] L. Wang, H. Jin, R. Yang and M. Gong, "Stereoscopic Inpainting: Joint Color and Depth Completion From Stereo Images," in IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, 2008.
[24] A. Hervieu, N. Papadakis, A. Bugeau, P. Gargallo and V. Caselles, "Stereoscopic Image Inpainting: Distinct Depth Maps and Images Inpainting," in International Conference on Pattern Recognition (ICPR), Istanbul, 2010.
[25] A. Hervieux, N. Papadakis, A. Bugeau, P. Gargallo and V. Caselles, "Stereoscopic Image Inpainting Using Scene Geometry," in IEEE International Conference on Multimedia and Expo (ICME), Barcelona, Spain, 2011.
[26] F. H. Cheng and M. D. Loo, "An Image Inpainting Method for Stereoscopic Images Based on Hole Classification," in International Conference on Ubi-Media Computing and Workshops (UMEDIA), Ulaanbaatar, 2014.
[27] F. Raimbault and A. Kokaram, "Stereo Video Inpainting," J. Electron. Imaging, 2012.
校內:2020-08-06公開