成功大學博碩士論文系統

簡易檢索 / 詳目顯示

回結果列表

研究生：	卓仁凱 Cho, Jen-kai
論文名稱：	基於補償性深度圖像繪圖法以產生三維立體螢幕之多視點影像 Multi-view Image Generation Using Compensated Depth-Image-Based Rendering for 3D Displays
指導教授：	陳中和 Chen, Chung-Ho
學位類別：	碩士 Master
系所名稱：	電機資訊學院 - 電腦與通信工程研究所 Institute of Computer & Communication Engineering
論文出版年：	2007
畢業學年度：	95
語文別：	英文
論文頁數：	80
中文關鍵詞：	三維顯示器、繪圖管線、電腦圖學(繪圖) 、多視點繪圖法
外文關鍵詞：	3D display, multi-view rendering, computer graphics, graphics pipeline, DIBR
相關次數：	點閱：169 下載：2
分享至:	分享至facebook 分享至twitter

查詢本校圖書館目錄查詢臺灣博碩士論文知識加值系統勘誤回報

隨著三維立體顯示器技術的進步，相關的應用也逐漸地被推廣。這種螢幕可以提供觀賞者雙眼不同的影像，進而產生立體感。若是在多人觀看的系統，要同時產生各個圖像給所有觀眾的視點，這對目前的繪圖演算法來說是個挑戰。最直覺的方法是在三維場景中屬於各個視點上放置假想攝影機，然後由每個視點演算產生出屬於各自的影像。這辦法的確可以產生理想的影像品質，但是運算的時間也會正比於顯示器所能提供的視點數。

另外有一個截然不同的做法稱作深度圖像繪圖法 depth-image-based rendering (DIBR)，這個演算法的效能與視點數無關。但是這個演算法會產生一些畫面上的瑕疵，這些瑕疵乃源自於傳統繪圖管線的特性。基於DIBR，我們提出了一個藉由修改部分繪圖管線，來補償該演算法以消除其主要瑕疵，稱為compensated DIBR。

為了要模擬多視點系統，我們使用SystemC語言架構了整個三維繪圖系統。實驗結果顯示我們所提出的方案相較於對每個視點均做一次繪圖的暴力演算法，可以減少約80%的記憶體存取量。

Today, three-dimension display technology is getting popular. These displays provide respective images to both eyes of each viewer, and hence bring viewers 3D experience. In the case of multiple viewers, creating the image for each view is a challenge to current graphics rendering algorithms. The intuitive way is to place virtual cameras at the corresponding positions for the respective viewpoints, and take the images of a scene from these views. This approach does provide ideal quality to the output images, but the time taken for drawing is basically proportional to the number of views provided by the 3D display.

There is an alternative called depth-image-based rendering (DIBR), which is a view number independent algorithm. However, this algorithm produces some visible artifacts due to the nature of the real-time graphics algorithm. Based on DIBR, we proposed an algorithm called compensated-DIBR by modifying part of the graphics algorithm to reduce the major artifacts.

In order to perform simulations for respective multi-view algorithms, we established a platform of the entire 3D graphics system in SystemC. The experimental results show that in the case of 9-view displays, the proposed scheme can reduce up to 80% of the memory traffic compared with the brute-force algorithm.

Chapter 1 Introduction ................................................................................................. 1
1 Contributions ............................................................................................... 1
2 Overview....................................................................................................... 2
Chapter 2 Background.................................................................................................. 4
1 Stereoscopic vision ....................................................................................... 4
2 3D displays ................................................................................................... 5
2.1 Screen disparity ................................................................................... 5
2.2 3D display technologies ....................................................................... 7
2.3 Two-view displays ................................................................................ 7
2.4 Multi-view displays.............................................................................. 9
3 3D computer graphics ............................................................................... 10
4 Motivation .................................................................................................. 14
4.1 Benchmark ......................................................................................... 15
4.2 Graphics card and stereo driver ...................................................... 16
4.3 Sharp 3D display................................................................................ 16
4.4 Summary ............................................................................................ 16
5 Graphics API.............................................................................................. 18
5.1 OpenGL.............................................................................................. 19
5.2 OpenGL ES ........................................................................................ 21
6 Graphics pipeline....................................................................................... 22
6.1 OpenGL pipeline................................................................................ 22
6.2 Multi-view rendering......................................................................... 24
7 Related work .............................................................................................. 24
7.1 Depth-Image-Based Rendering ........................................................ 24
7.2 Light field ........................................................................................... 25
Chapter 3 Implementation and methodology ........................................................... 27
1 System C model.......................................................................................... 27
1.1 Electronic System-Level.................................................................... 28
2 CoWare Platform Architect ...................................................................... 29
3 Immediate mode rendering....................................................................... 30
3.1 Transformation .......................................................................................... 31
3.2 Lighting .............................................................................................. 35
3.3 Primitive assembly............................................................................. 37
3.4 Clipping .............................................................................................. 38
3.5 Design of geometry engine ................................................................ 39
3.6 Triangle setup & traversal ................................................................ 40
3.7 Texture mapping................................................................................ 41
3.8 Per-fragment operation and the frame buffer ................................ 43
3.9 Design of rasterization engine .......................................................... 44
4 Tile-based rendering.................................................................................. 45
4.1 Architecture........................................................................................ 45
4.2 Implementation.................................................................................. 47
5 Verification ................................................................................................. 49
Chapter 4 Rendering multiple times.......................................................................... 51
1 Correct multiple projection ...................................................................... 51
2 Advantages and disadvantages................................................................. 52
Chapter 5 Depth-Image-Based Rendering ................................................................ 53
1 Theory......................................................................................................... 53
2 Implementation details.............................................................................. 54
2.1 Depth buffer to z in eye coordinates ................................................ 54
2.2 Visibility problems............................................................................. 55
2.3 Artifacts .............................................................................................. 59
3 Advantages and disadvantages................................................................. 60
Chapter 6 Compensated-DIBR .................................................................................. 61
1 Motivation .................................................................................................. 61
2 Compensated depth test ............................................................................ 61
2.1 Implementation.................................................................................. 61
3 Hole-filling with compensation buffer ..................................................... 62
3.1 Limitation........................................................................................... 63
4 Advantages and disadvantages................................................................. 66
Chapter 7 Simulation and analysis ............................................................................ 69
1 Simulation methodology ........................................................................... 69
2 Results and analysis................................................................................... 71
2.1 Single view rendering ........................................................................ 71
2.2 9-view DIBR....................................................................................... 72
Chapter 8 Conclusions and future work ................................................................... 76
References ............................................................... 78
                                    

[1] Neil A. Dodgson, "Autostereoscopic 3D Displays," Computer, vol. 38, iss. 8, Aug
2005, pp. 31-36.
[2] Johan Compen, 3D graphics rendering for multiview displays: Using programmable
shaders on graphics cards, Koninklijke Philips Electronics N.V. 2005, Technical note
TN-2004/00920.
[3] David F. McAllister, Stereo computer graphics and other true 3D technology,
Princeton university press．Princeton, 1993
[4] David F. McAllister, Stereo technology: Stereo & 3D display technology,
http://research.csc.ncsu.edu/stereographics/wiley.pdf
[5] Philips, 3D Display website, http://www.dimensionalstudio.com/
[6] Philips, Philips Mutiview 3D Display Solutions,
http://www.3dc.gr.jp/english/domestic_rep/040617a/Philips_3dc.pdf
[7] Richard S. Wright, Jr. and Benjamin Lipchark, OpenGL superbible, 3rd edition, Sams
Publishing, 2005
[8] The Mesa 3D Graphics Library website, http://www.mesa3d.org
[9] Futuremark Corporation, Products page, http://www.futuremark.com/products/
[10] NVIDIA, 3D Stereo User's Guide (v77.77),
http://download.nvidia.com/Windows/77.77/77.77_3D_Stereo_User_Guide.pdf
[11] Tomas Akenine-Moller, and Eric Haines, Real-time rendering, 2nd edition, A K Peters,
Ltd., 2002.
[12] Jason Stewart, Eric P. Bennett, and Leonard McMillan, "PixelView: a
view-independent graphics rendering architecture," Proceedings of the ACM
SIGGRAPH/EUROGRAPHICS conference on Graphics hardware HWWS 2004, pp.
75-84.
[13] Mark Segal and Kurt Akeley, The OpenGL Graphics System: A Specification Version
2.1, Silicon Graphics, Inc., http://www.opengl.org/registry/doc/glspec21.20061201.pdf
[14] David Blythe and Aaftab Munshi, OpenGL ES Common/Common-Lite Profile
Specification Version 1.1.10, Khronos Group, Inc.,
http://www.khronos.org/registry/gles/specs/1.1/es_full_spec.1.1.10.pdf
[15] Christoph Fehn, "A 3D-TV system based on video plus depth information," Signal,
System and Computers, Conference Record of the Thirty-Seventh Asilomar
Conference, vol. 2, Nov. 2003, pp. 1529-1533.
[16] CoWare Inc., Product page, http://www.coware.com/products/platformarchitect.php
79
[17] Dan Crisu, Stamaitis Vassiliadis, Sorin D. Cotofana, and Petri Liuha, "3D Graphics
Tile-based Systolic Scan-Conversion," Signal, System and Computers, 2004,
Conference Record of the Thirty-Eighth Asilomar Conference, vol. 1, Nov. 2004, pp.
517-521.
[18] Sharp Electronic Corp., LCD Monitor with 3D Display,
http://www.sharpsystems.com/kb/?cid=2680&c=1172&cpc=6HTK8W331lHO3ae4y2
74f8RqlL25sBFnYP
[19] Microsoft Corp., DirectX Resource Center,
http://msdn2.microsoft.com/zh-tw/xna/aa937781.aspx
[20] Tomshardware guide website, R600: Finally DX10 Hardware from ATI,
http://www.tomshardware.com/2007/05/14/r600_finally_dx10_hardware_from_ati
[21] Vincent Mobile 3D Rendering Library, Project: Vincent Mobile 3D Rendering Library,
http://sourceforge.net/projects/ogl-es/
[22] Jamie Brettle and Cladimir V. G. Baranoski, Stereo Rendering: An Overview,
University of Waterloo, Technical Report CS-2005-02.
[23] Marc Levoy and Pat Hanrahan, "Light filed rendering," Proceedings SIGGRAPH
1996, pp. 31-42.
[24] David C. Black and Jack Donovan, SystemC: From the Ground Up, Ekletic Ally, Inc.,
2004.
[25] Brian Bailey, Grant Martin and Andrew Piziali, website of the book: Electronic System
Level Design and Verification, http://electronicsystemlevel.com/
[26] CoWare, ConvergenSC Training Manual rev: 1Mar06, CoWare, Inc., 2006.
[27] Ashley Stevens, White paper: ARM Mali 3D Graphics System Solution, December
2006, http://www.arm.com/miscPDFs/16514.pdf
[28] Imagination Technologies Ltd., PowerVR MBX 2D/3D Graphics,
http://www.imgtec.com/Downloads/index.asp?download=true&f=PowerVRMBX.pdf
&t=PowerVR%20PDP%20Documents
[29] Henry Fuchs, John Poulton, John Eyles, Trey Greer, Jack Goldfeather, David Ellsworth,
Steve Molnar, Greg Turk, Brice Tebbs, and Laura Israel, "Pixel-planes 5: a
heterogeneous multiprocessor graphics system using processor-enhanced memories,"
ACM SIGGRAPH Computer Graphics , Proceedings of the 16th annual conference on
Computer graphics and interactive techniques SIGGRAPH '89, vol. 23, iss. 3, July
1989, pp. 79-88.
[30] Joel McCormack, Robert McNamara, Christopher Gianos, Norman P. Jouppi, Todd
Dutton, John Zurawski, Larry Seiler, and Ken Correll, "Implementing Neon: a 256-bit
graphics accelerator," Micro, IEEE, vol. 19, iss. 2, March-April 1999, pp. 58-69.
[31] Minglun Gong, Jason M. Selzer, Cheng Lei, and Yee-Hong Yang, "Real-time backward
80
disparity-based rendering for dynamic scenes using programmable graphics hardware,"
Proceedings of Graphics Interface, May 2007, pp. 241-248.
[32] Wan-Yu Chen, Yu-Lin Chang, Shyh-Feng Lin, Li-Fu Ding, and Liang-Gee Chen,
"Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and
Interpolation," Multimedia and Expo, ICME 2005. IEEE International Conference,
July 2005, pp. 1314-1317
[33] Greg Humphreys, Mike Houston, Ren Ng, Randall Frank, Sean Ahern, Peter D.
Kirchner, and James T. Klosowski, "Chromium: A Stream-Processing Framework for
Interactive Rendering on Clusters," ACM Transactions on Graphics, Proceedings of the
29th annual conference on Computer graphics and interactive techniques SIGGRAPH
'02, vol. 21, iss. 3, July 2002, pp. 693-702.
[34] Khronos Group, OpneGL ES overview, http://www.khronos.org/opengles/

校內：2012-08-23公開
校外：2012-08-23公開

簡易檢索 / 詳目顯示

相關論文