| 研究生: |
陳建文 Chen, Chien-Wen |
|---|---|
| 論文名稱: |
用於虛擬實境數位互動創作系統之高效架構 A Memory Efficient Framework for Interactive Digital Content Creation in Virtual Reality |
| 指導教授: |
朱威達
Chu, Wei-Ta |
| 學位類別: |
博士 Doctor |
| 系所名稱: |
電機資訊學院 - 多媒體系統與智慧型運算工程博士學位學程 Multimedia System and Intelligent Computing Ph.D. Degree Program |
| 論文出版年: | 2022 |
| 畢業學年度: | 110 |
| 語文別: | 英文 |
| 論文頁數: | 91 |
| 中文關鍵詞: | 即時雕刻 、地形生成 、虛擬實境 、體素雕刻 |
| 外文關鍵詞: | Real-time Sculpting, Terrain Generation, Virtual Reality, Volumetric Sculpting |
| 相關次數: | 點閱:97 下載:13 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
基於體素的三維模型表示方式具有易於編輯的特性,因此被廣泛應用於數位雕刻與地形生成,然而,儲存三維空間中完整的體素資料需要耗費大量記憶體,這限制了此方法在一般家用設備上的使用。在這篇論文中,我們提出了嶄新的資料結構來取代傳統的純量場方法,我們所提出的資料結構可以被快速地編輯,並且常用的等值面提取演算法如邁進方塊與對偶表面皆適用以提取模型表面,在我們所提出的雕刻系統中,模型的不同區塊可以使用不同解析度來表現,並且這些區塊可以被無縫連接,再者,我們所提出的方法非常易於進行平行化運算,我們的方法可以達到與現存方法幾乎一致的結果並且大幅減少記憶體使用量與運算時間,使用我們系統所創作的模型可以被用於常見的遊戲引擎中並設計高互動性的遊戲,基於我們所提出的方法,我們實作了一套虛擬實境數位內容創作系統。
Volumetric representation is widely used in digital sculpting and terrain generation due to its highly modifiable characteristic. However, storing the entire raw voxel map requires a lot of memory, which limits its application on general machines. In this work, we propose to use a novel data structure based on the concept of layered depth-normal images to replace the commonly used scalar field for storing the volumetric information. The proposed data structure can be quickly edited, and the isosurface can be extracted by using general methods such as Marching Cubes and Dual Contouring. The proposed sculpting system can edit models with multiple resolution levels, and the surface between models of different resolutions can be connected seamlessly. Our method can achieve similar results as the existing volumetric methods while significantly reduces the memory usage and computation time. The model created by our system can be used in common game engines to make highly interactive games. Furthermore, all of our processes are parallel-friendly. We implemented a virtual reality digital content creation tool based on the proposed method to demonstrate the effectiveness and feasibility of our method.
[1] A-Frame. A-painter. https://aframe.io/a-painter/. Accessed: May 10, 2021 [Online].
[2] Autodesk Inc. Inventor. https://www.autodesk.com/products/inventor/overview. Accessed: May 10, 2021 [Online].
[3] Autodesk Inc. Maya. https://www.autodesk.com.tw/products/maya/overview. Accessed: May 10, 2021 [Online].
[4] Jakob Andreas Bærentzen. Octree-based volume sculpting. In Proceedings Visualization ’98. ACM Press, 1998. Vis98 - IEEE Visualization 1998 ; Conference date: 01-10-1998 Through 01-10-1998.
[5] M. Becher, M. Krone, G. Reina, and T. Ertl. Feature-based volumetric terrain generation and decoration. IEEE Transactions on Visualization and Computer Graphics, 25(2):1283–1296, 2019.
[6] Wendy Bolier, Wolfgang Hürst, Guido van Bommel, Joost Bosman, and Harriët Bosman. Drawing in a virtual 3d space - introducing vr drawing in elementary school art education. In Proceedings of the 26th ACM International Conference on Multimedia, MM '18, page 337–345, New York, NY, USA, 2018. Association for Computing Machinery.
[7] Chien-Wen Chen, Jain-Wei Peng, Chia-Ming Kuo, Min-Chun Hu, and Yuan-Chi Tseng. Ontlus: 3d content collaborative creation via virtual reality. In MultiMedia Modeling, pages 386–389, Cham, 2018. Springer International Publishing.
[8] Evgeni V. Chernyaev. Marching cubes 33: Construction of topologically correct isosurfaces. Technical report, 1995.
[9] Guillaume Cordonnier, Marie-Paule Cani, Bedrich Benes, Jean Braun, and Eric Galin. Sculpting Mountains: Interactive Terrain Modeling Based on Subsurface Geology. IEEE Transactions on Visualization and Computer Graphics, 24(5):1756–1769, May 2018.
[10] Epic Games. Unreal engine 4. https://www.unrealengine.com/. Accessed: May 10, 2021 [Online].
[11] Eric Ferley, Marie-Paule Cani, and Jean-Dominique Gascuel. Practical volumetric sculpting. The Visual Computer, 16:469–480, 09 1999.
[12] Eric Ferley, Marie-Paule Cani, and Jean-Dominique Gascuel. Resolution adaptive volume sculpting. Graphical Models (GMOD), 63:459–478, 11 2001.
[13] Tinsley A. Galyean and John F. Hughes. Sculpting: An interactive volumetric modeling technique. SIGGRAPH ’91, page 267–274, New York, NY, USA, 1991. Association for Computing Machinery.
[14] Ryan Geiss. Generating complex procedural terrains using the gpu. GPU Gems 3, pages 7–37, 2008.
[15] Sarah F. Frisken Gibson. Constrained elastic surface nets: Generating smooth surfaces from binary segmented data. In Proceedings of the First International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI '98, page 888–898, Berlin, Heidelberg, 1998. Springer-Verlag.
[16] Google. Tilt brush. https://www.tiltbrush.com/. Accessed: May 10, 2021 [Online].
[17] Éric Guérin, Julie Digne, Éric Galin, Adrien Peytavie, Christian Wolf, Bedrich Benes, and Benoît Martinez. Interactive example-based terrain authoring with conditional generative adversarial networks. 36(6), 2017.
[18] Ben Houston, Michael B. Nielsen, Christopher Batty, Ola Nilsson, and Ken Museth. Hierarchical rle level set: A compact and versatile deformable surface representation. 25(1):151–175, 2006.
[19] Tao Ju, Frank Losasso, Scott Schaefer, and Joe Warren. Dual contouring of hermite data. ACM Trans. Graph., 21(3):339–346, July 2002.
[20] Daniel Keefe, Daniel Acevedo, Tomer Moscovich, David Laidlaw, and Jr LaViola. Cavepainting: A fully immersive 3d artistic medium and interactive experience. Proceedings of the Symposium on Interactive 3D Graphics, pages 85–93, 01 2001.
[21] Daniel Keefe, Robert Zeleznik, and David Laidlaw. Drawing on air: Input techniques for controlled 3d line illustration. IEEE Transactions on Visualization and Computer Graphics, 13(5):1067–1081, 2007.
[22] Sylvain Lefebvre and Hugues Hoppe. Perfect spatial hashing. ACM Trans. Graph., 25(3):579–588, July 2006.
[23] Eric Stephen Lengyel. Transition cells for dynamic multiresolution marching cubes. J. Graphics, GPU, & Game Tools, 15:99–122, 2010.
[24] Eric Stephen Lengyel. Voxel-Based Terrain for Real-Time Virtual Simulations. PhD thesis, USA, 2010.
[25] William E. Lorensen and Harvey E. Cline. Marching cubes: A high resolution 3d surface construction algorithm. SIGGRAPH Comput. Graph., 21(4):163–169, August 1987.
[26] Bogdan Maxim and Dorian Gorgan. Artworkvr: Novel interaction techniques for virtual painter. In Alin Moldoveanu and Alan J. Dix, editors, 16th International Conference on Human-Computer Interaction, RoCHI 2019, Bucharest, Romania, October 17-18, 2019, pages 30–37. Matrix Rom, 2019.
[27] MAXON Computer. Cinema 4d. https://www.maxon.net/cinema-4d. Accessed: May 10, 2021 [Online].
[28] Mojang. Minecraft. https://www.minecraft.net/. Accessed: May 10, 2021 [Online].
[29] Ken Museth. Vdb: High-resolution sparse volumes with dynamic topology. ACM Trans. Graph., 32(3):1–22, July 2013.
[30] Michael Nielsen and Ken Museth. Dynamic tubular grid: An efficient data structure and algorithms for high resolution level sets. J. Sci. Comput., 26:261–299, 03 2006.
[31] Matthias Nießner, Michael Zollhöfer, Shahram Izadi, and Marc Stamminger. Real-time 3d reconstruction at scale using voxel hashing. ACM Trans. Graph., 32(6), November 2013.
[32] Oculus VR. Medium. https://www.oculus.com/medium/. Accessed: May 10, 2021 [Online].
[33] Jeong Joon Park, Peter Florence, Julian Straub, Richard Newcombe, and Steven Lovegrove. Deepsdf: Learning continuous signed distance functions for shape representation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
[34] Kuo-Luen Perng, Wei-Teh Wang, and Ming Ouhyoung. A real-time 3d virtual sculpting tool based on modified marching cubes. 01 2001.
[35] Pilgway. 3d-coat. https://3dcoat.com/. Accessed: May 10, 2021 [Online].
[36] Pixologic. Zbrush. https://pixologic.com/. Accessed: May 10, 2021 [Online].
[37] Robert McNeel & Associates. Rhino. https://www.rhino3d.com/. Accessed: May 10, 2021 [Online].
[38] S. Schaefer and J. Warren. Dual marching cubes: primal contouring of dual grids. In 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings., pages 70–76, 2004.
[39] Steven Schkolne, Michael Pruett, and Peter Schröder. Surface drawing: Creating organic 3d shapes with the hand and tangible tools. pages 261–268, New York, NY, USA, 2001. Association for Computing Machinery.
[40] SOLIDWORKS Corp. Solidworks. https://www.solidworks.com/. Accessed: May 10, 2021 [Online].
[41] Lucian Stãnculescu, Raphaëlle Chaine, and Marie-Paule Cani. Freestyle: Sculpting meshes with self-adaptive topology. Comput. Graph., 35(3):614–622, June 2011.
[42] System Era Softworks. Astroneer. https://astroneer.space/. Accessed: May 10, 2021 [Online].
[43] Danhang Tang, Saurabh Singh, Philip A. Chou, Christian Hane, Mingsong Dou, Sean Fanello, Jonathan Taylor, Philip Davidson, Onur G. Guleryuz, Yinda Zhang, Shahram Izadi, Andrea Tagliasacchi, Sofien Bouaziz, and Cem Keskin. Deep implicit volume compression. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020.
[44] TenkLabs. Kodon. https://www.tenklabs.com/. Accessed: May 10, 2021 [Online].
[45] Unity Technologies. Unity 3d. https://unity.com/. Accessed: May 10, 2021 [Online].
[46] Kenneth James Versprille. Computer-Aided Design Applications of the Rational bSpline Approximation Form. PhD thesis, USA, 1975. AAI7607690.
[47] Voxel Plugin. Voxel plugin - dynamic terrain & procedural generation in unreal engine. https://voxelplugin.com/. Accessed: May 10, 2021 [Online].