簡易檢索 / 詳目顯示

研究生: 謝慈芯
Hsieh, Tzu-Hsin
論文名稱: 數位孿生在混合實境下的協作設計
Application of Digital Twin for Collaborative Design in Mixed Reality Environment
指導教授: 鄭泰昇
Jeng, Tay-Sheng
學位類別: 碩士
Master
系所名稱: 規劃與設計學院 - 建築學系
Department of Architecture
論文出版年: 2023
畢業學年度: 111
語文別: 英文
論文頁數: 154
中文關鍵詞: 協同作業數位孿生混合實境物聯網智慧城市管理平台
外文關鍵詞: Collaboration Design, Digital Twin, Mixed Reality (MR), Internet of Things (IoT), Smart City, Management Platform
相關次數: 點閱:104下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 建築資訊模型 (BIM) 提供了設計及施工協作的基礎,但是在建築模型資訊常常存在著即時同步的問題,且目前 BIM 著重在建築元件的資訊記錄,對於協同作業的管理維護環境無法提供良好協助,例如環境感測數據同步、用戶回饋交流、資源共享等等,為了將BIM 技術從建築設計階段延伸到設施管理階段,因此需要導入數位孿生 (Digital Twin) 技術,建置一個3D視覺化平台,以提供一個同步作業的環境,使得建築至城市的管理效率達最佳化。
    本研究專注於研發一種更直觀的操作方式來提升協同設計。因此我們將數位孿生技術與混合現實(MR)結合,藉由數位孿生中IoT數據的整合,導入混合實境協同作業的環境。本研究即時提供最佳的信息共享,為管理者和決策者提供對空間的理解與溝通,並確保模型和信息數據在建築物生命週期中始終保持更新狀態。我們的具體目標包括將數位孿生技術與MR有效結合,提升協同設計方法,並實現即時更改與視覺反饋。
    在本論文中,我們使用Unity引擎與Autodesk Forge API,將現場的建築信息建立為BIM模型,並在Microsoft HoloLens 2可穿戴設備上顯示。我們建立了現場模型的數位孿生網絡儀表板,由感應器收集的數據到由Raspberry pi建立的物聯網基站。接著將數位孿生網絡儀表板上的模型顯示在HoloLens 2上,以支援在混合現實環境中進行協同設計。在智慧城市應用中,該系統打破了現有城市管理介面的2D平面,並在混合現實(MR)頭戴式裝置中將介面3D視覺化,創造了一種更直觀且高效的智慧城市管理方式。

    Building Information Modeling (BIM) provides the basis for design collaboration, but there are often problems with real-time synchronization of building model information. Currently, BIM focuses on the information record of building components, but does not provide good assistance to the management and maintenance environment of collaborative work, such as synchronization of environmental sensing data, user feedback exchange, resource sharing, etc. In order to extend BIM technology from the building design stage to the facility management stage, it is necessary to introduce Digital Twin technology to build a 3D visualization platform to provide a collaborative environment. This will optimize the efficiency of building and city management.
    This study focuses on providing a more intuitive way to support collaborative design. Therefore, a collaborative environment is created by integrating IoT data in digital twins into a mixed reality environment. Our research provides optimal information sharing in real time, providing managers and decision makers with direct control and discussion of the space. This ensures that models and information data are always up to date over the life cycle of the building. Our specific goals include the effective integration of digital twin technology with MR to enhance collaborative design approaches and enable real-time changes and real-time visual feedback.
    In this paper, we used the Unity Engine with Autodesk Platform Services API to build a BIM model in the field and display it on a Microsoft HoloLens 2 wearable device. We built a digital twin web dashboard of the field model with the data collected by the sensors to the IoT base station built by Raspberry pi. The models on the digital twin dashboard were then displayed on HoloLens 2 to enable collaborative design in a mixed reality environment. The system breaks the 2D plane of the existing city management interface and visualizes the interface in 3D in a mixed reality (MR) headset, creating a more intuitive and efficient way to manage smart cities.

    摘要 ............................................................................................................................I Abstract ..................................................................................................................... II Acknowledgement ................................................................................................... III Contents ...................................................................................................................IV List of Figure ......................................................................................................... VII List of Table.............................................................................................................XI Chapter 1 Introduction..........................................................................................1 1.1 Research Background & Motivation ..................................................................... 1 1.2 Research Objective................................................................................................ 2 1.3 Research Framework & Method............................................................................ 4 Chapter 2 Related Work .......................................................................................6 2.1 Collaborative Design............................................................................................. 6 2.1.1 The definition of Collaboration Design......................................................... 7 2.1.2 Collaboration Design & Computer Aided Architectural Design (CAAD).... 9 2.1.3 Shared Workspace of Collaboration Design ............................................... 12 2.1.4 The Communication problem and process of collaborative design............. 16 2.1.5 The Strategies for Enhancing Collaborative Design ................................... 18 2.2 Concept of Digital Twin................................................................................................ 20 2.2.1 From Building Information Modeling (BIM) to Digital Twins................... 20 2.2.2 The definition of Digital Twin .................................................................... 24 2.2.3 The Classification of Digital Twin .............................................................. 26 2.2.4 The System Framework of Digital Twin.................................................... 29 2.2.5 Digital Twin with IoT .................................................................................. 33 2.3 Mixed Reality ...................................................................................................... 36 2.3.1 The Development of Mixed Reality ............................................................ 36 2.3.2 The Features of Mixed Reality .................................................................... 38 2.3.3 The technology of Mixed Reality ................................................................ 39 2.3.4 Applications of Mixed Reality in AEC ....................................................... 41 2.4 Connection between Related Work ..................................................................... 46 2.4.1 Comparison between Digital Twin and Mixed Reality ............................... 46 2.4.2 Advantages of Collaborative in Mixed Reality environments .................... 48 2.4.3 The implementation of Digital Twin in Smart City management ............... 50 Chapter 3 Framework and Methodology ............................................................ 57 3.1 The Scenario ........................................................................................................ 57 3.2 System Design ..................................................................................................... 61 3.2.1 Development Environment and Tools ......................................................... 62 3.2.2 System and Users ........................................................................................ 66 3.2.3 Collaborative Flow ...................................................................................... 67 3.3 Digital Twin Web Dashboard ............................................................................ 70 3.3.1 Digital Twin Modeling ................................................................................ 72 3.3.2 IoT Sensor Connection ................................................................................ 76 3.4 Mixed Reality Application ................................................................................ 80 3.4.1 Digital Twin Import ..................................................................................... 81 3.4.2 Mixed Reality Deployment ......................................................................... 83 3.5 Collaborative Environment................................................................................. 86 3.5.1 Collaborative Environment Setup ............................................................... 87 3.5.2 Collaborative Interface Design .................................................................... 93 Chapter 4 Applications, Finding and Evaluation .............................................. 102 4.1 Applications ....................................................................................................... 103 4.2 Experimental Analysis ....................................................................................... 107 4.2.1 Data Management ...................................................................................... 107 4.2.2 IoT Connectivity ........................................................................................ 109 4.3 User Experience ................................................................................................. 112 4.3.1 Visual Interface ......................................................................................... 112 4.3.2 Collaboration ............................................................................................. 118 Chapter 5 Conclusion and Discussion .............................................................. 123 5.1 Conclusion ......................................................................................................... 123 5.2 Discussion.......................................................................................................... 125 5.3 Future work ....................................................................................................... 126 I. Reference ........................................................................................................ 132 English Reference .......................................................................................................... 132 Chinese Reference ......................................................................................................... 136 Website Reference ......................................................................................................... 136 II. Appendix ..................................................................................................... 137 II.1 Database Connection .............................................................................................. 137 II.2 Interface Design Process ......................................................................................... 138 II.3 Collaboration Setting .............................................................................................. 139 II.4 System Demo Video ............................................................................................... 141

    English Reference
    Alam, K. M., & El Saddik, A. (2017). C2PS: A Digital Twin Architecture Reference Model for the Cloud-Based Cyber-Physical Systems. IEEE Access, 5, 2050-2062. https://doi.org/10.1109/access.2017.2657006
    Albino, V., Berardi, U., & Dangelico, R. M. (2015). Smart Cities: Definitions, Dimensions, Performance, and Initiatives. Journal of Urban Technology, 22(1), 3-21. https://doi.org/10.1080/10630732.2014.942092
    Azhar, S. (2011). Building Information Modeling (BIM): Trends, Benefits, Risks, and Challenges for the AEC Industry. Leadership and management in engineering, 11(3), 241-252. https://doi.org/10.1061/(asce)lm.1943-5630.0000127
    Bew, M., & Richards, M. (2008). BIM maturity model. Construct IT Autumn 2008 Members’ Meeting. Brighton, UK,
    Billinghurst, M., & Kato, H. (1999). Collaborative mixed reality. Proceedings of the first international symposium on mixed reality,
    Boschert, S., & Rosen, R. (2016). Digital Twin—The Simulation Aspect. In (pp. 59-74). Springer International Publishing. https://doi.org/10.1007/978-3-319-32156-1_5
    Caprari, G., Castelli, G., Montuori, M., Camardelli, M., & Malvezzi, R. (2022). Digital Twin for Urban Planning in the Green Deal Era: A State of the Art and Future Perspectives. Sustainability, 14(10), 6263. https://doi.org/10.3390/su14106263
    Chi, H.-L., Kang, S.-C., & Wang, X. (2013). Research trends and opportunities of augmented reality applications in architecture, engineering, and construction. Automation in construction, 33, 116-122.
    Chiu, M.-L. (2002). An organizational view of design communication in design collaboration. Design studies, 23(2), 187-210.
    Cidota, M., Lukosch, S., Datcu, D., & Lukosch, H. (2016, 2016). Workspace Awareness in Collaborative AR using HMDs.
    Dave, B., Buda, A., Nurminen, A., & Främling, K. (2018). A framework for integrating BIM and IoT through open standards. Automation in construction, 95, 35-45.
    Dembski, F., Wössner, U., Letzgus, M., Ruddat, M., & Yamu, C. (2020). Urban Digital Twins for Smart Cities and Citizens: The Case Study of Herrenberg, Germany. Sustainability, 12(6), 2307. https://doi.org/10.3390/su12062307
    Deng, M., Menassa, C. C., & Kamat, V. R. (2021). From BIM to digital twins: a systematic review of the evolution of intelligent building representations in the AEC-FM industry. Journal of Information Technology in Construction, 26, 58-83. https://doi.org/10.36680/j.itcon.2021.005
    Eastman, C. M., Teicholz, P., Sacks, R., & Liston, K. (2011). BIM handbook: A guide to building information modeling for owners, managers, designers, engineers and contractors. John Wiley & Sons.
    Fiorentino, M., Uva, A. E., Monno, G., & Radkowski, R. (2012). Augmented technical drawings: a novel technique for natural interactive visualization of computer-aided design models. Journal of Computing and Information Science in Engineering, 12(2).
    Gero, J. S. (1994). Towards a model of exploration in computer-aided design. Formal design methods for CAD,
    Glaessgen, E., & Stargel, D. (2012). The digital twin paradigm for future NASA and US Air Force vehicles. 53rd AIAA/ASME/ASCE/AHS/ASC structures, structural dynamics and materials conference 20th AIAA/ASME/AHS adaptive structures conference 14th AIAA,
    Grieves, M. (2003). PLM - Beyond lean manufacturing. Manufacturing Engineering, 130, 23-23.
    Howell, I., & Batcheler, B. (2005). Building information modeling two years later–huge potential, some success and several limitations. The Laiserin Letter, 22(4), 3521-3528.
    Hu, W., Zhang, T., Deng, X., Liu, Z., & Tan, J. (2021). Digital twin: a state-of-the-art review of its enabling technologies, applications and challenges. Journal of Intelligent Manufacturing and Special Equipment, 2(1), 1-34. https://doi.org/10.1108/jimse-12-2020-010
    Kahn, K. B. (1996). Interdepartmental integration: a definition with implications for product development performance. Journal of product innovation management, 13(2), 137-151.
    Kaur, M. J., Mishra, V. P., & Maheshwari, P. (2020). The Convergence of Digital Twin, IoT, and Machine Learning: Transforming Data into Action. In (pp. 3-17). Springer International Publishing. https://doi.org/10.1007/978-3-030-18732-3_1
    Kim, K., Kim, H., & Kim, H. (2017). Image-based construction hazard avoidance system using augmented reality in wearable device. Automation in construction, 83, 390-403.
    Kritzinger, W., Karner, M., Traar, G., Henjes, J., & Sihn, W. (2018). Digital Twin in manufacturing: A categorical literature review and classification. Ifac-PapersOnline, 51(11), 1016-1022.
    Lee, S., & Yu, J. (2016). Comparative study of BIM acceptance between Korea and the United States. Journal of construction engineering and management, 142(3), 05015016.
    Li, X., Wu, P., Shen, G. Q., Wang, X., & Teng, Y. (2017). Mapping the knowledge domains of Building Information Modeling (BIM): A bibliometric approach. Automation in construction, 84, 195-206. https://doi.org/10.1016/j.autcon.2017.09.011
    Lu, Q., Chen, L., Lee, S., & Zhao, X. (2018). Activity theory-based analysis of BIM implementation in building O&M and first response. Automation in construction, 85, 317-332.
    Maher, M. L., Gero, J. S., & Saad, M. (1993). Synchronous support and emergence in collaborative CAAD. CAAD futures,
    Maher, M. L., & Rutherford, J. (1997). A model for synchronous collaborative design using CAD and database management. Research in Engineering Design, 9(2), 85-98.
    Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems, 77(12), 1321-1329.
    Milgram, P., Takemura, H., Utsumi, A., & Kishino, F. (1995). Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and telepresence technologies,
    Mohammadi, N., & Taylor, J. E. (2017). Smart city digital twins.
    Müller, C. (1997). An advanced groupware approach for an integrated planning process in building construction. CAAD futures 1997: Proceedings of the 7th International Conference on Computer Aided Architectural Design Futures held in Munich, Germany, 4–6 August 1997,
    Nash, C., Ganin, Y., Eslami, S. A., & Battaglia, P. (2020). Polygen: An autoregressive generative model of 3d meshes. International conference on machine learning,
    Palmer, T. D., & Fields, N. A. (1994). Computer supported cooperative work. Computer, 27(5), 15-17.
    Qiuchen Lu, V., Parlikad, A. K., Woodall, P., Ranasinghe, G. D., & Heaton, J. (2019, 2019). Developing a Dynamic Digital Twin at a Building Level: using Cambridge Campus as Case Study.
    Rasheed, A., San, O., & Kvamsdal, T. (2020). Digital Twin: Values, Challenges and Enablers From a Modeling Perspective. IEEE Access, 8, 21980-22012. https://doi.org/10.1109/access.2020.2970143
    Saad, M., & Maher, M. L. (1996). Shared understanding in computer-supported collaborative design. Computer-Aided Design, 28(3), 183-192.
    Sareika, M., & Schmalstieg, D. (2007, 2007). Urban Sketcher: Mixed Reality on Site for Urban Planning and Architecture.
    Scheer, S. (1990). BIM.
    Schmalstieg, D., Fuhrmann, A., Szalavari, Z., & Gervautz, M. (1996). Studierstube-an environment for collaboration in augmented reality. CVE’96 Workshop Proceedings,
    Schrotter, G., & Hürzeler, C. (2020). The Digital Twin of the City of Zurich for Urban Planning. PFG – Journal of Photogrammetry, Remote Sensing and Geoinformation Science, 88(1), 99-112. https://doi.org/10.1007/s41064-020-00092-2
    Shahat, E., Hyun, C. T., & Yeom, C. (2021). City Digital Twin Potentials: A Review and Research Agenda. Sustainability, 13(6), 3386. https://doi.org/10.3390/su13063386
    Simoff, S. J., & Maher, M. L. (2000). Analysing participation in collaborative design environments. Design studies, 21(2), 119-144.
    Soon, K. H., & Khoo, V. H. S. (2017). CITYGML MODELLING FOR SINGAPORE 3D NATIONAL MAPPING. The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLII-4/W7, 37-42. https://doi.org/10.5194/isprs-archives-xlii-4-w7-37-2017
    Tang, S., Shelden, D. R., Eastman, C. M., Pishdad-Bozorgi, P., & Gao, X. (2019). A review of building information modeling (BIM) and the internet of things (IoT) devices integration: Present status and future trends. Automation in construction, 101, 127-139.
    Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., & Sui, F. (2018). Digital twin-driven product design, manufacturing and service with big data. The International Journal of Advanced Manufacturing Technology, 94, 3563-3576.
    Tuegel, E. J., Ingraffea, A. R., Eason, T. G., & Spottswood, S. M. (2011). Reengineering Aircraft Structural Life Prediction Using a Digital Twin. International Journal of Aerospace Engineering, 2011, 1-14. https://doi.org/10.1155/2011/154798
    van Nederveen, G. A., & Tolman, F. P. (1992). Modelling multiple views on buildings. Automation in construction, 1(3), 215-224.
    Volk, R., Stengel, J., & Schultmann, F. (2014). Building Information Modeling (BIM) for existing buildings—Literature review and future needs. Automation in construction, 38, 109-127.
    Wojtowicz, J., Papazian, P., Fargas, J., Davidson, J. N., & Cheng, N. (1993). Asynchronous architecture. Education and Practice: The Critical Interface, 107-117.

    Chinese Reference
    黃崇銘. (2022). 數位孿生導入社會住宅提高管理維護效能研究.
    許家碩. (2022). 基於混合實境的機器人協作工藝

    Website Reference
    National Research Foundation (Singapore Government). (2020). Virtual Singapore. (https://www.nrf.gov.sg/programmes/virtual-singapore/).
    Stadt Zürich (Zürich Government). (2020). Digital Twin - Stadt Zürich (https://www.stadt-zuerich.ch/portal/de/index/politik_u_recht/stadtrat/weitere-politikfelder/smartcity/english/projects/zwilling.html)
    Microsoft Learn. (2022). HoloLens 2 fundamentals: develop mixed reality applications – Training. (https://learn.microsoft.com/en-us/training/paths/beginner-hololens-2-tutorials/)
    Microsoft Learn. (2022). Create & locate anchors in Unity - Azure Spatial Anchors (https://learn.microsoft.com/en-us/azure/spatial-anchors/how-tos/create-locate-anchors-unity)
    Microsoft Learn. (2022). Sharing object movements with multiple users - Mixed Reality. (https://learn.microsoft.com/en-us/windows/mixed-reality/develop/unity/tutorials/mr-learning-sharing-04)
    Autodesk Platform Services (formerly Forge). (2019). Getting Started | Autodesk Platform Services Tutorials. (https://tutorials.autodesk.io/)
    Photon Engine. (2022). Photon Unity Networking 2: Main Page. (https://doc-api.photonengine.com/en/pun/v2/index.html)
    Microsoft. (2023). HoloLens 2 brings new immersive collaboration tools to industrial metaverse customers (https://news.microsoft.com/source/features/innovation/hololens-2-industrial-metaverse/)
    Apple. (2023). Design spatial SharePlay experiences (https://developer.apple.com/videos/play/wwdc2023/10075/)

    無法下載圖示 校內:2026-06-08公開
    校外:2026-06-08公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE