頭戴式顯示器的擴增實境環境可以為玩家提供身臨其境的遊戲體驗，適當的手勢可以實現現實世界與虛擬環境的結合。先前的研究指出有許多因素會影響玩家的沉浸感，包括遊戲的即時反饋、遊戲畫面的質量、玩家的個人特質、遊戲的介面等等因素。但在頭戴式擴增實境的介面以及敘事與非敘事介面的研究甚少。本研究探索手勢操作在遊戲中的可用性，並嘗試使用當前成熟的手勢傳感器尋找新的應用。利用Leap motion所設計的開源眼鏡開發了一款基於手勢互動的頭戴式擴增實境遊戲，包含第一人稱射擊遊戲的元素。無需任何控制器或屏幕來操作遊戲，僅依靠玩家的雙手通過無控制器介面進行操作。
而本研究主要專注在血條、時間、選單以及彈藥顯示這四種介面在敘事以及非敘事介面兩種版本的影響。比較了這四種介面在兩種不同版本的方式之下沉浸感的差異。最後，本研究表明，易用性得分為79.4，屬於合格的易用性評估。在ARI量表結果中兩版本並無顯著的差異，可能的原因為量表的問項不具指標性，本研究提出了未來相關研究的建議問項。最後根據訪談的結果，69%的玩家認為敘事介面有較高的沉浸感。而敘事介面若可以達到即時顯示玩家所需的資訊時，可以使沉浸感更高。怪物血條需要有明顯的反饋，而上方的HUD血條以玩家自行設定的方式較為適合。至於時間則較無明顯的差異，應該視遊戲的類型及風格為準。最後，這項提出了敘事及非敘事的沉浸研究的挑戰和未來建議。

The head-mounted environment can bring players an immersive gaming experience, and the use of gesture control can enable real-world objects to interact with the virtual environment. Previous studies have pointed out that many factors affect the player's immersion, including the instant feedback of the game, the quality of the game screen, the player's characteristics, the game interface, and so on. However, there is very little research on the head-mounted augmented reality interface and the diegetic and non-diegetic interface. This research explores the usability of gesture operations in games and tries to find new applications using current mature gesture sensors. Using the open-source glasses designed by Leap motion, a head-mounted augmented reality game based on gesture interaction was developed, which contains elements of first-person shooter games. There is no need for any controller or screen to operate the game and only rely on the player's hands to operate through the controller-less interface.
This research mainly focuses on the impact of the four interfaces on the diegetic and non-diegetic versions of the blood bar, time, menu, and ammunition. The differences in immersion between these four interfaces in two different versions are compared. Finally, this study shows that the SUS (System Usability Scale) score is 79.4, which is qualified ease of use evaluation. There is no significant difference between the two versions in the results of the ARI scale. The possible reason is that the question items of the scale are not indexed. This study puts forward suggestions for future related research. Finally, according to the results of the interview, 69% of players believe that the diegetic interface has a high sense of immersion. If the diegetic interface can display the information required by the player in real-time, it can increase the sense of immersion. The monster health bar needs obvious feedback, and the upper HUD health bar is more suitable for players to set by themselves. As for the time, there is no obvious difference, it should depend on the type and style of the game. Finally, this article presents challenges and future recommendations for diegetic and non-diegetic immersive research.

Alimanova, M., Borambayeva, S., Kozhamzharova, D., Kurmangaiyeva, N., Ospanova, D., Tyulepberdinova, G., . . . Kassenkhan, A. (2017). Gamification of hand rehabilitation process using virtual reality tools: Using leap motion for hand rehabilitation. Paper presented at the 2017 First IEEE International Conference on Robotic Computing (IRC).
Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators & Virtual Environments, 6(4), 355-385.
Bajura, M., & Neumann, U. (1995). Dynamic registration correction in augmented-reality systems. Paper presented at the Proceedings Virtual Reality Annual International Symposium'95.
BBC. (2016a). Hundreds of Pokemon Go incidents logged by police. Retrieved from https://www.bbc.com/news/uk-england-37183161
BBC. (2016b). Pokemon Go 'increases risk of death by distraction'. Retrieved from https://www.bbc.com/news/health-37563986
BBC. (2019). Microsoft HoloLens 2 augmented reality headset unveiled. Retrieved from https://www.bbc.com/news/technology-47350884
Billinghurst, M., Clark, A., & Lee, G. (2015). A survey of augmented reality. Foundations and Trends® in Human–Computer Interaction, 8(2-3), 73-272.
Brown, E., & Cairns, P. (2004). A grounded investigation of game immersion. Paper presented at the CHI'04 extended abstracts on Human factors in computing systems.
Burns, C. G., & Fairclough, S. H. (2015). Use of auditory event-related potentials to measure immersion during a computer game. International Journal of Human-Computer Studies, 73, 107-114.
Bystrom, K.-E., Barfield, W., & Hendrix, C. (1999). A conceptual model of the sense of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 8(2), 241-244.
Cabreira, A. T., & Hwang, F. (2015). An analysis of mid-air gestures used across three platforms. Paper presented at the Proceedings of the 2015 British HCI Conference.
Caudell, T. P., & Mizell, D. W. (1992). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Paper presented at the Proceedings of the twenty-fifth Hawaii international conference on system sciences.
Christian Schönauer, T. P., Hannes Kaufmann. (2011). Chronic Pain Rehabilitation with a Serious Game using Multimodal Input.
Clark, R. A., Pua, Y. H., Fortin, K., Ritchie, C., Webster, K. E., Denehy, L., & Bryant, A. L. (2012). Validity of the Microsoft Kinect for assessment of postural control. Gait Posture, 36(3), 372-377. doi:10.1016/j.gaitpost.2012.03.033
Csikszentmihalyi, M., & Graef, R. (1975). Socialization into sleep: Exploratory findings. Merrill-Palmer Quarterly of Behavior and Development, 21(1), 3-18.
Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience: New York: Harper & Row.
Cummings, J. J., & Bailenson, J. N. (2016). How immersive is enough? A meta-analysis of the effect of immersive technology on user presence. Media Psychology, 19(2), 272-309.
Esfahlani, S. S., Muresan, B., Sanaei, A., & Wilson, G. (2018). Validity of the Kinect and Myo armband in a serious game for assessing upper limb movement. Entertainment Computing, 27, 150-156.
Fagerholt, E., & Lorentzon, M. (2009). Beyond the HUD-user interfaces for increased player immersion in FPS games.
Fernandez, R. A. S., Sanchez-Lopez, J. L., Sampedro, C., Bavle, H., Molina, M., & Campoy, P. (2016). Natural user interfaces for human-drone multi-modal interaction. Paper presented at the 2016 International Conference on Unmanned Aircraft Systems (ICUAS)
Fitzgerald, E., Ferguson, R., Adams, A., Gaved, M., Mor, Y., & Thomas, R. (2013). Augmented reality and mobile learning: the state of the art. International Journal of Mobile and Blended Learning (IJMBL), 5(4), 43-58.
Foxlin, E. (1996). Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter.
Galloway, A. R. (2006). Gaming: Essays on algorithmic culture (Vol. 18): U of Minnesota Press.
Gartenberg, C. (2018). Microsoft has discontinued the Kinect Adapter for newer Xbox One consoles.Retrieved from https://www.theverge.com/circuitbreaker/2018/1/2/16842738/microsoft-kinect-adapter-xbox-one-x-s-discontinued
Georgiou, Y., & Kyza, E. A. (2017). The development and validation of the ARI questionnaire: An instrument for measuring immersion in location-based augmented reality settings. International Journal of Human-Computer Studies, 98, 24-37. doi:10.1016/j.ijhcs.2016.09.014
Grinberg, A. M., Careaga, J. S., Mehl, M. R., & O’Connor, M.-F. (2014). Social engagement and user immersion in a socially based virtual world. Computers in Human Behavior, 36, 479-486.
Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., & Sodnik, J. (2014). An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors, 14(2), 3702-3720.
Hinske, S., Lampe, M., Magerkurth, C., & Röcker, C. (2007). Classifying pervasive games: on pervasive computing and mixed reality. Concepts and technologies for Pervasive Games-A Reader for Pervasive Gaming Research, 1(20), 1-20.
Jennett, C., Cox, A. L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., & Walton, A. (2008). Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 66(9), 641-661. doi:10.1016/j.ijhcs.2008.04.004
Körner, A., Geyer, M., & Brähler, E. (2002). Das NEO-Fünf-Faktoren Inventar. Diagnostica, 48(1), 19-27.
Kratz, L., Smith, M., & Lee, F. J. (2007). Wiizards: 3d gesture recognition for game play input. Paper presented at the Proceedings of the 2007 conference on Future Play.
Laffan, D. A., Greaney, J., Barton, H., & Kaye, L. K. (2016). The relationships between the structural video game characteristics, video game engagement and happiness among individuals who play video games. Computers in Human Behavior, 65, 544-549.
Laine, T. H., & Suk, H. J. (2016). Designing mobile augmented reality exergames. Games and culture, 11(5), 548-580.
Lake, S. (2018). Ending Sales of Myo, Preparing for the Future. Retrieved from https://medium.com/@srlake/ending-sales-of-myo-preparing-for-the-future-281af9bbcac2
Leap Motion. (2018). Project North Star is Now Open Source. Retrieved from http://blog.leapmotion.com/north-star-open-source/
Lessiter, J., Freeman, J., Keogh, E., & Davidoff, J. (2001). A cross-media presence questionnaire: The ITC-Sense of Presence Inventory. Presence: Teleoperators & Virtual Environments, 10(3), 282-297.
Mackie, K. (2019). Microsoft Shows Off HoloLens 2 and Azure Kinect at MWC19 Barcelona. Retrieved from https://redmondmag.com/articles/2019/02/25/hololens-2-azure-kinect-mwc19.aspx
Marin, G., Dominio, F., & Zanuttigh, P. (2014). Hand gesture recognition with leap motion and kinect devices. Paper presented at the 2014 IEEE International Conference on Image Processing (ICIP).
McMahan, A. (2013). Immersion, engagement, and presence: A method for analyzing 3-D video games. In The video game theory reader (pp. 89-108): Routledge.
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems, 77(12), 1321-1329.
Mircosoft. (2019). Azure Kinect DK. Retrieved from https://azure.microsoft.com/zh-tw/services/kinect-dk/
Morschheuser, B., Riar, M., Hamari, J., & Maedche, A. (2017). How games induce cooperation? A study on the relationship between game features and we-intentions in an augmented reality game. Computers in Human Behavior, 77, 169-183. doi:10.1016/j.chb.2017.08.026
Nah, F. F.-H., Eschenbrenner, B., Zeng, Q., Telaprolu, V. R., & Sepehr, S. (2014). Flow in gaming: literature synthesis and framework development. International Journal of Information Systems and Management, 1(1-2), 83-124.
Newzoo. (2019). Newzoo Global Games Market Report 2019. Retrieved from https://newzoo.com/insights/trend-reports/newzoo-global-games-market-report-2019-light-version/
Normand, J.-M., Servières, M., & Moreau, G. (2012). A new typology of augmented reality applications. Paper presented at the Proceedings of the 3rd Augmented Human International Conference.
Patrick, E., Cosgrove, D., Slavkovic, A., Rode, J. A., Verratti, T., & Chiselko, G. (2000). Using a large projection screen as an alternative to head-mounted displays for virtual environments. Paper presented at the Proceedings of the SIGCHI conference on Human Factors in Computing Systems.
Peacocke, M., Teather, R. J., Carette, J., & MacKenzie, I. S. (2015). Evaluating the effectiveness of HUDs and diegetic ammo displays in first-person shooter games. Paper presented at the 2015 IEEE Games Entertainment Media Conference (GEM).
Pisharady, P. K., & Saerbeck, M. (2015). Recent methods and databases in vision-based hand gesture recognition: A review. Computer Vision and Image Understanding, 141, 152-165. doi:10.1016/j.cviu.2015.08.004
Qin, H., Patrick Rau, P.-L., & Salvendy, G. (2009). Measuring player immersion in the computer game narrative. Intl. Journal of Human–Computer Interaction, 25(2), 107-133.
Rolland, J. P., & Fuchs, H. (2000). Optical versus video see-through head-mounted displays in medical visualization. Presence: Teleoperators & Virtual Environments, 9(3), 287-309.
Saracho, O. N., & Spodek, B. (1995). Children's play and early childhood education: Insights from history and theory. Journal of education, 177(3), 129-148.
Saucier, G. (1994). Mini-Markers: A brief version of Goldberg's unipolar Big-Five markers. Journal of personality assessment, 63(3), 506-516.
Scharstein, D., & Szeliski, R. (2003). High-accuracy stereo depth maps using structured light. Paper presented at the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings.
Schell, J. (2008). The Art of Game Design:A Book of Lenses
Scoresby, J., & Shelton, B. E. (2011). Visual perspectives within educational computer games: effects on presence and flow within virtual immersive learning environments. Instructional Science, 39(3), 227-254.
Shin, D. (2017). How does immersion work in augmented reality games? A user-centric view of immersion and engagement. Information, Communication & Society, 22(9), 1212-1229. doi:10.1080/1369118x.2017.1411519
Shin, D. (2018). Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience? Computers in Human Behavior, 78, 64-73.
Silpasuwanchai, C., & Ren, X. (2015). Designing concurrent full-body gestures for intense gameplay. International Journal of Human-Computer Studies, 80, 1-13.
Slater, M., Usoh, M., & Steed, A. (1994). Depth of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 3(2), 130-144.
Sutherland, I. E. (1968). A head-mounted three dimensional display. Paper presented at the Proceedings of the December 9-11, 1968, fall joint computer conference, part I.
Takahashi. (2019). What I learned at North Star Meetup. Retrieved from https://medium.com/@pythor/what-i-learned-at-north-star-meetup-fdb56e58a2e6
Teng, C. I., Tseng, H. M., Li, I. C., & Yu, C. S. (2011). International English Big-Five mini-markers: Development of the traditional Chinese version. Journal of Management, 28(6), 579-600. (in Chinese)
ThalmicLabs. (2014). Unveiling the Final Design of the Myo™ Armband. Retrieved from https://medium.com/thalmic/unveiling-the-final-design-of-the-myo-armband-10576c0ae95b
Thompson, E. R. (2008). Development and validation of an international English big-five mini-markers. Personality and individual differences, 45(6), 542-548.
Vokorokos, L., Mihal'ov, J., & Chovancová, E. (2016). Motion sensors: Gesticulation efficiency across multiple platforms. Paper presented at the 2016 IEEE 20th Jubilee International Conference on Intelligent Engineering Systems (INES).
Weibel, D., & Wissmath, B. (2011). Immersion in computer games: The role of spatial presence and flow. International Journal of Computer Games Technology, 2011, 6.
Weibel, D., Wissmath, B., & Mast, F. W. (2010). Immersion in mediated environments: the role of personality traits. Cyberpsychology, Behavior, and Social Networking, 13(3), 251-256.
Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence, 7(3), 225-240.
Yeo, H.-S., Lee, B.-G., & Lim, H. (2013). Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimedia Tools and Applications, 74(8), 2687-2715. doi:10.1007/s11042-013-1501-1
Yeo, H.-S., Lee, B.-G., & Lim, H. (2015). Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware. Multimedia Tools and Applications, 74(8), 2687-2715.
Zahorik, P., & Jenison, R. L. (1998). Presence as being-in-the-world. Presence, 7(1), 78-89