| 研究生: |
闕郁珊 Chueh, Yu-Shan |
|---|---|
| 論文名稱: |
遊戲化設計於網路調查數據品質與參與體驗影響之研究 The Effect of Gamification Design on Online Survey Data Quality and Participation Experience |
| 指導教授: |
劉說芳
Liu, Shuo-Fang |
| 學位類別: |
碩士 Master |
| 系所名稱: |
規劃與設計學院 - 工業設計學系 Department of Industrial Design |
| 論文出版年: | 2020 |
| 畢業學年度: | 108 |
| 語文別: | 英文 |
| 論文頁數: | 133 |
| 中文關鍵詞: | 遊戲化 、網路調查 、數據品質 、使用者體驗 |
| 外文關鍵詞: | Gamification, Online survey, Data quality, User experience |
| 相關次數: | 點閱:247 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
網路調查是一種通過網站進行研究與市場調查的新模式,近二十年中獲得極大的歡迎。然而,網路調查的回覆率普遍較低,進一步影響調查的數據品質,從研究主題至資料整理與分析,調查數據品質乃是所有研究者們追求的最高標準。幸運的是遊戲化可以通過遊戲元素與機制製造類似遊戲的歷程,進一步驅使人們的參與動機、體驗與忠誠度,同時也經常應用於嚴肅工作中。
本研究欲以遊戲化應用於網路調查,來提升數據品質及促進參與體驗。先以現有網路調查案例及遊戲化相關研究篩選出適合網路調查之元素,並進一步以半結構式訪談與使用者體驗測試確立體驗性較高的遊戲化元素。以第一階段實驗為基礎,自建網頁開發出遊戲化調查與一般調查,將兩者執行A/B測試探究遊戲化網路調查對數據品質及主觀參與體驗的影響。
研究結果發現,遊戲化調查在客觀性指標的回覆率、回覆時間及開放式問題的答案長度,以及主觀性指標的系統易用性量表及使用者體驗問卷,這幾個項目結果都優於一般調查。尤其遊戲化調查的回覆率達80.39%更是比一般的調查都還要高,而在開放式問題的答案長度中也有達顯著水準,還額外收穫到受測者使用表情符號及波浪符號的回應狀況,表示遊戲化調查操作起來很有趣及設計的很棒等回饋。由此證明應用遊戲化能使得網路調查參與者有良好的體驗並提升數據品質。最後,本研究最終提出了遊戲化調查的設計概念,將網路調查分做「觸發連結」、「參與動力」與「成就回饋」三個階段進行遊戲化設計。此概念貢獻給後續的研究實驗進一步開發,無論是提升調查品質亦或是貼近使用者的期望,遊戲化網路調查勢必是個新機會能深入去發展。
Online survey is a new mode of conducting research and market research through websites, which has gained great popularity in the past two decades. However, the response rate of online surveys is generally low, which further affects the quality of survey. The data quality is the highest standard pursued by all researchers. Fortunately, gamification can create a game-like process and environment through game elements and mechanics to further drive people’s motivation, experience, and loyalty. It is also often used in serious work.
This study intends to apply gamification to online surveys to improve data quality and promote participation experience. First, the existing online survey cases and gamification-related research are used to screen out the elements suitable for the online survey, and then semi-structured interviews and user experience tests are used to establish more experiential gamification elements. Based on the first phase of the experiment, self-built website developed gamification surveys and normal surveys, and performed A/B testing to explore the impact of gamification online surveys on data quality and subjective participation experience.
The result shows that gamification surveys are better than normal surveys in terms of response rate, response time, length of answers to open questions, system usability scale, and user experience questionnaire. In particular, the response rate of gamification surveys reached 80.39%, which is even higher than general online surveys. The length of answers to open questions is also higher than normal surveys and has reached significant level. In addition, participants mentioned in the answers that these are fun to operate and well designed. This proves that application gamification can enable to have a great experience and improve data quality. Finally, this research puts forward the design concept of the gamification survey, which divides the online survey into three stages: “Trigger Connection”, “Participation Motivation” and “Achievement Feedback”. Whether improving the quality of the survey or meeting the expectations of users, gamification online surveys are bound to be a new opportunity for further development.
AAPOR. (2016). Standard Definitions: Final Dispositions of Case Codes and Outcome Rates for Surveys. In 9th (Ed.). Ann Arbor, MI: AAPOR.
Azoulay, P., Graff Zivin, J. S., & Manso, G. (2011). Incentives and creativity: evidence from the academic life sciences. The RAND Journal of Economics, 42(3), 527-554.
Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114-123.
Baptista, G., & Oliveira, T. (2019). Gamification and serious games: A literature meta-analysis and integrative model. Computers in Human Behavior, 92, 306-315. doi:10.1016/j.chb.2018.11.030
Bernhaupt, R. (2015). Game user experience evaluation: Springer.
Bosnjak, M., & Tuten, T. L. (2003). Prepaid and promised incentives in web surveys: An experiment. Social science computer review, 21(2), 208-217.
Brace, I. (2018). Questionnaire design: How to plan, structure and write survey material for effective market research: Kogan Page Publishers.
Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189(194), 4-7.
Bruns, A. (2008). Blogs, Wikipedia, Second Life, and beyond: From production to produsage (Vol. 45): Peter Lang.
Bunchball, I. (2010). Gamification 101: An introduction to the use of game dynamics to influence behavior. White paper, 9.
Carroll, J. M. (1982). The adventure of getting to know a computer. Computer(11), 49-58.
Chandola, V., Banerjee, A., & Kumar, V. (2007). Outlier detection: A survey. ACM Computing Surveys, 14, 15.
Chen, C. M., Li, M. C., & Chen, T. C. (2020). A web-based collaborative reading annotation system with gamification mechanisms to improve reading performance. Computers & Education, 144, 103697.
Chin, J. P., Diehl, V. A., & Norman, K. L. (1988). Development of an instrument measuring user satisfaction of the human-computer interface. Paper presented at the Proceedings of the SIGCHI conference on Human factors in computing systems.
Cook, C., Heath, F., Thompson, R. L., & Thompson, B. (2001). Score reliability in webor internet-based surveys: Unnumbered graphic rating scales versus likert-type scales. Educational and Psychological Measurement, 61(4), 697-706.
Couper, M. P. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64(4), 464-494.
Couper, M. P., Traugott, M. W., & Lamias, M. J. (2001). Web survey design and administration. Public Opinion Quarterly, 65(2), 230-253.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. psychometrika, 16(3), 297-334.
Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological bulletin, 125(6), 627.
Deci, E. L., & Ryan, R. M. (1985). Intrinsic motivation and self-determination in human behavior. New York and London: Plenum.
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: defining gamification. Paper presented at the Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments.
Dillman, D. A., Gertseva, A., & Mahon Haft, T. (2005). Achieving usability in establishment surveys through the application of visual design principles. Journal of Official Statistics, 21(2), 183.
Dillman, D. A., & Smyth, J. D. (2007). Design effects in the transition to web-based surveys. Am J Prev Med, 32(5 Suppl), S90-96. doi:10.1016/j.amepre.2007.03.008
Dillmann, D. A. (2000). Mail and internet surveys: the tailored design method. New York.
DIS, I. (2010). 9241-210: 2010. Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems (formerly known as 13407). International Standardization Organization (ISO). Switzerland.
Domínguez, A., Saenz-de-Navarrete, J., de-Marcos, L., Fernández-Sanz, L., Pagés, C., & Martínez-Herráiz, J.-J. (2013). Gamifying learning experiences: Practical implications and outcomes. Computers & Education, 63, 380-392. doi:10.1016/j.compedu.2012.12.020
Fan, W., & Yan, Z. (2010). Factors affecting response rates of the web survey: A systematic review. Computers in Human Behavior, 26(2), 132-139. doi:10.1016/j.chb.2009.10.015
Frey, B. S., & Oberholzer-Gee, F. (1997). The cost of price incentives: An empirical analysis of motivation crowding-out. The American economic review, 87(4), 746-755.
Fricker, R. D., & Schonlau, M. (2002). Advantages and disadvantages of Internet research surveys: Evidence from the literature. Field methods, 14(4), 347-367.
Groves, R. M., & Couper, M. P. (2012). Nonresponse in household interview surveys: John Wiley & Sons.
Groves, R. M., & Peytcheva, E. (2008). The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-Analysis. Public Opinion Quarterly, 72(2), 167-189. doi:10.1093/poq/nfn011
Guba, E. G., & Lincoln, Y. S. (1994). Competing paradigms in qualitative research. Handbook of qualitative research, 2(163-194), 105.
Hamari, J., & Koivisto, J. (2013). Social Motivations To Use Gamification: An Empirical Study Of Gamifying Exercise. Paper presented at the ECIS.
Hamari, J., & Koivisto, J. (2015). “Working out for likes”: An empirical study on social influence in exercise gamification. Computers in Human Behavior, 50, 333-347.
Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification. Paper presented at the 2014 47th Hawaii International Conference on System Sciences.
Hassan, L., Dias, A., & Hamari, J. (2019). How motivational feedback increases user’s benefits and continued use: A study on gamification, quantified-self and social networking. International Journal of Information Management, 46, 151-162. doi:10.1016/j.ijinfomgt.2018.12.004
Hassenzahl, M., Schöbel, M., & Trautmann, T. (2008). How motivational orientation influences the evaluation and choice of hedonic and pragmatic interactive products: The role of regulatory focus. Interacting with Computers, 20(4-5), 473-479.
Huotari, K., & Hamari, J. (2012). Defining gamification: a service marketing perspective. Paper presented at the Proceeding of the 16th international academic MindTrek conference.
Huotari, K., & Hamari, J. (2016). A definition for gamification: anchoring gamification in the service marketing literature. Electronic Markets, 27(1), 21-31. doi:10.1007/s12525-015-0212-z
Johnson, D., Deterding, S., Kuhn, K. A., Staneva, A., Stoyanov, S., & Hides, L. (2016). Gamification for health and wellbeing: A systematic review of the literature. Internet Interv, 6, 89-106. doi:10.1016/j.invent.2016.10.002
Juul, J. (2010). A casual revolution: Reinventing video games and their players: MIT press.
Kohavi, R., & Longbotham, R. (2017). Online Controlled Experiments and A/B Testing. Encyclopedia of machine learning and data mining, 7(8), 922-929.
Laugwitz, B., Held, T., & Schrepp, M. (2008). Construction and evaluation of a user experience questionnaire. Paper presented at the Symposium of the Austrian HCI and Usability Engineering Group.
Malone, T. W. (1982). Heuristics for designing enjoyable user interfaces: Lessons from computer games. Paper presented at the Proceedings of the 1982 conference on Human factors in computing systems.
Marache-Francisco, C., & Brangier, E. (2013). Process of gamification. Proceedings of the 6th Centric, 126-131.
Mavletova, A. (2015). Web surveys among children and adolescents: is there a gamification effect? Social science computer review, 33(3), 372-398.
Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological methods, 17(3), 437.
Mora, A., Riera, D., Gonzalez, C., & Arnedo-Moreno, J. (2015). A literature review of gamification design frameworks. Paper presented at the 2015 7th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games).
National Development Council (2019). 2018 Mobile Phone Users’ Digital Opportunity Survey (AE080005). Available from Survey Research Data Archive, Academia Sinica. doi:10.6141/TW-SRDA-AE080005-1
National Development Council (2020). 2018 Mobile Phone Users’ Digital Opportunity Survey (AE080006). Available from Survey Research Data Archive, Academia Sinica. doi:10.6141/TW-SRDA-AE080006-1
Norman, D., Miller, J., & Henderson, A. (1995). What you see, some of what’s in the future, and how we go about doing it: HI at Apple Computer. Paper presented at the Conference companion on Human factors in computing systems.
Pelling, N. (2011). The (short) prehistory of gamification. Funding Startups (& other impossibilities), 9.
Pine, B. J., & Gilmore, J. H. (1998). Welcome to the experience economy. Harvard business review, 76, 97-105.
Pine, B. J., & Gilmore, J. H. (2011). The experience economy: Harvard Business Press.
Poncin, I., Garnier, M., Ben Mimoun, M. S., & Leclercq, T. (2017). Smart technologies and shopping experience: Are gamification interfaces effective? The case of the Smartstore. Technological Forecasting and Social Change, 124, 320-331. doi:10.1016/j.techfore.2017.01.025
Porter, S. R., & Whitcomb, M. E. (2003). The impact of lottery incentives on student survey response rates. Research in higher education, 44(4), 389-407.
Reeve, J. (2014). Understanding motivation and emotion: John Wiley & Sons.
Reeves, B., & Read, J. L. (2009). Total engagement: How games and virtual worlds are changing the way people work and businesses compete: Harvard Business Press.
Rhyne, T. M., Doenges, P., Hibbard, B., Pfister, H., & Robins, N. (2000). The impact of computer games on scientific & information visualization (panel session):“if you can’t beat them, join them”. Paper presented at the Proceedings of the conference on Visualization’00.
Rodden, K., Hutchinson, H., & Fu, X. (2010). Measuring the user experience on a large scale: user-centered metrics for web applications. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.
Rodrigues, L. F., Oliveira, A., & Costa, C. J. (2016). Playing seriously – How gamification and social cues influence bank customers to use gamified e-business applications. Computers in Human Behavior, 63, 392-407. doi:10.1016/j.chb.2016.05.063
Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary educational psychology, 25(1), 54-67.
Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371-380. doi:10.1016/j.chb.2016.12.033
Sauermann, H., & Roach, M. (2013). Increasing web survey response rates in innovation research: An experimental study of static and dynamic contact design features. Research Policy, 42(1), 273-286. doi:10.1016/j.respol.2012.05.003
Schacht, S., Keusch, F., Bergmann, N., & Morana, S. (2017). Web survey gamification–increasing data quality in web surveys by using game design elements.
Schonlau, M., & Toepoel, V. (2015). Straightlining in Web survey panels over time. Paper presented at the Survey Research Methods.
Schrepp, M. (2019). User experience questionnaire handbook. All you need to know to apply the UEQ successfully in your project.
Scott, N. (2012). A user-centered theoretical framework for meaningful gamification. Games+ Learning+ Society, 8.
Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: A survey. International Journal of Human-Computer Studies, 74, 14-31.
Statista. (2018). Market research tools most used by market researchers in the United States in 2017 and 2018. Retrieved from https://www.statista.com/statistics/917601/market-research-industry-us-most-used-tools/.
Teo, T. S., Lim, V. K., & Lai, R. Y. (1999). Intrinsic and extrinsic motivation in Internet usage. Omega, 27(1), 25-37.
Terrill, B. (2008). My coverage of lobby of the social gaming summit. Bret on Social Games.
Vorderer, P., Klimmt, C., & Ritterfeld, U. (2004). Enjoyment: At the heart of media entertainment. Communication theory, 14(4), 388-408.
Werbach, K., & Hunter, D. (2012). For the win: How game thinking can revolutionize your business: Wharton Digital Press.
Yohannis, A. R., Prabowo, Y. D., & Waworuntu, A. (2014). Defining Gamification: From lexical meaning and process viewpoint towards a gameful reality. Paper presented at the 2014 International Conference on Information Technology Systems and Innovation (ICITSI).
Zhang, C., & Conrad, F. (2014). Speeding in web surveys: The tendency to answer very fast and its association with straightlining. Paper presented at the Survey Research Methods.
Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps: "O’Reilly Media, Inc.".
張紹勳 (2008)。研究方法:理論與統計。 臺中市:滄海圖書。