簡易檢索 / 詳目顯示

研究生: 朱炳丞
Zhu, Bing-Cheng
論文名稱: 膚電圖、心電圖與臉部肌電圖分析情感圖片所引起的情感區分
Using Skin Conductance, EKG, Facial EMG to Discriminate Affect Induced by Affective Pictures
指導教授: 陳建旭
Chen, Chien-Hsu
學位類別: 碩士
Master
系所名稱: 規劃與設計學院 - 工業設計學系
Department of Industrial Design
論文出版年: 2021
畢業學年度: 109
語文別: 英文
論文頁數: 71
中文關鍵詞: 情緒情感圖片情感分析自我評估量表生理訊號
外文關鍵詞: emotion, affective pictures, affect discrimination, Self-Assessment Manikin, physiological signal
相關次數: 點閱:206下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 情緒是一個抽象的心理狀況,影響著我們生活許多方面,如判斷力、生產力與睡眠狀況等等,認知與管理自身情緒是現代人的重要課題之一,現今有許多情緒辨識的應用,然而臉部辨識與自評量表皆有不足之處,隨著感測器的微型化,觀測生理訊號相比以前變得容易許多,且膚電訊號、心電圖與皺眉肌肌電圖亦被證實與情感圖片有相關性,因此本研究想藉由生理訊號來分析情感圖片所引起的情感區分。使用國際情感圖片系統提供的圖片,與網路上類似內容之圖片作為實驗媒材,讓受測者在觀看情感圖片時,同時收取生理訊號,並且填寫SAM量表,隨後以成對T檢定分析觀看圖片時,生理訊號的趨勢,歸納結果後得出女性比男性更容易對情感圖片有生理訊號的反應,且心跳頻率在觀看圖片時的反應,比其餘兩個訊號還要強烈。有明顯生理訊號趨勢的情感為男性興奮、男性抑鬱、女性興奮、女性放鬆、女性抑鬱以及女性焦慮。且發現以SAM量表測量網路圖片後,結果亦與原始國際情感圖片系統之數據相仿,顯示其內容能夠有效引起情感。

    Emotion is an abstract psychological condition that affects many aspects of our lives, such as judgment, productivity, and sleep status. Recognizing and managing one's own emotions is one of the critical topics of modern people. There are many applications of emotion detection today. However, facial recognition and self-report have their shortcomings. With the miniaturization of sensors, the detection of physiological signals has become much more comfortable than before. Skin electrical signals, electrocardiograms, and electrograms between the eyebrows have also been confirmed to be related to affective pictures. Therefore, this research aims to analyze the affective discrimination caused by affective pictures through physiological signals. The pictures provided by the International Affective Picture System and similar content pictures on the Internet are used to conduct experiments with similar content pictures collected on the Internet. Subjects' physiological signals are measured while looking at the affective pictures simultaneously. Self-assessment Manikin will be filled after looking at pictures. Then apply paired sample T-test to analyze the trend of physiological signals produced while watching pictures. The result shows that women are more prone to respond to affective pictures than men in the physiological signal. And the heartbeat frequency is usually more discrimination to the affective pictures than the other two signals when viewing them. Affect with apparent physiological signal trends are male excitement, male depression, female excitement, female relaxation, female depression, and female anxiety. And after conducting the Self-assessment Manikin on pictures from the Internet, it was found that the result is similar to the original data of the International Affective Picture System. Pointing that their content can effectively induce affect.

    摘要 i SUMMARY ii 致謝 iii TABLE OF CONTENTS iv LIST OF TABLES vi LIST OF FIGURES vii CHAPTER 1 INTRODUCTION 1 1.1 Research Background and Motivation 1 1.2 Research Questions 4 1.3 Research Assumption 7 1.4 Research Limitations 10 1.5 Research Purpose 11 1.6 Framework of the Thesis 11 CHAPTER 2 LITERATURE REVIEW 13 2.1 Affect and Emotion 13 2.2 The Universality of Affects 14 2.3 Affect Circumplex Model and Naming 15 2.4 Differences in Genders’ Response to Affective Pictures 16 2.5 Scatter Plot of Pleasure and Arousal 17 2.6 Pleasure, Arousal and Physiological Signals 20 2.6.1 EMG 20 2.6.2 Skin conductivity 21 2.6.3 Heart Rate 22 2.6.4 Reference for Experimental Specification 25 2.6.5 Summary 26 CHAPTER 3 RESEARCH METHODOLOGY 28 3.1 Pre-work 28 3.1.1 Production of Experimental Briefing 28 3.1.2 Experimental Field Configuration and Hardware and Software Facilities 32 3.1.3 Subjects 34 3.2 Research Process 35 3.2.1 Wearing the Physiological Signal Sensors 35 3.2.2 Electrocardiogram Sensor 35 3.2.3 Skin Conductance Sensor 36 3.2.4 EMG Sensor 36 3.2.5 Check Data Reception 37 3.2.6 Play the Experimental Briefing 37 3.2.7 Post-Test SAM 38 3.3 Physiological Signal Data Analysis 38 3.4 SAM Data Analysis 39 CHAPTER 4 ANALYSIS AND RESULT 41 4.1 Results of Physiological Signal Analysis 41 4.2 Picture Affective Score Analysis 48 CHAPTER 5 DISCUSSION 53 5.1 X.Y. Scatter plots of Pictures’ Affective Scores 53 5.2 Affects and the Trend of Physiological Signals 56 5.2.1 Excited Affect (P+A+) 56 5.2.2 Relaxed Affect (P+A-) 57 5.2.3 Depressed Affect (P-A-) 58 5.2.4 Stressed Affect (P-A+) 58 5.2.5 Summary 59 CHAPTER 6 CONCLUSION 62 REFERENCES 66 Appendix A EXPERIMENT INTRODUCTION 69 Appendix B EXPERIMENT AGREEMENT 70 Appendix C SAM SCORES 71

    Bann, E. Y., & Bryson, J. J. (2013). Measuring cultural relativity of emotional valence and arousal using semantic clustering and twitter. arXiv preprint arXiv:1304.7507.
    Barrett, L. F. (2017). How emotions are made: The secret life of the brain: Houghton Mifflin Harcourt.
    Barrett, L. F., & Russell, J. A. (1999). The structure of current affect: Controversies and emerging consensus. Current directions in psychological science, 8(1), 10-14.
    Berlyne, D. E. (1975). Extension to Indian subjects of a study of exploratory and verbal responses to visual patterns. Journal of Cross-Cultural Psychology, 6(3), 316-330.
    Bradley, M. M., Codispoti, M., Cuthbert, B. N., & Lang, P. J. (2001). Emotion and motivation I: defensive and appetitive reactions in picture processing. Emotion, 1(3), 276.
    Bradley, M. M., Codispoti, M., Sabatinelli, D., & Lang, P. J. (2001). Emotion and motivation II: sex differences in picture processing. Emotion, 1(3), 300.
    Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry, 25(1), 49-59.
    Bradley, M. M., & Lang, P. J. (1999). Affective norms for English words (ANEW): Instruction manual and affective ratings. Retrieved from
    Ekman, P. (1992). An argument for basic emotions. Cognition & emotion, 6(3-4), 169-200.
    Fridlund, A. J., Schwartz, G. E., & Fowler, S. C. (1984). Pattern recognition of self‐reported emotional state from multiple‐site facial EMG activity during affective imagery. Psychophysiology, 21(6), 622-637.
    Frijda, N. H., Kuipers, P., & Ter Schure, E. (1989). Relations among emotion, appraisal, and emotional action readiness. Journal of personality and social psychology, 57(2), 212.
    Fu, Y., Leong, H. V., Ngai, G., & Chan, S. (2016). Non-Intrusive Health-Monitoring Devices. In Encyclopedia of E-Health and Telemedicine (pp. 711-721): IGI Global.
    Garcia-Garcia, J. M., Penichet, V. M., & Lozano, M. D. (2017). Emotion detection: a technology review. Paper presented at the Proceedings of the XVIII international conference on human computer interaction.
    Gatchel, R. J., & Lang, P. J. (1973). Accuracy of psychophysical judgments and physiological response amplitude. Journal of Experimental Psychology, 98(1), 175.
    Greenwald, M. K., Cook, E. W., & Lang, P. J. (1989). Affective judgment and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli. Journal of psychophysiology.
    Lang, P. J. (1969). The mechanics of desensitization and the laboratory study of human fear. Behavior therapy: Appraisal and status. New York: McGraw-Hill, 160-191.
    Lang, P. J. (1995). The emotion probe: studies of motivation and attention. American psychologist, 50(5), 372.
    Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1990). Emotion, attention, and the startle reflex. Psychological review, 97(3), 377.
    Lang, P. J., Bradley, M. M., & Cuthbert, B. N. (1997). International affective picture system (IAPS): Technical manual and affective ratings. NIMH Center for the Study of Emotion and Attention, 1, 39-58.
    Lang, P. J., Bradley, M. M., Fitzsimmons, J. R., Cuthbert, B. N., Scott, J. D., Moulder, B., & Nangia, V. (1998). Emotional arousal and activation of the visual cortex: an fMRI analysis. Psychophysiology, 35(2), 199-210.
    Lang, P. J., Greenwald, M. K., Bradley, M. M., & Hamm, A. O. (1993). Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology, 30(3), 261-273.
    Macht, M. (2008). How emotions affect eating: a five-way model. Appetite, 50(1), 1-11.
    Mehrabian, A., & Russell, J. A. (1974). An approach to environmental psychology: the MIT Press.
    Oeldorf-Hirsch, A., & Sundar, S. S. (2016). Social and technological motivations for online photo sharing. Journal of Broadcasting & Electronic Media, 60(4), 624-642.
    Plutchik, R. (1982). A psychoevolutionary theory of emotions. In: Sage Publications.
    Russell, J. A., Lewicka, M., & Niit, T. (1989). A cross-cultural study of a circumplex model of affect. Journal of personality and social psychology, 57(5), 848.
    Salovey, P., & Mayer, J. D. (1990). Emotional intelligence. Imagination, cognition and personality, 9(3), 185-211.
    Shouse, E. (2005). Feeling, emotion, affect. M/c journal, 8(6), 26.
    Vandekerckhove, M., Weiss, R., Schotte, C., Exadaktylos, V., Haex, B., Verbraecken, J., & Cluydts, R. (2011). The role of presleep negative emotion in sleep physiology. Psychophysiology, 48(12), 1738-1744. doi:10.1111/j.1469-8986.2011.01281.x
    Wall, T., Russell, J., & Moore, N. (2017). Positive emotion in workplace impact. Journal of Work-Applied Management.

    下載圖示
    2026-02-10公開
    QR CODE