簡易檢索 / 詳目顯示

研究生: 戴庭揚
Tai, Ting-Yang
論文名稱: 聽覺音高運動方向對視覺誘發自我運動知覺之調節:以 Shepard–Risset 滑音刺激為例
Auditory Pitch-Motion Direction Modulates Visually Induced Vection: Evidence from Shepard–Risset Glissando Stimuli
指導教授: 黃碧群
Huang, Pi-Chun
學位類別: 碩士
Master
系所名稱: 社會科學院 - 心理學系
Department of Psychology
論文出版年: 2026
畢業學年度: 114
語文別: 英文
論文頁數: 125
中文關鍵詞: 自我運動感Shepard–Risset glissando音高運動方向視聽一致性自我運動知覺
外文關鍵詞: vection, Shepard–Risset glissando, pitch-motion direction, audiovisual congrency, sself-motion perception
相關次數: 點閱:31下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 自我運動感(vection)是指個體在缺乏實際身體位移的情況下,仍主觀感受到自身正在移動的知覺經驗。Shepard–Risset glissando 是一種藉由音高彷彿持續上升或下降,傳遞隱喻性方向資訊的聽覺錯覺。過去研究顯示,聽覺線索可以影響自我運動感,但多數研究主要探討聲源在空間中移動所提供的聽覺運動線索,或具有明確起始與終點的短暫音高變化。相較之下,持續性且不涉及聲源空間位移的音高運動,是否也能提供與自我運動方向相關的資訊,仍有待釐清。本研究探討持續性 Shepard–Risset glissando 所傳遞的升降方向線索,是否會在純聽覺與視聽情境中影響自我運動感。實驗一(32 人)在純聽覺情境中操弄滑音速度(快速、正常、慢速)與音高運動方向(上升、下降);實驗二(42 人)與實驗三(22 人)將上升、下降及白噪音三種聽覺條件,分別搭配向上與向下兩種視覺運動方向。實驗二使用一般螢幕呈現視覺刺激,實驗三則將相同的視聽覺因素組合延伸至頭戴式顯示器(head-mounted display, HMD)情境。由於視覺運動通常誘發反方向的自我運動感,當滑音升降方向與視覺刺激預期誘發的自我運動方向相符時,該配對被定義為「視聽方向一致」。三個實驗皆測量自我運動感的發生率、自我運動感方向、起始時間、持續時間與主觀強度。實驗一顯示,純聽覺情境下,96.4%的Shepard–Risset glissando試次出現自我運動感回報。正常速度條件下的發生率高於慢速條件,但快速條件與正常或慢速條件均無顯著差異。此外,滑音升降方向所誘發的自我運動感發生率並無顯著差異。上升與下降 glissando 分別較常伴隨向上與向下的自我運動感;在方向可明確分類的試次中,上升glissando亦伴隨較長的持續時間與較高的主觀強度。實驗二與實驗三進一步顯示,在視聽情境中,自我運動感的發生主要由視覺運動主導,滑音升降方向與視聽一致性均未穩定改變發生率。然而,聽覺線索仍會調節自我運動感的主觀強度。兩個視聽實驗的主觀強度皆出現聽覺條件與視覺運動方向的交互作用。實驗二中,向下視覺運動搭配上升滑音時的主觀強度高於搭配下降滑音,而向上視覺運動則呈現相反結果。實驗三中,向下視覺運動搭配上升滑音時的主觀強度高於搭配下降滑音時;在向上視覺運動條件下,兩種滑音的主觀強度則無可靠差異。相較之下,起始時間與持續時間未在三個實驗中呈現一致效果。整體而言,持續性 Shepard–Risset glissando 所傳遞的滑音升降方向,在純聽覺情境中與高比例且具有特定方向的自我運動感相關;在視聽情境中,則主要調節由視覺運動所建立之自我運動感的主觀強度與方向特徵,而未穩定改變其發生率。整體而言,持續性 Shepard–Risset glissando 在純聽覺情境中與高比例且具方向性的自我運動感回報相關;在視聽情境中,則較像是在視覺運動所建立的方向框架下,輔助性地調節方向相關回報與主觀強度,而非穩定改變自我運動感的發生率。

    Vection refers to the subjective experience of self-motion in the absence of corresponding physical displacement. Shepard–Risset glissandi are auditory illusions in which pitch appears to rise or fall continuously, thereby conveying metaphoric directional information. Although auditory cues can contribute to vection, previous research has primarily examined spatialized sound-source motion or finite pitch sweeps. It remains unclear whether sustained nonspatial pitch motion can provide directional information for self-motion perception, particularly when visual motion already establishes a strong vection framework. The present study examined whether pitch-motion information conveyed by sustained Shepard–Risset glissandi influenced vection in auditory-only and audiovisual contexts. Experiment 1 (n = 32) manipulated glissando speed (Fast, Normal, and Slow) and pitch-motion direction (Ascending, Descending) in an auditory-only context. Experiments 2 (n = 42) and 3 (n = 22) both paired three auditory conditions—Ascending, Descending, and White Noise—with two visual motion directions (Upward and Downward). Experiment 2 presented the visual stimuli on a monitor, whereas Experiment 3 extended the same audiovisual factorial combination using a head-mounted display (HMD). Because visual motion typically induces vection in the opposite direction, a pairing was defined as audiovisually congruent when pitch-motion direction corresponded to the self-motion direction expected to be induced by the visual stimulus. Across experiments, vection occurrence, reported vection direction, onset time, vection duration, and subjective intensity were assessed. In Experiment 1, vection was reported in 96.4% of the auditory-only Shepard–Risset glissandi trials. Vection occurrence was higher in the Normal than in the Slow condition, whereas the Fast condition did not differ significantly from either condition. Vection occurrence also did not differ significantly between the Ascending and Descending conditions. Ascending and Descending glissandi were more often associated with upward and downward vection, respectively; among trials with clearly classifiable directions, the Ascending condition was also associated with longer vection duration and greater subjective intensity. In the audiovisual contexts of Experiments 2 and 3, vection occurrence was primarily supported by visual motion, and neither pitch-motion direction nor audiovisual congruency consistently altered occurrence. Instead, both audiovisual experiments showed an auditory condition × visual motion direction interaction in subjective intensity. In Experiment 2, subjective intensity was higher for Ascending than Descending glissandi during Downward visual motion, whereas during Upward visual motion, subjective intensity was higher for Descending than Ascending glissandi. In Experiment 3, subjective intensity was higher for Ascending than Descending glissandi during Downward visual motion, whereas subjective intensity did not differ reliably between Ascending and Descending glissandi during Upward visual motion. Effects on onset time and vection duration were not consistent across the three experiments. These findings suggest that sustained nonspatial pitch motion can provide directional information for auditory-only vection, but in audiovisual contexts it functions mainly as a supplementary cue that modulates direction-related reports and subjective intensity within a visually defined self-motion framework.

    摘要 1 ABSTRACT 3 誌謝 5 TABLE OF CONTENTS 7 LIST OF TABLES 10 LIST OF FIGURES 11 1. INTRODUCTION 13 1.1. VECTION AND MULTISENSORY SELF-MOTION PERCEPTION 13 1.2. AUDITORY AND AUDIOVISUAL CONTRIBUTIONS TO VECTION 15 1.3. PITCH–ELEVATION CORRESPONDENCE AND DYNAMIC PITCH MOTION 18 1.4. PITCH-MOTION DIRECTION AND VISUALLY INDUCED VECTION 20 1.5. SHEPARD–RISSET GLISSANDI AND AUDITORY VECTION 21 1.6. VISUAL DISPLAY CONTEXT AND VECTION 24 1.7. RESEARCH GAPS AND THE PRESENT STUDY 25 2. EXPERIMENT 1 27 2.1. METHOD 27 2.1.1. Participants 27 2.1.2. Equipment 27 2.1.3. Stimuli 27 2.1.4. Procedure 30 2.1.5. Data Analysis 31 2.2. RESULTS 34 2.2.1. Vection Occurrence 34 2.2.2. Expected Reported Vection Direction 37 2.2.3. Continuous Measures for Expected-Direction Trials 39 3. EXPERIMENT 2 41 3.1. PARTICIPANTS 41 3.2. EQUIPMENT 41 3.3. STIMULI 42 3.4. PROCEDURE 42 3.5. DATA ANALYSIS 43 3.5.1. Statistical Design and Analysis 43 3.5.2. Data Pre-processing and Exclusion 44 3.5.3. Statistical Analysis Strategy 45 3.6. RESULTS 45 3.6.1. Vection Occurrence 45 3.6.2. Expected Reported Vection Direction 49 3.6.3. Direction-Specific Onset Time 53 3.6.4. Direction-Specific Vection Duration 55 4. EXPERIMENT 3 57 4.1. PARTICIPANTS 57 4.2. EQUIPMENT 57 4.3. STIMULI 57 4.4. PROCEDURE 58 4.5. DATA ANALYSIS 58 4.5.1. Statistical Design and Analysis 58 4.5.2. Data Pre-processing and Exclusion 59 4.6. RESULT 59 4.6.1. Vection Occurrence 59 4.6.2. Expected Reported Vection Direction 62 4.6.3. Subjective Intensity 65 4.6.4. Direction-Specific Onset Time 67 4.6.5. Direction-Specific Vection Duration 69 5. DISCUSSION 72 5.1. AUDITORY-ONLY VECTION IN EXPERIMENT 1 73 5.2. CONTINUOUS VECTION MEASURES IN EXPERIMENT 1 74 5.3. VISUAL MOTION AND REPORTED VECTION DIRECTION 75 5.4. AUDIOVISUAL VECTION OCCURRENCE IN EXPERIMENTS 2 AND 3 75 5.5. SUBJECTIVE INTENSITY IN EXPERIMENTS 2 AND 3 76 5.6. ONSET TIME AND VECTION DURATION IN EXPERIMENTS 2 AND 3 77 5.7. LIMITATIONS AND METHODOLOGICAL CONSIDERATIONS 78 5.8. FUTURE DIRECTIONS AND CONCLUSION 79 6. REFERENCES 81 7. APPENDICES 88 APPENDIX A: FULL CONTINUOUS-MEASURE ANALYSES OF ALL VECTION-OCCURRENCE TRIALS 88 Experiment 1 88 Experiment 2 90 Experiment 3 94 APPENDIX B: DIRECTION-SPECIFIC UPWARD–DOWNWARD CONTINUOUS-MEASURE ANALYSES 101 Experiment 1 101 Experiment 2 103 Experiment 3 107 APPENDIX C: EXPLORATORY COGNITIVE-STYLE ANALYSES 111 CRAF Procedure and Group Classification 111 Analytic Approach 112 Experiment 1 112 Experiment 2 114 Experiment 3 118

    Bagust, J. (2005). Assessment of verticality perception by a rod-and-frame test: Preliminary observations on the use of a computer monitor and video eye glasses. Archives of Physical Medicine and Rehabilitation, 86(5), 1062–1064. https://doi.org/10.1016/j.apmr.2004.05.022
    Brainard, D. H. (1997). The Psychophysics Toolbox. Spatial Vision, 10(4), 433–436. https://doi.org/10.1163/156856897X00357
    Brandt, T., Dichgans, J., & Koenig, E. (1973). Differential effects of central versus peripheral vision on egocentric and exocentric motion perception. Experimental Brain Research, 16(5), 476–491. https://doi.org/10.1007/BF00234474
    Delle Monache, S., La Scaleia, B., Finazzi Agrò, A., Lacquaniti, F., & Zago, M. (2025). Psychophysical evidence for an internal model of gravity in the visual and vestibular estimates of vertical motion duration. Scientific Reports, 15, 10394. https://doi.org/10.1038/s41598-025-94512-1
    Dichgans, J., & Brandt, T. (1978). Visual-vestibular interaction: Effects on self-motion perception and postural control. In R. Held, H. W. Leibowitz, & H.-L. Teuber (Eds.), Handbook of sensory physiology: Vol. 8. Perception (pp. 755–804). Springer. https://doi.org/10.1007/978-3-642-46354-9_25
    Docherty, S., & Bagust, J. (2010). From line to dots: An improved computerised rod and frame system for testing subjective visual vertical and horizontal. BMC Research Notes, 3, Article 9. https://doi.org/10.1186/1756-0500-3-9
    Keshavarz, B., & Berti, S. (2014). Integration of sensory information precedes the sensation of vection: A combined behavioral and event-related brain potential (ERP) study. Behavioural Brain Research, 259, 131–136. https://doi.org/10.1016/j.bbr.2013.10.045
    Keshavarz, B., Hettinger, L. J., Vena, D., & Campos, J. L. (2014). Combined effects of auditory and visual cues on the perception of vection. Experimental Brain Research, 232(3), 827–836. https://doi.org/10.1007/s00221-013-3793-9
    Keshavarz, B., Speck, M., Haycock, B., & Berti, S. (2017). Effect of different display types on vection and its interaction with motion direction and field dependence. i-Perception, 8(3), Article 2041669517707768. https://doi.org/10.1177/2041669517707768
    Kleiner, M., Brainard, D. H., & Pelli, D. G. (2007). What’s new in Psychtoolbox-3? Perception, 36(ECVP Abstract Supplement), 14.
    Kirollos, R., & Herdman, C. M. (2023). Caloric vestibular stimulation induces vestibular circular vection even with a conflicting visual display presented in a virtual reality headset. i-Perception, 14(2), 1–19. https://doi.org/10.1177/20416695231168093
    Kooijman, L., Berti, S., Asadi, H., Nahavandi, S., & Keshavarz, B. (2024). Measuring vection: A review and critical evaluation of different methods for quantifying illusory self-motion. Behavior Research Methods, 56(3), 2292–2310. https://doi.org/10.3758/s13428-023-02148-8
    Lackner, J. R. (1977). Induction of illusory self-rotation and nystagmus by a rotating sound-field. Aviation, Space, and Environmental Medicine, 48(2), 129–131.
    Lappe, M., Bremmer, F., & van den Berg, A. V. (1999). Perception of self-motion from visual flow. Trends in Cognitive Sciences, 3(9), 329–336. https://doi.org/10.1016/S1364-6613(99)01364-9
    Larsson, P., Västfjäll, D., & Kleiner, M. (2004). Perception of self-motion and presence in auditory virtual environments. In M. Alcañiz Raya & B. Rey Solaz (Eds.), Proceedings of the seventh annual international workshop PRESENCE 2004 (pp. 252–258). Editorial UPV. https://matthewlombard.com/ISPR/Proceedings/2004/Larsson%2C%20Vastfjall%2C%20Kleiner.pdf
    Maeda, F., Kanai, R., & Shimojo, S. (2004). Changing pitch induced visual motion illusion. Current Biology, 14(23), R990–R991. https://doi.org/10.1016/j.cub.2004.11.018
    McCormick, K., Lacey, S., Stilla, R., Nygaard, L. C., & Sathian, K. (2018). Neural basis of the crossmodal correspondence between auditory pitch and visuospatial elevation. Neuropsychologia, 112, 19–30. https://doi.org/10.1016/j.neuropsychologia.2018.02.029
    Mursic, R. A., & Palmisano, S. (2020). The Shepard–Risset glissando: Identifying the origins of metaphorical auditory vection and motion sickness. Multisensory Research, 33(1), 61–86. https://doi.org/10.1163/22134808-20191450
    Mursic, R. A., Riecke, B. E., Apthorp, D., & Palmisano, S. (2017). The Shepard–Risset glissando: Music that moves you. Experimental Brain Research, 235(10), 3111–3127. https://doi.org/10.1007/s00221-017-5033-1
    Palmisano, S., Allison, R. S., Schira, M. M., & Barry, R. J. (2015). Future challenges for vection research: Definitions, functional significance, measures, and neural bases. Frontiers in Psychology, 6, Article 193. https://doi.org/10.3389/fpsyg.2015.00193
    Parkinson, C., Kohler, P. J., Sievers, B., & Wheatley, T. (2012). Associations between auditory pitch and visual elevation do not depend on language: Evidence from a remote population. Perception, 41(7), 854–861. https://doi.org/10.1068/p7225
    Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10(4), 437–442. https://doi.org/10.1163/156856897X00366
    Repasky, D. (2013, November 14). 10 hours of infinite fractal and falling Shepard’s tone [Video]. YouTube. https://www.youtube.com/watch?v=u9VMfdG873E
    Riecke, B. E., & Jordan, J. D. (2015). Comparing the effectiveness of different displays in enhancing illusions of self-movement (vection). Frontiers in Psychology, 6, Article 713. https://doi.org/10.3389/fpsyg.2015.00713
    Riecke, B. E., Schulte-Pelkum, J., Caniard, F., & Bülthoff, H. H. (2005). Influence of auditory cues on the visually-induced self-motion illusion (circular vection) in virtual reality. In M. Slater (Ed.), PRESENCE 2005: The 8th international workshop on presence: Conference proceedings (pp. 49–57). University College London. https://hdl.handle.net/11858/00-001M-0000-0013-D43B-4
    Riecke, B. E., Väljamäe, A., & Schulte-Pelkum, J. (2009). Moving sounds enhance the visually-induced self-motion illusion (circular vection) in virtual reality. ACM Transactions on Applied Perception, 6(2), Article 7. https://doi.org/10.1145/1498700.1498701
    Sadaghiani, S., Maier, J. X., & Noppeney, U. (2009). Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing. The Journal of Neuroscience, 29(20), 6490–6499. https://doi.org/10.1523/JNEUROSCI.5437-08.2009
    Seno, T., Hasuo, E., Ito, H., & Nakajima, Y. (2012). Perceptually plausible sounds facilitate visually induced self-motion perception (vection). Perception, 41(5), 577–593. https://doi.org/10.1068/p7184
    Väljamäe, A. (2009). Auditorily-induced illusory self-motion: A review. Brain Research Reviews, 61(2), 240–255. https://doi.org/10.1016/j.brainresrev.2009.07.001
    Väljamäe, A., Larsson, P., Västfjäll, D., & Kleiner, M. (2005). Travelling without moving: Auditory scene cues for translational self-motion. In Proceedings of ICAD 05—Eleventh Meeting of the International Conference on Auditory Display (pp. 9–16). http://hdl.handle.net/1853/50193
    Väljamäe, A., & Sell, S. (2014). The influence of imagery vividness on cognitive and perceptual cues in circular auditorily-induced vection. Frontiers in Psychology, 5, 1362. https://doi.org/10.3389/fpsyg.2014.01362
    Witkin, H. A., & Asch, S. E. (1948). Studies in space orientation: IV. Further experiments on perception of the upright with displaced visual fields. Journal of Experimental Psychology, 38(6), 762–782. https://doi.org/10.1037/h0053671
    Wright, W. G., DiZio, P., & Lackner, J. R. (2006). Perceived self-motion in two visual contexts: Dissociable mechanisms underlie perception. Journal of Vestibular Research, 16(1–2), 23–28. https://doi.org/10.3233/VES-2006-161-202

    下載圖示
    校外:立即公開
    QR CODE