簡易檢索 / 詳目顯示

研究生: 王潔心
Wang, Chieh-Hsin
論文名稱: 觀影時跨腦相似性與個體內模組化之探討——以自然情境神經影像資料庫為例
Testing the 'inter-brain similarity' versus 'intra-subject modularity' during movie-watching with a naturalistic neuroimaging database.
指導教授: 龔俊嘉
Kung, Chun-Chia
學位類別: 碩士
Master
系所名稱: 社會科學院 - 心理學系
Department of Psychology
論文出版年: 2025
畢業學年度: 113
語文別: 英文
論文頁數: 65
中文關鍵詞: 神經電影學 、跨受試者相似性 、大腦模組化 、開放神經科學
外文關鍵詞: neurocinematics, inter-subject similarity, brain modularity, open neuroscience
相關次數: 點閱:150  下載:0 
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 「神經電影學(neurocinematics)」結合了功能性磁振造影(functional magnetic resonance imaging, fMRI)與電影研究,自 2008 年提出以來,提供了新的視角來解析電影內容與觀影體驗的神經基礎,並促進以動態、自然情境之刺激(naturalistic stimuli)探討跨個體的大腦同步性與大腦網路模組化的研究。另一方面,隨著「開放神經科學(open neuroscience)」的興起,資料的重複使用與再分析成為可能,可提升研究的可驗證性與可信賴度。本研究是結合上述兩點,利用一組開放的神經影像資料集(每部電影受試者數 6 至 20 人),以 Yeo 等人(2011)的 17個大腦功能網路為基礎,檢驗跨受試者相似性(inter-subject similarity, ISS)與受試者內模組性(intra-subject modularity, Q)的動態關係。結果顯示,在完整電影的層次上,並未觀察到 Betzel 等人(2020)所提出「高 ISS 伴隨模組化下降與跨系統整合增加,而低 ISS 則對應較高的分化(segregation)與近似靜息態的網路結構」;相反地,我們發現整體ISS 與 Q 呈現正相關,當跨受試者的腦反應更同步時,個體內的模組化程度亦隨之提升。即便在極端條件下(最高與最低 3 個 ISS 時段),亦未重現 Betzel 等人提出之假說。當電影被切割為較短片段時,每部片僅在少數時段觀察到與 Betzel 一致的現象。並且,在具高度辨識的經典電影場景,ISS 與 Q 並未穩定地呈現反向關係,顯示即便觀眾在注意力上高度同步,個體間的大腦處理策略仍展現差異與認知複雜性。本研究的貢獻在於將 Betzel 等人以短片段驗證的 ISS–Q 框架延伸至完整電影,並發現其結果並非完全適用。透過使用開放資料,本研究不僅檢驗了既有假設的再現性,也拓展了其適用性,凸顯自然情境刺激在理解人類大腦動態網路組織中的重要性。

    Neurocinematics, the integration of functional magnetic resonance imaging (fMRI) with film studies, provides a powerful framework for investigating the neural basis of cinematic experience under naturalistic conditions. While prior work has linked inter-subject similarity (ISS) to shifts in brain modularity, Betzel et al. (2020) suggested that high ISS coincides with reduced modularity and increased integration across networks. In this study, we re-examined this relationship using an open fMRI dataset (6–20 participants per film) and the 17 functional networks defined by Yeo et al. (2011). Across ten full-length films, we consistently observed a positive correlation between ISS and intra-subject modularity (Q): stronger neural synchronization across viewers was accompanied by higher modular organization within individuals. Even under extreme ISS conditions, Betzel’s inverse relationship did not replicate. When films were divided into shorter segments, the predicted inverse ISS–Q pattern emerged only in isolated periods. Moreover, iconic film scenes eliciting strong attentional alignment did not reliably produce an inverse relationship, suggesting that synchronized attention does not necessarily translate into uniform network integration strategies. By extending the ISS–Q framework from short clips to full-length films, this study demonstrates its limited generalizability and underscores the complexity of neural dynamics during naturalistic viewing. Leveraging open data, we highlight both the reproducibility challenges of existing models and the importance of naturalistic stimuli for advancing our understanding of dynamic brain network organization.

    摘要 i Abstract ii 1. Introduction 1 2. Literature Review 4 2.1 Brain Modularity 4 2.2 Inter-Subject Similarity (ISS) 8 2.3 Relationship Between ISS and Modularity 10 2.4 Extending the ISS–Modularity Framework to Full-Length Movies 12 3. Methods and Materials 13 3.1 Dataset and Participants 14 3.2 Preprocessing 14 3.3 Time-varying Functional Connectivity 15 3.4 Intersubject Similarity (ISS) Computation 15 3.5 Modularity Q Calculation 16 3.6 Statistical Analysis 17 4. Results 20 4.1 ISS and Modularity Pearson Correlations Across Movies 20 4.2 Extreme ISS Conditions and Corresponding Modularity 20 4.3 ISS–Q Directional Consistency: Quadrant-Based Analysis 21 4.4 Sliding Window Sizes 21 4.5 Segments Analysis 22 5. Discussion 35 5.1 Revisiting the ISS–Modularity Relationship 36 5.2 Sliding Window Size analysis 39 5.3 Event Boundaries and ISS-Modularity Reorganization 40 5.4 Narrative Salience ≠ Cognitive Synchronization 41 5.5 Limitations and Future Directions 42 6. Conclusion 44 References 45 Appendix 52

    Aliko, S., Huang, J., Gheorghiu, F., Meliss, S., & Skipper, J. I. (2020). A naturalistic neuroimaging database for understanding the brain using ecological stimuli. Scientific Data, 7(1), 347. https://www.nature.com/articles/s41597-020-00680-2
    Allen, E. A., Damaraju, E., Plis, S. M., Erhardt, E. B., Eichele, T., & Calhoun, V. D. (2014). Tracking whole-brain connectivity dynamics in the resting state. Cerebral Cortex, 24(3), 663–676. https://doi.org/10.1093/cercor/bhs352
    Ariely, D., & Berns, G. S. (2010). Neuromarketing: The hope and hype of neuroimaging in business. Nature Reviews Neuroscience, 11(4), 284–292. https://doi.org/10.1038/nrn2795
Bartels, A., & Zeki, S. (2004). Functional brain mapping during free viewing of natural scenes. Human Brain Mapping, 21(2), 75–85. https://doi.org/10.1002/hbm.10160
    Bertolero, M. A., Yeo, B. T. T., & D’Esposito, M. (2015). The modular and integrative functional architecture of the human brain. Proceedings of the National Academy of Sciences of the United States of America, 112(49), E6798–E6807. https://doi.org/10.1073/pnas.1510619112
    Betzel, R. F., Cutts, S. A., Greenwell, S., & Sporns, O. (2020). Individualized event structure drives individual differences in whole-brain functional connectivity. Nature Communications, 11, 5204. https://doi.org/10.1038/s41467-020-18952-9
    Camerer, C. F., Loewenstein, G., & Prelec, D. (2005). Neuroeconomics: How neuroscience can inform economics. Journal of Economic Literature, 43(1), 9–64. https://doi.org/10.1257/0022051053737843
    Chang, C., & Glover, G. H. (2010). Time–frequency dynamics of resting-state brain connectivity measured with fMRI. NeuroImage, 50(1), 81–98. https://doi.org/10.1016/j.neuroimage.2009.12.011
    Chen, J., Leong, Y. C., Norman, K. A., Hasson, U., & Honey, C. J. (2017). Shared memories reveal shared structure in neural activity across individuals. Nature Neuroscience, 20(1), 115–125. https://doi.org/10.1038/nn.4450
    Cohen, J. R., & D’Esposito, M. (2016). The segregation and integration of distinct brain networks and their relationship to cognition. The Journal of Neuroscience, 36(48), 12083–12094. https://doi.org/10.1523/JNEUROSCI.2965-15.2016
    Cox, R. W. (1996). AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages. Computers and Biomedical Research, 29(3), 162–173. https://doi.org/10.1006/cbmr.1996.0014
    Finn, E. S., Glerean, E., Khojandi, A. Y., Nielson, D., Molfese, P. J., Handwerker, D. A., & Bandettini, P. A. (2018). Idiosynchrony: From shared responses to individual differences during naturalistic neuroimaging. NeuroImage, 183, 513–529. https://doi.org/10.1016/j.neuroimage.2018.08.013
    Friston, K. J., Holmes, A. P., Worsley, K. J., Poline, J. P., Frith, C. D., & Frackowiak, R. S. J. (1994). Statistical parametric maps in functional imaging: A general linear approach. Human Brain Mapping, 2(4), 189–210. https://doi.org/10.1002/hbm.460020402
    Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004). Intersubject synchronization of cortical activity during natural vision. Science, 303(5664), 1634–1640. https://doi.org/10.1126/science.1089506
    Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., & Heeger, D. J. (2008). Neurocinematics: The neuroscience of film. Projections, 2(1), 1–26. https://doi.org/10.3167/proj.2008.020102
    Hutchison, R. M., Womelsdorf, T., Allen, E. A., Bandettini, P. A., Calhoun, V. D., Corbetta, M., ... & Chang, C. (2013). Dynamic functional connectivity: Promise, issues, and interpretations. NeuroImage, 80, 360–378. https://doi.org/10.1016/j.neuroimage.2013.05.079
    Illes, J., & Bird, S. J. (2006). Neuroethics: A modern context for ethics in neuroscience. Trends in Neurosciences, 29(9), 511–517. https://doi.org/10.1016/j.tins.2006.07.002
    Kwong, K. K., Belliveau, J. W., Chesler, D. A., Goldberg, I. E., Weisskoff, R. M., Poncelet, B. P., Kennedy, D. N., Hoppel, B. E., Cohen, M. S., Turner, R., Cheng, H. M., Brady, T. J., & Rosen, B. R. (1992). Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. Proceedings of the National Academy of Sciences, 89(12), 5675–5679. https://doi.org/10.1073/pnas.89.12.5675
    Leonardi, N., & Van De Ville, D. (2015). On spurious and real fluctuations of dynamic functional connectivity during rest. NeuroImage, 104, 430–436. https://doi.org/10.1016/j.neuroimage.2014.09.007
    Meunier, D., Lambiotte, R., & Bullmore, E. T. (2010). Modular and hierarchically modular organization of brain networks. Frontiers in Neuroscience, 4, 200. https://doi.org/10.3389/fnins.2010.00200
    Nastase, S. A., Goldstein, A., & Hasson, U. (2020). Keep it real: Rethinking the primacy of experimental control in cognitive neuroscience. NeuroImage, 222, 117254. https://doi.org/10.1016/j.neuroimage.2020.117254
    Newman, M. E. J. (2006). Modularity and community structure in networks. Proceedings of the National Academy of Sciences, 103(23), 8577–8582. https://doi.org/10.1073/pnas.0601602103
    Newman, M. E. J., & Girvan, M. (2004). Finding and evaluating community structure in networks. Physical Review E, 69(2), 026113. https://doi.org/10.1103/PhysRevE.69.026113
    Nummenmaa, L., Glerean, E., Viinikainen, M., Jääskeläinen, I. P., Hari, R., & Sams, M. (2012). Emotions promote social interaction by synchronizing brain activity across individuals. Proceedings of the National Academy of Sciences, 109(24), 9599–9604. https://doi.org/10.1073/pnas.1206095109
    Ogawa, S., Tank, D. W., Menon, R., Ellermann, J. M., Kim, S. G., Merkle, H., & Ugurbil, K. (1992). Intrinsic signal changes accompanying sensory stimulation: Functional brain mapping with magnetic resonance imaging. Proceedings of the National Academy of Sciences of the United States of America, 89(13), 5951–5955. https://doi.org/10.1073/pnas.89.13.5951
    Preti, M. G., Bolton, T. A. W., & Van De Ville, D. (2017). The dynamic functional connectome: State-of-the-art and perspectives. NeuroImage, 160, 41–54. https://doi.org/10.1016/j.neuroimage.2016.12.061
    Rubinov, M., & Sporns, O. (2010). Complex network measures of brain connectivity: Uses and interpretations. NeuroImage, 52(3), 1059–1069. https://doi.org/10.1016/j.neuroimage.2009.10.003
    Shine, J. M. (2019). Human cognition involves the dynamic integration of neural activity and neuromodulatory systems. Nature Neuroscience, 22(2), 289–296. https://doi.org/10.1038/s41593-018-0312-0
    Simon, H. A. (1962). The architecture of complexity. Proceedings of the American Philosophical Society, 106(6), 467–482. https://www.jstor.org/stable/985254
    Simony, E., Honey, C. J., Chen, J., Lositsky, O., Yeshurun, Y., Wiesel, A., & Hasson, U. (2016). Dynamic reconfiguration of the default mode network during narrative comprehension. Nature Communications, 7, 12141. https://doi.org/10.1038/ncomms12141
    Sonkusare, S., Breakspear, M., & Guo, C. (2019). Naturalistic stimuli in neuroscience: Critically acclaimed. Trends in Cognitive Sciences, 23(8), 699–714. https://doi.org/10.1016/j.tics.2019.05.004
    Sporns, O. (2013). Network attributes for segregation and integration in the human brain. Current Opinion in Neurobiology, 23(2), 162–171. https://doi.org/10.1016/j.conb.2012.11.015
    Sporns, O. (2013). Structure and function of complex brain networks. Dialogues in Clinical Neuroscience, 15(3), 247–262. https://doi.org/10.31887/DCNS.2013.15.3/osporns
    Sporns, O., & Betzel, R. F. (2016). Modular brain networks. Annual Review of Psychology, 67, 613–640. https://doi.org/10.1146/annurev-psych-122414-033634
    Tononi, G., Sporns, O., & Edelman, G. M. (1994). A measure for brain complexity: Relating functional segregation and integration in the nervous system. Proceedings of the National Academy of Sciences, 91(11), 5033–5037. https://doi.org/10.1073/pnas.91.11.5033
    Vanderwal, T., Kelly, C., Eilbott, J., Mayes, L. C., & Castellanos, F. X. (2015). Inscapes: A movie paradigm to improve compliance in functional magnetic resonance imaging. NeuroImage, 122, 222–232. https://doi.org/10.1016/j.neuroimage.2015.07.069
    Vogler, C. (2007). The writer’s journey: Mythic structure for writers.
    Wig, G. S., Schlaggar, B. L., & Petersen, S. E. (2011). Concepts and principles in the analysis of brain networks. Annals of the New York Academy of Sciences, 1224(1), 126–146. https://doi.org/10.1111/j.1749-6632.2010.05882.x
    Yeo, B. T. T., Krienen, F. M., Sepulcre, J., Sabuncu, M. R., Lashkari, D., Hollinshead, M., ... & Buckner, R. L. (2011). The organization of the human cerebral cortex estimated by intrinsic functional connectivity. Journal of Neurophysiology, 106(3), 1125–1165. https://doi.org/10.1152/jn.00338.2011
    Zacks, J. M., Speer, N. K., Swallow, K. M., Braver, T. S., & Reynolds, J. R. (2007). Event perception: A mind-brain perspective. Psychological Bulletin, 133(2), 273–293. https://doi.org/10.1037/0033-2909.133.2.273
    Zalesky, A., Fornito, A., & Bullmore, E. T. (2010). Whole-brain anatomical networks: Does the choice of nodes matter? NeuroImage, 50(3), 970–983. https://doi.org/10.1016/j.neuroimage.2009.12.027

    下載圖示
    2026-08-31公開
    QR CODE