| 研究生: |
葉俊邑 Yeh, Chun-Yi |
|---|---|
| 論文名稱: |
快閃式記憶體類神經網路SPICE模型開發與變異探討 SPICE Modeling for Flash Memory in Neural Networks and Variation Study |
| 指導教授: |
江孟學
Chiang, Meng-Hsueh |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 奈米積體電路工程碩士博士學位學程 MS Degree/Ph.D. Program on Nano-Integrated-Circuit Engineering |
| 論文出版年: | 2023 |
| 畢業學年度: | 111 |
| 語文別: | 英文 |
| 論文頁數: | 64 |
| 中文關鍵詞: | 快閃式記憶體 、精簡模型 、類神經網路 、Verilog-A 、HSPICE |
| 外文關鍵詞: | Flash, Compact Model, Neural Network, Verilog-A, HSPICE |
| 相關次數: | 點閱:208 下載:1 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
隨著目前人工智慧以及物聯網的蓬勃發展下,馮紐曼架構無法有效的處以大量的數據,為了解決馮紐曼架構所帶來的瓶頸,記憶體內運算被視為打破此瓶頸的一大技術,快閃式記憶體為目前被廣泛討論的類神經網路的元件,具有成熟的製程技術、高位元密度及優秀的耐久度等優點,對於神經網路辨識很高的準確率。
在本篇論文中,我們利用Verilog-A建立快閃式記憶體(Flash)模型,並以電路模擬軟體(HSPICE)測試電性,在快閃式記憶體操作中藉由給定不同電壓的脈衝波,使內部的浮柵存取電子,改變元件的閾值電壓高低。模型提供了不同多階操作功能。並且我們探討不同變異所造成的閾值電壓改變,提供各種變異在快閃式記憶體所造成的影響。此模型也提供模擬類比仿生網路的操作模式,並使用類比非揮發性記憶體電路平台,進行不同權重的訓練,達成手寫辨識的能力,最後展示不同脈衝波大小對於準確率的影響。
With the flourishing development of Artificial Intelligence and the Internet of Things, the Von-Neumann architecture cannot handle large amounts of data efficiently. In order to solve the bottleneck of the Von-Neumann architecture, Computing In Memory (CIM) is regarded as a powerful technology to break this bottleneck. Flash memory is a widely discussed analog neural network device with mature process technology, high bit density, and excellent endurance. The accuracy in neural network recognition is very high.
In this thesis, we developed a compact model of flash memory with physical characteristics using Verilog-A and obtained electrical characteristics through HSPICE simulations. In flash memory operation, the threshold voltage level of the device is changed by giving different voltages pulse to trap the electrons in the internal floating gate. The model provides different multilevel operation functions. Moreover, we investigate the effect of different kinds of variations on flash memory due to threshold voltage changes. The model also offers simulations for analog neural network operation patterns by using an analog nonvolatile memory circuit platform to train different weights to achieve handwriting recognition capability. Finally, we show the effect of different pulse sizes on the accuracy.
[1] 洪瑋辰, "類比非揮發記憶體仿生電路之深度學習模擬平台," 碩士, 微電子工程研究所, 國立成功大學, 台南市, 2019. [Online]. Available: https://hdl.handle.net/11296/hwes23
[2] G. E. Moore, "Cramming More Components Onto Integrated Circuits," Proceedings of the IEEE, vol. 86, no. 1, pp. 82-85, 1998, doi: 10.1109/JPROC.1998.658762.
[3] H. Li et al., "A learnable parallel processing architecture towards unity of memory and computing," Scientific Reports, vol. 5, no. 1, p. 13330, 2015/08/14 2015, doi: 10.1038/srep13330.
[4] J. del Valle, J. G. Ramírez, M. J. Rozenberg, and I. K. Schuller, "Challenges in materials and devices for resistive-switching-based neuromorphic computing," Journal of Applied Physics, vol. 124, no. 21, p. 211101, 2018, doi: 10.1063/1.5047800.
[5] G. Gildenblat et al., "PSP: An Advanced Surface-Potential-Based MOSFET Model for Circuit Simulation," IEEE Transactions on Electron Devices, vol. 53, no. 9, pp. 1979-1993, 2006, doi: 10.1109/TED.2005.881006.
[6] Nonvolatile Memory Technologies with Emphasis on Flash: A Comprehensive Guide to Understanding and Using NVM Devices (NONVOLATILE MEMORY TECHNOLOGIES WITH EMPHASIS ON FLASH: A COMPREHENSIVE GUIDE TO UNDERSTANDING AND USING NVM DEVICES). (in English), 2008, pp. 1-759.
[7] D. Garetto, "Numerical and Compact Modeling of Embedded Flash Memory Devices Targeted for IC Design," EPFL. [Online]. Available: https://infoscience.epfl.ch/record/170285/files/EPFL_TH5274.pdf
[8] M. Lenzlinger and E. H. Snow, "Fowler-Nordheim tunneling into thermally grown SiO2," IEEE Transactions on Electron Devices, vol. 15, no. 9, pp. 686-686, 1968, doi: 10.1109/T-ED.1968.16430.
[9] A. Maure, P. Canet, F. Lalande, B. Delsuc, and J. Devin, "Flash Memory Cell Compact Modeling Using PSP Model," in 2008 IEEE International Behavioral Modeling and Simulation Workshop, 25-26 Sept. 2008 2008, pp. 45-49, doi: 10.1109/BMAS.2008.4751238.
[10] E. Kheirkhahi, "Contact effects in Pentacene Field Effect Transistors," Ph.D., Northeastern University, United States -- Massachusetts, 3722045, 2015. [Online]. Available: https://www.proquest.com/dissertations-theses/contact-effects-pentacene-field-effect/docview/1728125205/se-2?accountid=12719
http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3722045
http://sfx.lib.ncku.edu.tw:3410/sfxlcl41?url_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:dissertation&genre=dissertations&sid=ProQ:ProQuest+Dissertations+%26+Theses+A%26I&atitle=&title=Contact+effects+in+Pentacene+Field+Effect+Transistors&issn=&date=2015-01-01&volume=&issue=&spage=&au=Kheirkhahi%2C+Erfan&isbn=978-1-339-03946-6&jtitle=&btitle=&rft_id=info:eric/&rft_id=info:doi/
[11] D. B. William and B. Joe, "Basics of Nonvolatile Semiconductor Memory Devices," in Nonvolatile Semiconductor Memory Technology: A Comprehensive Guide to Understanding and Using NVSM Devices: IEEE, 1998, pp. 1-88.
[12] A. L. Shimpi. "The Intel SSD 710 (200GB) Review." (accessed September 30, 2011).
[13] K. Takeuchi, T. Tanaka, and T. Tanzawa, "A multipage cell architecture for high-speed programming multilevel NAND flash memories," IEEE Journal of Solid-State Circuits, vol. 33, no. 8, pp. 1228-1238, 1998, doi: 10.1109/4.705361.
[14] R. Bez, E. Camerlenghi, A. Modelli, and A. Visconti, "Introduction to flash memory," Proceedings of the IEEE, vol. 91, no. 4, pp. 489-502, 2003, doi: 10.1109/JPROC.2003.811702.
[15] P. Pavan, R. Bez, P. Olivo, and E. Zanoni, "Flash memory cells-an overview," Proceedings of the IEEE, vol. 85, no. 8, pp. 1248-1271, 1997, doi: 10.1109/5.622505.
[16] S. Selberherr, "MOS device modeling at 77 K," IEEE Transactions on Electron Devices, vol. 36, no. 8, pp. 1464-1474, 1989, doi: 10.1109/16.30960.
[17] M. S. Lundstrom, "On the mobility versus drain current relation for a nanoscale MOSFET," IEEE Electron Device Letters, vol. 22, no. 6, pp. 293-295, 2001, doi: 10.1109/55.924846.
[18] D. Esseni and E. Sangiorgi, "Low field electron mobility in ultra-thin SOI MOSFETs: experimental characterization and theoretical investigation," Solid-State Electronics, vol. 48, no. 6, pp. 927-936, 2004/06/01/ 2004, doi: https://doi.org/10.1016/j.sse.2003.12.027.
[19] Z. Sun et al., "Flash-based in-memory computing for stochastic computing in image edge detection," Journal of Semiconductors, vol. 44, no. 5, p. 054101, 2023/05/01 2023, doi: 10.1088/1674-4926/44/5/054101.
[20] -. N. Mendiratta and -. S. L. Tripathi, "- A review on performance comparison of advanced MOSFET structures below 45 nm technology node," - Journal of Semiconductors, vol. - 41, no. - 6, pp. - 061401, - 2019-11-04 2020, doi: - 10.1088/1674-4926/41/6/061401.
[21] C. Zambelli, L. Crippa, R. Micheloni, and P. Olivo, "Cross-Temperature Effects of Program and Read Operations in 2D and 3D NAND Flash Memories," in 2018 International Integrated Reliability Workshop (IIRW), 7-11 Oct. 2018 2018, pp. 1-4, doi: 10.1109/IIRW.2018.8727102.
[22] A. Bravaix, C. Guerin, V. Huard, D. Roy, J. M. Roux, and E. Vincent, "Hot-Carrier acceleration factors for low power management in DC-AC stressed 40nm NMOS node at high temperature," in 2009 IEEE International Reliability Physics Symposium, 26-30 April 2009 2009, pp. 531-548, doi: 10.1109/IRPS.2009.5173308.
[23] G. Malavena, S. Petrò, A. S. Spinelli, and C. M. Compagnoni, "Impact of Program Accuracy and Random Telegraph Noise on the Performance of a NOR Flash-based Neuromorphic Classifier," in ESSDERC 2019 - 49th European Solid-State Device Research Conference (ESSDERC), 23-26 Sept. 2019 2019, pp. 122-125, doi: 10.1109/ESSDERC.2019.8901751.
[24] H.-T. Lue, K.-C. Wang, and C.-Y. Lu, "Introduction of 3D AND-type Flash Memory and It’s Applications to Computing-in-Memory (CIM)," 2021 International Symposium on VLSI Technology, Systems and Applications (VLSI-TSA), pp. 1-2, 2021.
[25] Y. Feng et al., "A Novel Array Programming Scheme for Large Matrix Processing in Flash-Based Computing-in-Memory (CIM) With Ultrahigh Bit Density," IEEE Transactions on Electron Devices, vol. 70, no. 2, pp. 461-467, 2023, doi: 10.1109/TED.2022.3227529.
[26] L. Gao et al., "Fully parallel write/read in resistive synaptic array for accelerating on-chip learning," Nanotechnology, vol. 26, no. 45, p. 455204, 2015/10/22 2015, doi: 10.1088/0957-4484/26/45/455204.
[27] 許竣翔, "電阻式記憶體類神經網路應用之模型開發," 碩士, 奈米積體電路工程碩士學位學程, 國立成功大學, 台南市, 2020. [Online]. Available: https://hdl.handle.net/11296/ahyr2h
[28] M. Jerry et al., "Ferroelectric FET analog synapse for acceleration of deep neural network training," in 2017 IEEE International Electron Devices Meeting (IEDM), 2-6 Dec. 2017 2017, pp. 6.2.1-6.2.4, doi: 10.1109/IEDM.2017.8268338.