簡易檢索 / 詳目顯示

研究生: 黃冠程
Huang, Kuan-Cheng
論文名稱: 具小樣本數值資料學習能力之生成對抗網路
A Generative Adversarial Network for Learning with Small Numerical Data Sets
指導教授: 利德江
Li, Der-Chiang
學位類別: 碩士
Master
系所名稱: 管理學院 - 資訊管理研究所
Institute of Information Management
論文出版年: 2021
畢業學年度: 109
語文別: 中文
論文頁數: 64
中文關鍵詞: 小樣本資料虛擬樣本生成對抗網路
外文關鍵詞: Small Datasets, Virtual Sample, Generative Adversarial Network
相關次數: 點閱:188下載:0
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近年來生成對抗網路(Generative Adversarial Networks, GANs)被提出用以
    生成模擬圖片,且已有部分文獻將GAN 應用於數值資料之分析,如建築能源消
    耗的預測以及肝癌期數的預測與辨別。然此些研究均以一般資料量或大數據資料
    量而為之,而在現今全球化的時代,快速決策之需求漸增,但囿於短時間內可獲
    得的資料稀少,導致機器學習演算法難以產出穩健的結果,如何從少數樣本中獲取更多訊息已成為一項課題。因此,如何發展適用於小樣本資料分析之GAN 架構,實為本研究之目的。本研究將以Wasserstein GAN(WGAN)做為本研究之GAN 架構,並改良整體趨勢擴散(mega-trend-diffusion, MTD)作為GAN 之生成網路限制,以倒傳遞神經網路(back-propagation network, BPN)作為GAN 之生成網路與鑑別網路,稱為WGAN_MTD。本研究透過此改良後之GAN 架構,使小樣本資料也能透過GAN生成出具有相似於真實樣本之虛擬樣本。我們從UC Irvine Machine Learning Repository 中挑選了兩筆公開資料集並透過多個分類模式與未增生虛擬樣本之方式比較準確度等測量指標。本研究對比未生成虛擬樣本的情況下,提供更好或接近最佳的結果。

    In recent years, Generative Adversarial Networks (GANs) have been proposed to generate simulated images, and some literatures have applied GAN to the analysis of numerical data, such as the prediction of building energy consumption and the
    prediction and identification of liver cancer stages. However, these studies are based on general data volume or big data volume. In the current era of globalization, the demand for rapid decision-making is increasing, but the data available in a short period of time is scarce, which leads to machine learning may not have a precise result. How to get more information from a few samples has become an important issue. Therefore, the main purpose of this research is to develop a generative adversarial network for learning with small numerical datasets. This research will use Wasserstein GAN (WGAN) as the GAN architecture of this research, and use mega trend-diffusion (MTD) to limit the bound of virtual samples that GAN generates, and use Back-propagation Network , BPN) as the generation network and the discrimination network of GAN, and called WGAN_MTD. This research chooses two datasets in UC Irvine Machine Learning Repository and evaluated and compared the performance by three criteria, such as Accuracy, standard deviation, and P-value. The experiment result shows that through this improved GAN architecture (WGAN_MTD), small sample data can also be used to generate virtual samples similar to real samples through GAN.

    摘要 i 目錄 xxiv 圖目錄 xxvi 表目錄 xxviii 第一章 緒論 1 1.1 研究背景 1 1.2 研究動機 3 1.3 研究目的 4 1.4 研究架構 5 第二章 文獻回顧 7 2.1 虛擬樣本生成 7 2.1.1. 生成對抗網路 7 2.1.2. 資訊擴散 11 2.2 預測分類模型 16 2.2.1. 倒傳遞神經網路 16 2.2.2. 支援向量機 17 2.2.3. 決策樹 21 2.2.4. 單純貝氏分類器 21 2.3 小結 23 第三章 研究方法 24 3.1 符號定義 24 3.2 虛擬樣本生成與挑選 25 3.2.1 WGAN 之架構 25 3.2.2 WGAN 訓練步驟 26 3.2.3 MTD 值域推估 27 3.2.4 MTD 樣本生成之流程 28 3.2.5 MTD 的問題與改善 30 3.3 研究方法流程 35 第四章 實例驗證 36 4.1 實驗環境 36 4.2 WGAN 網路設定 38 4.2.1 網路參數 38 4.2.2 網路架構 39 4.3 實驗結果 44 4.3.1 Wine 資料集實驗結果 44 4.3.2 Seeds 資料集實驗結果 51 4.4 研究發現 57 第五章 結論與建議 59 參考文獻 60

    葉怡成,類神經網路模式應用與實作,儒林圖書公司,2003年三月。
    Anthony, M., & Biggs, N. (1993). Computational Learning Theory for Artificial Neural Networks. North-Holland Mathematical Library, 51, 25-62.
    Arjovsky, M., Chintala, S., & Bottou, L. (2017). Wasserstein gan. arXiv preprint arXiv:1701.07875.
    Chao, G. Y., Tsai, T. I., Lu, T. J., Hsu, H. C., Bao, B. Y., Wu, W. Y., Lin, M. T., Lu, T. L. (2011). A new approach to prediction of radiotherapy of bladder cancer cells in small dataset analysis. Expert Systems with Applications, 38(7), 7963-7969.
    Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273-297.
    Efron, B., & Tibshirani, R. J. (1994). An Introduction to the Bootstrap: CRC press.
    Frid-Adar, M., Diamant, I., Klang, E., Amitai, M., Goldberger, J., & Greenspan, H. (2018). GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing, 321, 321-331.
    Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y. (2014). Generative adversarial nets. Advances in Neural Information Processing Systems, 27, 2672-2680.
    Goyal, P., Dollár, P., Girshick, R., Noordhuis, P., Wesolowski, L., Kyrola, A., Tulloch A., Jia Y., He, K. (2017). Accurate, large minibatch sgd: Training imagenet in 1 hour. arXiv preprint arXiv:1706.02677.
    Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017). Improved training of wasserstein GANs. Advances in Neural Information Processing Systems, 30, 5768-5778.
    Huang, C. F. (1997). Principle of information diffusion. Fuzzy Sets and Systems, 91(1), 69-90.
    Huang, C., & Moraga, C. (2004). A diffusion-neural-network for learning from small samples. International Journal of Approximate Reasoning, 35(2), 137-161.
    Huang, C. J., Wang, H. F., Chiu, H. J., Lan, T. H., Hu, T. M., & Loh, E. W. (2010). Prediction of the period of psychotic episode in individual schizophrenics by simulation-data construction approach. Journal of Medical Systems, 34(5), 799-808.
    Ivǎnescu, V. C., Bertrand, J. W. M., Fransoo, J. C., & Kleijnen, J. P. C. (2006). Bootstrapping to solve the limited data problem in production control: An application in batch process industries. Journal of the Operational Research Society, 57(1), 2-9.
    Karras, T., Laine, S., & Aila, T. (2019). A style-based generator architecture for generative adversarial networks. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), Long Beach, CA, USA, 2019, 4396-4405.
    Kuo, Y., Yang, T., Peters, B. A., & Chang, I. (2007). Simulation metamodel development using uniform design and neural networks for automated material handling systems in semiconductor wafer fabrication. Simulation Modelling Practice and Theory, 15(8), 1002-1015.
    Lanouette, R., Thibault, J., & Valade, J. L. (1999). Process modeling with neural networks using small experimental datasets. Computers and Chemical Engineering, 23(9), 1167-1176.
    Li, D. C., Chen, C. C., Chang, C. J., & Chen, W. C. (2012). Employing box-and-whisker plots for learning more knowledge in TFT-LCD pilot runs. International Journal of Production Research, 50(6), 1539-1553.
    Li, D. C., Chen, L. S., & Lin, Y. S. (2003). Using functional virtual population as assistance to learn scheduling knowledge in dynamic manufacturing environments. International Journal of Production Research, 41(17), 4011-4024.
    Li, D. C., Fang, Y. H., Lai, Y. Y., & Hu, S. C. (2009a). Utilization of virtual samples to facilitate cancer identification for DNA microarray data in the early stages of an investigation. Information Sciences, 179(16), 2740-2753.
    Li, D. C., Hsu, H. C., Tsai, T. I., Lu, T. J., & Hu, S. C. (2007a). A new method to help diagnose cancers for small sample size. Expert Systems with Applications, 33(2), 420-424.
    Li, D. C., Huang, W. T., Chen, C. C., & Chang, C. J. (2013). Employing virtual samples to build early high-dimensional manufacturing models. International Journal of Production Research, 51(11), 3206-3224.
    Li, D. C., Lin, W. K., Chen, C. C., Chen, H. Y., & Lin, L. S. (2018). Rebuilding sample distributions for small dataset learning. Decision Support Systems, 105, 66-76.
    Li, D. C., Lin, W. K., Lin, L. S., Chen, C. C., & Huang, W. T. (2016). The attribute-trend-similarity method to improve learning performance for small datasets. International Journal of Production Research, 55(7), 1898-1913.
    Li, D. C., & Lin, Y. S. (2006). Using virtual sample generation to build up management knowledge in the early manufacturing stages. European Journal of Operational Research, 175(1), 413-434.
    Li, D. C., Liu, C. W., & Hu, S. C. (2010). A learning method for the class imbalance problem with medical data sets. Computers in Biology and Medicine, 40(5), 509-518.
    Li, D. C., Tsai, T. I., & Shi, S. (2009b). A prediction of the dielectric constant of multi-layer ceramic capacitors using the mega-trend-diffusion technique in powder pilot runs: Case study. International Journal of Production Research, 47(1), 51-69.
    Li, D. C., Wu, C. S., Tsai, T. I., & Lina, Y. S. (2007b). Using mega-trend-diffusion and artificial samples in small data set learning for early flexible manufacturing system scheduling knowledge. Computers and Operations Research, 34(4), 966-982.
    Li, L., Lin, Y., Zheng, N., & Wang, F. Y. (2017). Parallel learning: A perspective and a framework. IEEE/CAA Journal of Automatica Sinica, 4(3), 389-395.
    Liu, Y., Zhou, Y., Liu, X., Dong, F., Wang, C., & Wang, Z. (2019). Wasserstein GAN-Based Small-Sample Augmentation for New-Generation Artificial Intelligence: A Case Study of Cancer-Staging Data in Biology. Engineering, 5(1), 156-163.
    Mirza, M., & Osindero, S. (2014). Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784.
    Niyogi, P., Girosi, F., & Poggio, T. (1998). Incorporating prior information in machine learning by creating virtual examples. Proceedings of the IEEE, 86(11), 2196-2208.
    Oniśko, A., Druzdzel, M. J., & Wasyluk, H. (2001). Learning Bayesian network parameters from small data sets: Application of Noisy-OR gates. International Journal of Approximate Reasoning, 27(2), 165-182.
    Papari, M. M., Yousefi, F., Moghadasi, J., Karimi, H., & Campo, A. (2011). Modeling thermal conductivity augmentation of nanofluids using diffusion neural networks. International Journal of Thermal Sciences, 50(1), 44-52.
    Sánchez, V. D. A. (2003). Advanced support vector machines and kernel methods. Neurocomputing, 55(1-2), 5-20.
    Tian, C., Li, C., Zhang, G., & Lv, Y. (2019). Data Driven Parallel Prediction of Building Energy Consumption Using Generative Adversarial Nets. Energy and Buildings, 186, 230-243.
    Tukey, J. W. (1977). Exploratory data analysis: Reading (MA): Addison-Wesley.
    Vapnik, V. N. (2000). The Nature of Statistical Learning Theory: Springer, New York.
    Werbos, P. (1974). Beyond regression:" new tools for prediction and analysis in the behavioral sciences. Ph. D. dissertation, Harvard University.
    Yang, Q., Yan, P., Zhang, Y., Yu, H., Shi, Y., Mou, X., Kalra, M. K., Zhang,Y., Sun, L., Wang, G. (2018). Low-Dose CT Image Denoising Using a Generative Adversarial Network With Wasserstein Distance and Perceptual Loss. IEEE Transactions on Medical Imaging, 37(6), 1348-1357.
    Yamashita, R., Nishio, M., Do, R. K. G., & Togashi, K. (2018). Convolutional neural networks: an overview and application in radiology. Insights into Imaging, 9(4), 611-629.
    Zhang, H., Sindagi, V., & Patel, V. M. (2019). Image De-raining Using a Conditional Generative Adversarial Network. IEEE Transactions on Circuits and Systems for Video Technology, 8215(c), 1-1.

    下載圖示
    2026-06-29公開
    QR CODE