| 研究生: |
龎在偉 Pang, Tzai-Wei |
|---|---|
| 論文名稱: |
具零編碼描述的虛擬智慧演化 P-Learning: Virtual Intelligence Evolution with Zero Pattern of Class Embedding |
| 指導教授: |
鄭憲宗
Cheng, Sheng-Tzong |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 資訊工程學系 Department of Computer Science and Information Engineering |
| 論文出版年: | 2020 |
| 畢業學年度: | 108 |
| 語文別: | 英文 |
| 論文頁數: | 43 |
| 中文關鍵詞: | 零樣本學習 、變分自編碼器 、知識表示 |
| 外文關鍵詞: | Zero-shot learning, Variational Auto-Encoder, Knowledge representation |
| 相關次數: | 點閱:130 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
近年來零樣本學習是個重大且需要解決的問題,然而零樣本學習方法受限於需要不可見類描述的缺點。基於從無到有的演化概念,我們提出一個類似想法的機制用來生成不可見類的資訊。變分自編碼器是目前在深度學習中用來學習複雜資料的分布與表示的最好方法之一。本篇論文使用了以條件變分自編碼器分辨零樣本學習中可見類與不可見類。在缺少不可見類的類別編碼的情況下,學習可見類的分布後得到類別編碼的編碼器和一個可以概略得分類資料的分類器。以生成後條件變分自編碼器的類別隱表示作為可見類編碼以及計算得到不可見類的編碼。之後再得到給定的類別編碼與產生的類別編碼之間的對應。最後根據上述的描述,我們的建立一個類似樣本學習方法的分類器。我們使用植物疾病與其他經常應用於零樣本學習的資料集,我們展示我們的方法可以達到與普通零樣本學習相似的效能與在時間消耗上的優勢。
Zero-shot learning (ZSL) is a significant and hence to be developed problem. However, ZSL suffers a defect that the need of unseen class embedding. By the concept of evolution, we propose a mechanism that produces unseen class information is like an evolutionary procedure which is from none to one. Variational Auto-Encoder (VAE) is one of the state-of-the-art methods in deep learning to learn distribution and representation of complex data. In this work, we use Conditional Variational Autoencoder (CAVE) to distinguish the class data. In lacking unseen class embedding case, CVAE learns seen class distribution for class encoder and a classifier to roughly classify data. It notes that synthesizes latent representation as seen class embedding and calculated unseen class embedding. And then we align distribution between given class embedding and learned class embedding. Finally, based on these processes, our method constructs a classifier which is like general ZSL procedure. Experimental results on plant diseases dataset and others. We demonstrate that P-Learning can meet similar performance with ordinary ZSL work and has advantage in time consuming.
[1] Kim, B.; Shin, S.; Jung, H. Variational Autoencoder-Based Multiple Image Captioning Using a Caption Attention Map. Appl. Sci. 2019, 9, 2699.
[2] Adrian Alan Pol ; Victor Berger ; Cecile Germain ; Gianluca Cerminara ; Maurizio Pierini, "Anomaly Detection with Conditional Variational Autoencoders" IEEE International Conference On Machine Learning And Applications (ICMLA), 2019
[3] Jian Ni, Shanghang Zhang, Haiyong Xie, "Dual Adversarial Semantics-Consistent Network for Generalized Zero-Shot Learning." IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2019
[4] Hyeonwoo Yu, Beomhee Lee. Zero-shot Learning via Simultaneous Generating and Learning. Conference on Neural Information Processing Systems (NeurIPS 2019)
[5] Yongqin Xian, Christoph H. Lampert, Bernt Schiele, Zeynep Akata. Zero-Shot Learning—A Comprehensive Evaluation of the Good, the Bad and the Ugly. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 41, NO. 9, SEPTEMBER 2019.
[6] Jeffrey Dalton, James Allan, and Pranav Mirajkar. Zero-shot video retrieval using content and concepts. 22nd ACM international conference on Information &Knowledge Management, pages 1857–1860. ACM, 2013.
[7] Yuming Shen, Li Liu, Fumin Shen, and Ling Shao. Zero-shot sketch-image hashing. arXiv preprint arXiv:1803.02284,2018.
[8] Ziming Zhang and Venkatesh Saligrama. Zero-shot learning via semantic similarity embedding. The IEEE International Conference on Computer Vision (ICCV),pages 4166–4174, 2015
[9] Christoph H Lampert, Hannes Nickisch, and Stefan Harmeling. Attribute-based classification for zero-shot visual object categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014.
[10] Xiaodong Yu and Yiannis Aloimonos. Attribute-based transfer learning for object categorization with zero/one training example. European Conf. on Computer Vision, 2010.
[11] Devraj Mandal, Sanath Narayan, Saikumar Dwivedi, Vikram Gupta, Shuaib Ahmed, Fahad Shahbaz Khan, and Ling Shao. Out-of-Distribution Detection for Generalized Zero-Shot Action Recognition. IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2019
[12] G. Shalev, Y. Adi, and J. Keshet. Out-of-distribution detection using multiple semantic label representations. InNIPS,2018
[13] Arash Vahdat, Jan Kautz. NVAE: A Deep Hierarchical Variational Autoencoder. IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2020.
[14] Edgar Schönfeld, Sayna Ebrahimi, Samarth Sinha, Trevor Darrell, Zeynep Akata, " Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoders," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2019
[15] Yang Liu, Jishun Guo, Deng Cai, Xiaofei He. "Attribute Attention for Semantic Disambiguation in Zero-Shot Learning." ICCV (2019).
[16] Catherine Wah, Steve Branson, Peter Welinder, Pietro Per-ona, and Serge Belongie. The caltech-ucsd birds-200-2011dataset. 2011
[17] Genevieve Patterson and James Hays. Sun attribute database: Discovering, annotating, and recognizing scene attributes. In 2012 IEEE Conference on Computer Vision and Pattern Recognition, pages 2751–2758. IEEE, 2012.
[18] Y. Xian, C. H. Lampert, B. Schiele, and Z. Akata. Zero-shot learning-a comprehensive evaluation of the good, the bad and the ugly. IEEE transactions on pattern analysis and machine intelligence, 2018
[19] Samir Bhattarai. New Plant Diseases Dataset. Kaggle.
[20] Andrea Frome*, Greg S. Corrado*, Jonathon Shlens*, Samy BengioJeffrey Dean, Marc’Aurelio Ranzato, Tomas Mikolov. DeViSE: A Deep Visual-Semantic Embedding Model. NIPS 2013.
[21] Yongqin Xian, Tobias Lorenz, Bernt Schiele, Zeynep Akata. Feature Generating Networks for Zero-Shot Learning. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018.
[22] Soravit Changpinyo, Wei-Lun Chao, Boqing Gong, and FeiSha. Synthesized classifiers for zero-shot learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
[23] Christoph H. Lampert, Hannes Nickisch, Stefan Harmeling. Learning To Detect Unseen Object Classes by Between-Class Attribute Transfer. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009.
[24] Zhengming Ding, Ming Shao, Yun Fu. Generative Zero-Shot Learning via Low-Rank Embedded Semantic Dictionary. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 41, NO. 12, DECEMBER 2019.