簡易檢索 / 詳目顯示

研究生: 陳建璋
Chen, Jian-Jhang
論文名稱: 具有固定寬度乘法器的新型高效SVM加速器設計
A New and Efficient SVM Accelerator Design with Fixed-Width Multipliers
指導教授: 周哲民
Jou, Jer-Min
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電機工程學系
Department of Electrical Engineering
論文出版年: 2019
畢業學年度: 107
語文別: 中文
論文頁數: 57
中文關鍵詞: 支持向量機固定寬度乘法器迴圈分塊
外文關鍵詞: Support vector machines, Fixed-width multiplier, Loop tiling
相關次數: 點閱:71下載:4
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 支持向量機(SVM)廣泛的使用在人工智慧(AI)的應用上。由於AI應用的高計算複雜度和即時性要求,因此有效率的加速SVM運算是至關重要的。SVM大部分的運算是核函數,支配整個SVM的速度並且需要使用特殊硬體來實現。
    在本論文中,我們設計了一個新的SVM硬體加速器,通過改變決策函數的形式並藉由分塊loop迴圈來有效率的加速核函數的計算。此外,我們還設計了一種新的高效固定寬度乘法器,具有非常低的誤差,可用於SVM及任何其他加速器。
    因此,我們的SVM加速器與其他加速器相比顯著的提高了檢測速度,並且固定寬度乘法器比其他近似乘法器具有最低的誤差。

    Support vector machines (SVMs) are widely used in various artificial intelligence (AI) applications. Due to AI applications’ high computation complexity and real-time requirements, it is critical to speed up the SVM operation efficiently. The most part of the SVM computation is the kernel functions, which dominate the overall SVM speed and need to be implemented with special hardware. In this thesis, we designed a new SVM hardware accelerator that speeds up efficiently the calculation of kernel functions by changing the form of the decision function and by tiling the loops in it. And, we had also designed a new efficient fixed-width multiplier with very low errors for use in this SVM accelerator. Therefore, our SVM accelerator has a significantly improved detection speed compared to others, and the fixed-width multiplier has also the lowest errors than other approximate multipliers.

    摘要 III A New and Efficient SVM Accelerator Design with Fixed-Width Multipliers IV SUMMARY IV INTRODUCTION V OUR DESIGNS AND IMPORTANT RESULTS VI CONCLUSION X 致謝 XI 目錄 XII 表目錄 XV 圖目錄 XVI 第1章 緒論 1 1.1 研究背景 1 1.2 研究動機與目的 3 1.3 論文架構 4 第2章 背景知識與相關研究 5 2.1 支持向量機(SVM)介紹 6 2.1.1 可分割情形(The Separable case) 7 2.1.2 不可分割情形(The Non-Separable case) 9 2.1.3 SVM多類別應用 10 2.2 LibSVM軟體介紹 13 2.3 SVM硬體加速器相關研究 15 第3章 SVM加速演算法分析與架構設計 16 3.1 決策函數優化之重要性 17 3.2 決策函數之數學式改變 18 3.3 演算法平行優化 20 3.3.1 迴圈展開平行性分析 20 3.3.2 迴圈分塊平行性分析 21 3.4 SVM硬體架構設計 23 3.4.1 PMAC運算單元之設計 24 3.4.2 投票單元之設計 25 3.4.3 控制單元之設計 26 第4章 固定寬度乘法器之設計 27 4.1 固定寬度乘法器之研究 28 4.1.1 固定寬度乘法器 29 4.2 固定寬度乘法器的改良 34 4.3 管線化固定寬度乘法器 36 第5章 實驗結果與分析討論 38 5.1 實驗環境 39 5.2 固定寬度乘法器實驗結果 40 5.2.1 固定寬度乘法器的誤差分析 40 5.2.2 固定寬度乘法器的硬體效能分析 44 5.3 SVM硬體加速器實驗結果 47 5.3.1 SVM資料集與訓練參數 47 5.3.2 FPGA平台的實驗分析 48 5.3.3 SVM硬體效能分析 51 5.3.4 記憶體需求分析 53 第6章 結論與未來展望 54 參考文獻 55

    [1] C. Cortes and V. Vapnik, “Support-vector networks,” Mach. Learn., vol. 20, no. 3, pp. 273-297, 1995.
    [2] S. Dumais, J. Platt, D. Heckerman, and M. Sahami, “Inductive learning algorithms and representations for text categorization”, Proceedings of the 7th international conference on Information and knowledge management, 1998, pp. 148-155.
    [3] T. Joachims, “Text categorization with support vector machines”, Proceedings of European Conference on Machine Learning(ECML), 1988, pp. 137-142.
    [4] E. Osuna, R. Freund, and F. Girosi, “An improved training algorithm for support vector machines”, Neural Networks for Signal Processing VII-Proceedings of the 1997 IEEE Workshop, pp. 276-285.
    [5] M. Oren, C. Papageorgiou, P. Sinha, E. Osuna, and T. Poggio, “Pedestrian detection using wavelet templates”, Proceedings Computer Vision and Pattern Recognition, 1997, pp. 193-199.
    [6] Dae Hwan Kim, Hyun II Choi, Jin Hyung Kim, “3D Space Handwriting Recognition with Ligature Model”, International Symposium on Ubiquitious Computing Systems, 2006, pp. 41-56.
    [7] Christoph Amma, Tanja Schultz, Dirk Gehrig, “Airwriting Recognition using Wearable Motion Sensors”, Proceedings of the 1st Augmented Human International Conference, 2010, no. 10, pp. 1-8.
    [8] Kong Jun-qi, “Research of Gesture Recognition and Interaction Model Based on Three Dimensional Accelerometer”, in Chinese, 2009.
    [9] N. Shanthi, K. Duraiswamy, “A novel SVM-based handwritten Tamil character recognition system”, Pattern Analysis and Applications, 2010, vol. 3, no. 2, pp. 173-180.
    [10] Yan Jun, “Research of Feature Extraction based on Space Handwriting Recognition”, in Chinese, 2012.
    [11] C. C. Chang and C. J. Lin, “LIBSVM: a library for support vector machines,” Software available at https://www.csie.ntu.edu.tw/~cjlin/libsvm/.
    [12] B. Heisele, T. Serre, S. Prentice, and T. Poggio, “Hierarchical classification and feature reduction for fast face detection with support vector machines”, Pattern Recognition, 2003, vol. 36, no. 9, pp. 2007-2017.
    [13] Y. Ma and X. Ding, “Face detection based on cost-sensitive support vector machines”, Pattern Recognition with Support Vector Machines, 2002, pp. 260-267.
    [14] S. Cadambi, et al., “A massively parallel FPGA-based coprocessor for support vector machines”, Proceedings of the 17th IEEE Symposium on Field Programmable Custom Computing Machine, 2009, pp. 115-122.
    [15] O. Pina-Ramirez, R. Valdes-Cristerna, and O. Yanez-Suarez, “An FPGA implementation of linear kernel support vector machines”, Proceedings of the IEEE International Conference on Reconfigurable Computing and FPGA’s, 2006, pp. 1-6.
    [16] M. Ruiz-Llata, G. Guarnizo, and M. Yébenes-Calvino, “FPGA implementation of a support vector machine for classification and regression”, Proceedings of International Joint Conference on Neural Networks, 2010, pp. 1-5.
    [17] J. Fowers, G. Brown, P. Cooke, and G. Stitt, “A performance and energy comparison of FPGAs, GPUs, and multicores for sliding-window applications”, Proceedings of the ACM/SIGDA international symposium on Field Programmable Gate Arrays, 2012, pp. 47-56.
    [18] I. Kukenys and B. McCane, “Classifier cascades for support vector machines”, Processing 23rd International Conference Image Vision Computing, 2008, pp. 1-6.
    [19] C. Kyrkou, Christos-Savvas Bouganis, T. Theocharides, and Marios M. Polycarpou, “Embedded Hardware-Efficient Real-Time Classification With Cascade Support Vector Machines”, IEEE Transactions on Neural Networks and Learning Systems, 2016, vol. 27, no. 1, pp. 99-112.
    [20] Y. Jiang, K. Virupakshappa, and E. Oruklu, “FPGA Implementation of a Support Vector Machine Classifier for Ultrasonic Flaw Detection”, IEEE 60th International Midwest Symposium on Circuits and Systems, 2017, pp.180-183.
    [21] J. M. Jou, S. R. Kuang, and R. D. Chen, “Design of Low-Error Fixed-Width Multipliers for DSP Applications,” IEEE Trans. Circuits syst., vol. 46, no. 6, 1999.
    [22] D. De Caro, N. Petra, V. Garofalo, A.G.M. Strollo, “Fixed-width multipliers and multipliers-accumulators with min-max appr-oximation error,” IEEE Trans. Circuits Syst., 2013, vol. 60, no. 9, pp. 2375–2388.
    [23] C. Kyrkou, C.-S. Bouganis, T. Theocharides, and M. M. Polycarpou, “Embedded Hardware-Efficient Real-Time Classification With Cascade Support Vector Machines,” IEEE Trans. on Neural Netw. and Learning Syst., 2016, vol. 27, no. 1, pp. 99–112.

    無法下載圖示 校內:立即公開
    校外:不公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE