簡易檢索 / 詳目顯示

研究生: 楊傑凱
Yang, Chieh-Kai
論文名稱: 適用於隨機生成基本模型的多類別集成挑選方法
Ensemble Selection Methods for Random Base Models in Data Sets with Multiple Classes
指導教授: 翁慈宗
Wong, Tzu-Tsung
學位類別: 碩士
Master
系所名稱: 管理學院 - 資訊管理研究所
Institute of Information Management
論文出版年: 2026
畢業學年度: 114
語文別: 中文
論文頁數: 83
中文關鍵詞: 集成挑選最佳化模型隨機生成簡易貝氏多類別分類
外文關鍵詞: Ensemble selection, multi-class classification, naïve Bayesian classifier, optimization model , randomly-generated base model
相關次數: 點閱:26下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在分類任務中,集成學習透過整合多個基本模型的預測結果,有效提升整體預測效能,為了進一步解決傳統集成學習在記憶體上的龐大耗損與運算負擔的問題,集成挑選逐漸成為研究焦點,期望在縮減集成規模的同時,仍能維持甚至提升預測效能。集成挑選中,最佳化方法被廣泛應用,過往研究顯示基本模型的正確率與模型預測間的相關性為影響集成效能的關鍵因素,多數相關研究皆將此二者納入多目標範疇,建構最佳化模型。隨著隨機生成基本模型方法的提出,能大幅降低基本模型間預測的相關性,不再需要將此因素納入考量,基於此,本研究提出一個以正確率為單一目標的最佳化集成挑選模型,期望從候選模型中,挑選出最佳的組合進行集成,研究也將過往研究僅適用於二類別分類的最佳化模型框架重新設計,擴展應用範圍至現實中更常見的多類別分類任務。
    實驗結果顯示,本研究所提出之最佳化集成挑選方法在多數資料集上皆優於傳統集成挑選方法,能更有效地挑出較佳的基本模型組合,提升整體預測效能,在基本模型生成策略方面,本研究提出之隨機生成結合粒子群優化演算法,於集成挑選後在多數資料集表現優於袋裝法,而進一步結合隨機生成結合粒子群優化演算法與袋裝法之混合策略,於整體平均預測正確率上達到最佳表現,顯示整合不同模型生成機制可進一步強化分類效能。

    Ensemble learning improves prediction performance by integrating the outputs of multiple base models, and ensemble selection is an effective way to reduce the computational cost in ensemble learning. Traditional ensemble selection methods consider both accuracies and diversities of base models. When base models are randomly generated, an optimization model for ensemble selection need not include the diversity among base models in its objective function. However, the optimization model is designed to perform ensemble selection for data sets with only two class values. This thesis first investigates the parameters of particle swarm optimization for generating base models with high accuracies randomly for naïve Bayesian classifier when data sets have multiple class values. Then the filtering mechanism and the optimization model for ensemble selection are redesigned for processing data sets with multiple class values. The experimental results on 20 data sets demonstrate that the ensemble selection method proposed in this study is superior to another that considers both accuracies and diversities of base models. The hybrid of randomly-generated base models with the ones induced by bagging approach achieves the highest mean classification accuracy.

    摘要 I 誌謝 V 目錄 VI 表目錄 IX 圖目錄 X 第一章 緒論 1 1.1 研究背景與動機 1 1.2 研究目的 3 1.3 研究架構 3 第二章 文獻探討 5 2.1 集成學習 5 2.1.1袋裝法 6 2.1.2提升法 7 2.2 隨機生成基本模型 8 2.3 集成挑選 10 2.3.1 排序集成挑選法 10 2.3.2 聚類集成挑選法 11 2.3.3 最佳化集成挑選法 11 2.5 多類別分類 13 2.5.1 二元化分解方法 14 2.5.2 由多元分類擴展 15 2.6 小結 16 第三章 研究方法 17 3.1 研究方法流程 17 3.2 資料前處理與資料集分割 18 3.3 生成基本模型 19 3.4 基本模型生成策略與資料特性之適配性 24 3.5 基本模型內部結構之差異分析 26 3.6 多類別資料過濾機制 27 3.7 多類別最佳化集成挑選模型 32 3.8 測試集預測與結果評估 35 第四章 基本模型生成策略實驗評估 39 4.1 資料集與實驗環境設定 39 4.2 實驗參數設定 41 4.3 PSO超參數對基本模型效能之影響 42 4.3.1 正確率比較 43 4.3.2 運算效率比較 47 4.4 資料集結構特性對分類效能之影響 49 4.5 小結 53 第五章 最佳化集成挑選實驗評估 54 5.1 基本模型內部結構分析結果 54 5.2 資料過濾之結果 56 5.3 集成挑選後分類正確率之比較 58 5.4 集成挑選運算時間之比較 61 5.5 小結 63 第六章 結論與未來展望 65 6.1 結論 65 6.2 未來展望 66 第七章 參考文獻 67 附錄 71

    黃中立,(2023),以簡易貝氏分類器隨機生成基本模型之集成方法。國立成功大學 資訊管理研究所碩士班碩士論文。
    徐心縈,(2023),用羅吉斯迴歸建構隨機分類模型之集成方法。國立成功大學資訊管理研究所碩士班碩士論文。
    蔡哲倫,(2024),適用於多類別資料的含隨機生成模型之集成嵌套二分法。國立成功大學資訊管理研究所碩士班碩士論文。
    何政賢,(2024),以粒子群最佳化方法優化應用於二類別資料之隨機集成演算法。國立成功大學資訊管理研究所碩士班碩士論文。
    陳毓潔,(2025),適用於二類別資料之基於正確率最佳化的集成挑選法。國立成功大學工業與資訊管理研究所碩士班碩士論文
    林韋成,(2025),應用一對一與一對多方法於多類別資料的隨機生成模型之集 成方法。國立成功大學資訊管理研究所碩士班碩士論文。
    Ali, M.A, Uçuncu, D., Karadayı Ataş, P., Özöğür Akyüz,S. (2019). Classification of motor imagery task by using novel ensemble pruning approach. IEEE Transactions on Fuzzy Systems, 28(1), 85-91.
    Bian, Y.J., Wang, Y.J., Yao, Y.Q., Chen, H.H. (2020). Ensemble pruning based on objection maximization with a general distributed. IEEE Transactions on Neural Networks and Learning Systems, 31(9), 3766-3774.
    Breiman, L. (1996). Bagging predictors. Machine Learning, 24, 123-140.
    Chen D.C., Li W.W., Fang J. (2025). Blending-based ensemble learning low-voltage station area theft detection. Energies, 18(31).
    Concha, B. and Pedro,L. (2014). Discrete bayesian network classifiers: A survey. ACM COMPUTING SURVEYS, 47(1), 1-43.
    Dong, X.B., Yu, Z.W., Cao W.M, Shi Y.F, Ma, Q.L. (2020). A survey on ensemble learning. Frontiers of Computer Science, 14(2), 241-258.
    Dong, X., Wang, J., Liang, Y. (2025). A novel ensemble classifier selection method for software defect prediction, IEEE Access, 13, 25578-25597.
    Farid, D.M., Zhang, L., Rahman, C.M., Hossain, M.A., Strachan, R. (2014). Hybrid decision tree and naïve Bayes classifiers for multi-class classification tasks. Expert Systems with Applications, 41(4), 1937-1946.
    Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F.(2011). An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes. Pattern Recognition, 44(8), 1761-1776.
    Galar, M., Fernández, A., Barrenechea, E., Herrera, F. (2015). DRCW-OVO: Distance-based relative competence weighting combination for One-vs-One strategy in multi-class problems. Pattern Recognition, 48(1), 28-42.
    Garcia, L.P.F., Sáez, J.A., Luengo, J., Lorena, A.C, Carvalho, A.C.P.L.F., Herrera, F. (2015). Using the One-vs-One decomposition to improve the performance of class noise filters via an aggregation strategy in multi-class classification problems. Knowledge-Based Systems, 91, 153-164.
    Ibomoiye, D.M., Sun Y.X. (2022). A survey of ensemble learning : concepts, algorithms, applications, and prospects. IEEE Access, 10, 99129-99149.
    Koutsoukas, A., Lowe, R., KalantarMotamedi, Y., Mussa, H.Y., Klaffke, W., Mitchell, J.B.O., Glen, R.C., Bender, A. (2014). In silico target predictions: Defining a benchmarking data set and comparison of performance of the multiclass naïve bayes and parzen-rosenblatt window. Journal of Chemical Information and Modeling, 54(7), 2180-2182.
    Li, C.L, Li, D.Y., Qin, X., Qin, Y.X, Li, J.L., Yuan, J.F.(2025). Clustering ensemble pruning algorithm based on vec2vec classifier representation. Journal of King Saud University Computer and Information Sciences, 37(22).
    Mehra, N. and Gupta S. (2013). Survey on multiclass classification methods. International Journal of Computer Science and Information Technologies, 4(4), 572-576.
    Mitu, M.M., Arefin, S., Saurav, Z., Hasan M.A.,Farid, D.M. (2024). Pruning-based ensemble tree for multi-class classification. 2024 6th International Conference on Electrical Engineering and Information & Communication Technology, 481-486.
    Nakata, N., Siina, T. (2023). Ensemble learning of multiple models using deep learning for multiclass classification of ultrasound images of hepatic masses. Bioengineering, 10(69).
    Rokach, L. (2009). Collective-agreement-based pruning of ensembles. Computational Statistics & Data Analysis, 53(4), 1015-1026.
    Sagi, O., Rokach, L. (2017). Ensemble learning : A survey. Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery, 8(4).
    Tirronen, S., Kadiri, S.R., Alku, P. (2023). Hierarchical multi-class classification of voice disorders using self-supervised models and glottal features. IEEE Open Journal of Signal Processing, 4, 80-88.
    Wu, Y.C., He, Y.X., Qian, C., Zhou, Z.H. (2022). Multi-objective evolutionary ensemble pruning guided by margin distribution. Parallel Problem Solving from Nature – PPSN XVII, 427-441.
    Zhang, Y., Burer, S., Street, W.N. (2006). Ensemble pruning via semi-definite programming. Journal of Machine Learning Research, 7, 1315-1338.

    下載圖示
    校外:立即公開
    QR CODE