| 研究生: |
袁文謹 Yuan, Wen-Jin |
|---|---|
| 論文名稱: |
基於語意場景辨識與因子圖優化之移動機器人定位及視覺標籤校正研究 Study on Mobile Robot Localization and Fiducial Marker Calibration Based on Semantic Scene Recognition and Factor Graph Optimization |
| 指導教授: |
鄭銘揚
Cheng, Ming-Yang |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電機工程學系 Department of Electrical Engineering |
| 論文出版年: | 2026 |
| 畢業學年度: | 114 |
| 語文別: | 中文 |
| 論文頁數: | 137 |
| 中文關鍵詞: | 卡爾曼濾波器 、因子圖 、位姿估計 、語意分割 、感測器融合 、自主移動機器人 |
| 外文關鍵詞: | Kalman Filter, Factor Graph, Pose Estimation,, Semantic Segmentation, Sensor Fusion, Autonomous Mobile Robot |
| 相關次數: | 點閱:63 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
隨著工業4.0 與智慧物流的蓬勃發展,自主移動機器人已成為自動化倉儲與室內配送的核心技術。在動態複雜的室內環境中,單一感測器容易導致定位漂移、長時間運行累積誤差等問題。針對上述挑戰,本研究利用擴展卡爾曼濾波器進行感測器融合,提供高頻位姿估計。此外,利用因子圖框架整合多感測器資訊及視覺標記定位結果,在估計自走車位置的同時,也對視覺標籤位置進行校正。場景辨識部分,提出語義感知辨識機制,利用語意分割模型理解輸入影像,使系統能自動判別自走車當前所處區域,並動態切換對應之局部地圖。最後,構建一套完整的室內自走車定位系統,並於真實場景中驗證其可行性。實驗結果顯示,本系統在結構相似的室內環境下,能維持穩定的定位精度,且於場景切換後,透過視覺標籤的輔助,具備快速重定位的能力,整體定位強健性較傳統方法顯著提升,為智慧倉儲與室內服務機器人之實際部署提供可靠的技術基礎。
With the rapid development of Industry 4.0 and intelligent logistics, autonomous mobile robots have become a core technology in automated warehousing and indoor delivery. In dynamic and complex indoor environments, relying on a single sensor often leads to localization drift and accumulated errors over extended operation. To address these challenges, this study employs an Extended Kalman Filter (EKF) for sensor fusion to provide high-frequency pose estimation. Furthermore, a factor graph framework is adopted to integrate multi-sensor information and fiducial marker localization results, enabling simultaneous estimation of the robot's pose and correction of fiducial marker positions. For scene recognition, we propose a semantic perception mechanism, leveraging a semantic segmentation model to interpret input images, allowing the system to automatically determine the robot's current operational zone and dynamically switch to the corresponding local map. Finally, a complete indoor robot localization system is constructed and validated in real-world environments. Experimental results demonstrate that the proposed system maintains stable localization accuracy in structurally similar indoor environments. Moreover, with the assistance of fiducial markers, the system exhibits rapid relocalization capability after scene transitions. The overall localization robustness is significantly improved compared to conventional methods, providing a reliable technical foundation for practical deployment in smart warehousing and indoor service robotics.
[1] H. Lasi, P. Fettke, H.-G. Kemper, T. Feld, and M. Hoffmann, "Industry 4.0," Business & Information Systems Engineering, vol. 6, no. 4, pp. 239–242, 2014.
[2] M. Kalaitzakis, B. Cain, S. Carroll, A. Ambrosi, C. Whitehead, and N. Vitzilaios, "Fiducial Markers for Pose Estimation: Overview, Applications and Experimental Comparison of the ArTag, AprilTag, ArUco and STag Markers," Journal of Intelligent & Robotic Systems, vol. 101, no. 4, p. 71, 2021.
[3] P. J. Besl and N. D. McKay, "Method for Registration of 3-D Shapes," in Sensor Fusion IV: Control Paradigms and Data Structures, vol. 1611, 1992, pp. 586–606.
[4] D. Chetverikov, D. Svirko, D. Stepanov, and P. Krsek, "The Trimmed Iterative Closest Point Algorithm," in 2002 International Conference on Pattern Recognition, vol. 3, 2002, pp. 545–548.
[5] A. Segal, D. Haehnel, S. Thrun et al., "Generalized-ICP," in Robotics: Science and Systems, vol. 2, no. 4, 2009, p. 435.
[6] J. Serafin and G. Grisetti, "NICP: Dense Normal Based Point Cloud Registration," in 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015, pp. 742–749.
[7] P. Dellenbach, J.-E. Deschaud, B. Jacquet, and F. Goulette, "CT-ICP: Real-Time Elastic LiDAR Odometry with Loop Closure," in 2022 International Conference on Robotics and Automation (ICRA), 2022, pp. 5580–5586.
[8] J. Zhang, S. Singh, "LOAM: LiDAR Odometry and Mapping in Real-Time," in Robotics: Science and Systems, vol. 2, no. 9, 2014, pp. 1–9.
[9] T. Shan and B. Englot, " LeGO-LOAM: Lightweight and Ground-Optimized Lidar Odometry and Mapping on Variable Terrain," in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 4758–4765.
[10] J. Behley and C. Stachniss, "Efficient Surfel-Based SLAM Using 3D Laser Range Data in Urban Environments," in Robotics: Science and Systems, vol. 2018, 2018, p. 59.
[11] D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal of Computer Vision, vol. 60, no. 2, pp. 91–110, 2004.
[12] H. Bay, T. Tuytelaars, and L. Van Gool, "SURF: Speeded Up Robust Features," in European Conference on Computer Vision, 2006, pp. 404–417.
[13] E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An Efficient Alternative to SIFT or SURF," in 2011 International Conference on Computer Vision, 2011, pp. 2564–2571.
[14] E. Mráz, J. Rodina, and A. Babinec, "Using Fiducial Markers to Improve Localization of a Drone," in 2020 23rd International Symposium on Measurement and Control in Robotics (ISMCR), 2020, pp. 1–5.
[15] A. de Oliveira Júnior, L. Piardi, E. G. Bertogna, and P. Leitão, "Improving the Mobile Robots Indoor Localization System by Combining SLAM with Fiducial Markers," in 2021 Latin American Robotics Symposium (LARS), 2021 Brazilian Symposium on Robotics (SBR), and 2021 Workshop on Robotics in Education (WRE), 2021, pp. 234–239.
[16] B. Marques, R. Carvalho, P. Dias, M. Oliveira, C. Ferreira, and B. S. Santos, "Evaluating and Enhancing Google Tango Localization in Indoor Environments Using Fiducial Markers," in 2018 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), 2018, pp. 142–147.
[17] P. M. Djuric, J. H. Kotecha, J. Zhang, Y. Huang, T. Ghirmai, M. F. Bugallo, and J. Miguez, "Particle Filtering," IEEE Signal Processing Magazine, vol. 20, no. 5, pp. 19–38, 2003.
[18] M.-A. Chung and C.-W. Lin, "An Improved Localization of Mobile Robotic System Based on AMCL Algorithm," IEEE Sensors Journal, vol. 22, no. 1, pp. 900–908, 2021.
[19] G. Peng, W. Zheng, Z. Lu, J. Liao, L. Hu, G. Zhang, and D. He, "An Improved AMCL Algorithm Based on Laser Scanning Match in a Complex and Unstructured Environment," Complexity, vol. 2018, no. 1, p. 2327637, 2018.
[20] H. Zhu and Q. Luo, "Indoor Localization of Mobile Robots Based on the Fusion of an Improved AMCL Algorithm and a Collision Algorithm," IEEE Access, vol. 12, pp. 67199–67208, 2024.
[21] M. L. Fung, M. Z. Q. Chen, and Y. H. Chen, "Sensor Fusion: A Review of Methods and Applications," in 2017 29th Chinese Control and Decision Conference (CCDC), 2017, pp. 3853–3860.
[22] P. F. Muir and C. P. Neuman, "Kinematic Modeling of Wheeled Mobile Robots," Journal of Robotic Systems, vol. 4, no. 2, pp. 281–340, 1987.
[23] J. Wang and E. Olson, "AprilTag 2: Efficient and Robust Fiducial Detection," in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, pp. 4193–4198.
[24] S. Macenski, T. Foote, B. Gerkey, C. Lalancette, and W. Woodall, "Robot Operating System 2: Design, Architecture, and Uses in the Wild," Science Robotics, vol. 7, no. 66, p. eabm6074, 2022.
[25] A. Stefek, T. V. Pham, V. Krivanek, and K. L. Pham, "Energy Comparison of Controllers Used for a Differential Drive Wheeled Mobile Robot," IEEE Access, vol. 8, pp. 170915–170927, 2020.
[26] R. Roriz, J. Cabral, and T. Gomes, "Automotive LiDAR Technology: A Survey," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 7, pp. 6282–6297, 2021.
[27] C. Rablau, "LIDAR—A New (Self-Driving) Vehicle for Introducing Optics to Broader Engineering and Non-Engineering Audiences," in Education and Training in Optics and Photonics, 2019, p. 11143_138.
[28] J. Wojtanowski, M. Zygmunt, M. Kaszczuk, Z. Mierczyk, and M. Muzal, "Comparison of 905 nm and 1550 nm Semiconductor Laser Rangefinders' Performance Deterioration Due to Adverse Environmental Conditions," Opto-Electronics Review, vol. 22, no. 3, pp. 183–190, 2014.
[29] National Oceanic and Atmospheric Administration (NOAA), "What is LiDAR?" National Ocean Service, 2020. [Online]. Available: https://oceanservice.noaa.gov/facts/lidar.html
[30] T. Theilig, HDDM+ – Innovative Technology for Distance Measurement from SICK, SICK AG, Waldkirch, 2017. [Online]. Available: https://www.sick.com/tw/en/white-paper-hddm-technology-for-distance-measurement/w/gmt-micron-to-mile-whitepaper-HDDMplus/
[31] L. Keselman, J. I. Woodfill, A. Grunnet-Jepsen, and A. Bhowmik, "Intel RealSense Stereoscopic Depth Cameras," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2017, pp. 1–10.
[32] E. Olson, "AprilTag: A Robust and Flexible Visual Fiducial System," in 2011 IEEE International Conference on Robotics and Automation, 2011, pp. 3400–3407.
[33] ROS, "Documentation - ROS Wiki," 2011. [Online]. Available: https://www.ros.org/wiki
[34] S. Macenski and I. Jambrecic, "SLAM Toolbox: SLAM for the Dynamic World," Journal of Open Source Software, vol. 6, no. 61, p. 2783, 2021.
[35] K. Konolige, G. Grisetti, R. Kümmerle, W. Burgard, B. Limketkai, and R. Vincent, "Efficient Sparse Pose Adjustment for 2D Mapping," in 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010, pp. 22–29.
[36] G. Grisetti, C. Stachniss, and W. Burgard, "Improved Techniques for Grid Mapping with Rao-Blackwellized Particle Filters," IEEE Transactions on Robotics, vol. 23, no. 1, pp. 34–46, 2007.
[37] S. Kohlbrecher, O. Von Stryk, J. Meyer, and U. Klingauf, "A Flexible and Scalable SLAM System with Full 3D Motion Estimation," in 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics, 2011, pp. 155–160.
[38] W. Hess, D. Kohler, H. Rapp, and D. Andor, "Real-Time Loop Closure in 2D LIDAR SLAM," in 2016 IEEE International Conference on Robotics and Automation (ICRA), 2016, pp. 1271–1278.
[39] M. Labbé and F. Michaud, "RTAB-Map as an Open-Source LiDAR and Visual Simultaneous Localization and Mapping Library for Large-Scale and Long-Term Online Operation," Journal of Field Robotics, vol. 36, no. 2, pp. 416–446, 2019.
[40] J. Shi et al., "Good Features to Track," in 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1994, pp. 593–600.
[41] W. A. Qader, M. M. Ameen, and B. I. Ahmed, "An Overview of Bag of Words: Importance, Implementation, Applications, and Challenges," in 2019 International Engineering Conference (IEC), 2019, pp. 200–204.
[42] J. Illingworth and J. Kittler, "A Survey of the Hough Transform," Computer Vision, Graphics, and Image Processing, vol. 44, no. 1, pp. 87–116, 1988.
[43] G. Welch and G. Bishop, "An Introduction to the Kalman Filter," University of North Carolina at Chapel Hill, Tech. Rep. TR 95-041, 1995.
[44] M. Kaess, H. Johannsson, R. Roberts, V. Ila, J. Leonard, and F. Dellaert, "iSAM2: Incremental Smoothing and Mapping with Fluid Relinearization and Incremental Variable Reordering," in 2011 IEEE International Conference on Robotics and Automation (ICRA), 2011, pp. 3281–3288.
[45] F. R. Kschischang, B. J. Frey, and H.-A. Loeliger, "Factor Graphs and the Sum-Product Algorithm," IEEE Transactions on Information Theory, vol. 47, no. 2, pp. 498–519, 2001.
[46] J. Peng, Y. Liu, S. Tang, Y. Hao, L. Chu, G. Chen, et al., "PP-LiteSeg: A Superior Real-Time Semantic Segmentation Model," arXiv preprint, arXiv:2204.02681, 2022.
[47] T. Ren, S. Liu, A. Zeng, J. Lin, K. Li, H. Cao, et al., "Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks," arXiv preprint, arXiv:2401.14159, 2024.
[48] X. Shi, D. Li, P. Zhao, Q. Tian, Y. Tian, Q. Long, et al., "Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM," in 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 3139–3145.
[49] F. Dellaert, "Factor Graphs: Exploiting Structure in Robotics," Annual Review of Control, Robotics, and Autonomous Systems, vol. 4, no. 1, pp. 141–166, 2021.
[50] J. Dai, S. Liu, X. Hao, Z. Ren, and X. Yang, "UAV Localization Algorithm Based on Factor Graph Optimization in Complex Scenes," Sensors, vol. 22, no. 15, p. 5862, 2022.
[51] L. Xie, F. Lee, L. Liu, K. Kotani, and Q. Chen, "Scene Recognition: A Comprehensive Survey," Pattern Recognition, vol. 102, p. 107205, 2020.