簡易檢索 / 詳目顯示

研究生: 李亮瑩
Li, Liang-Ying
論文名稱: 應用單鏡頭攝影機於載具定位與前方車輛防撞警示
Application of Monocular Camera for Vehicular Localization and Forward Collision Warning
指導教授: 莊智清
Juang, Jyh-Ching
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電機工程學系
Department of Electrical Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 英文
論文頁數: 73
中文關鍵詞: 車輛導航系統擴展式卡爾濾波器單鏡頭攝影機車輛偵測前方車輛防撞警示
外文關鍵詞: Vehicle Navigation System, Extended Kalman Filter, Monocular Camera, Sensor Integration, Forward Collision Warning, Vehicle Detection
相關次數: 點閱:143下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 由於智慧型載具的蓬勃發展,對於載具動態穩定系統、防撞系統、道路偏移系統,甚至於自動導航系統的需求,精準的載具狀態是不可或缺的要素。一般而言,可以藉由全球定位系統(Global Positioning System, GPS)得到載具的位置、方向與速度。然而,當GPS受到干擾以至於定位精準度不夠可信的情況下,可藉由慣性導航系統(Inertial Navigation System, INS)和影像感測器來增加載具狀態的精準度。本論文利用車輛運動模型與擴展式卡爾曼濾波器發展多感知融合之精準定位演算法。隨著行車紀錄器的普及,幾乎所有車輛皆裝有行車紀錄器,因此本研究整合慣性感測元件(IMU),GNSS接收機和影像感測器進行載具狀態估測。此外,利用影像感測器偵測前方車輛,並於與前車太過相近時,給予駕駛警告。影像處理法則將實現於LabVIEW平台之人機界面(UMI)可進行即時觀察。而所提出之多感知融合定位演算法使用真實蒐集之資料於Matlab平台驗證。實驗結果不僅顯示所提出之多感知融合定位演算法可改善載具之定位精準度,此外亦說明所提出之前方防撞警示系統之可行性。

    Due to the vigorous development of intelligent vehicles, the accurate vehicle state is an indispensable element for vehicle dynamic stability system, collision avoidance systems, lane departure warning system, and even the automatic navigation system. Generally, the global positioning system (Global Positioning System, GPS) can be used to obtain the vehicle position, direction and speed. However, the positioning accuracy becomes not credible enough when GPS is disturbed, the accuracy of vehicle status can be increased by an inertial navigation system (Inertial Navigation System, INS) and image sensors. In this thesis, the vehicle kinematic model and the extended Kalman filter algorithm are adopted to develop a multi-sensors fusion algorithm for precise positioning. With the popularity of driving recorder, almost every vehicle is equipped with a driving recorder. The aim of this research is to estimate vehicle state by fusing the measurements gathered from inertial measurement unit (IMU), GNSS receiver and image sensors. In addition, the vision-based collision warning system can warn the driver according to the forward vehicle width while the inter-vehicle distance gets too close. Image processing technique is implemented in LabVIEW user machine interface (UMI), which can be observed in real time. The proposed algorithm is verified by using real gathered data in Matlab platform. The experimental results demonstrate not only that the accuracy of the vehicle state is improved by the proposed positioning algorithm in GPS challenging environments, but also the proposed forward collision warning system is feasible.

    摘要 II Abstract III Acknowledgements V Content VI List of Tables VIII List of Figures IX List of Abbreviations XII Chapter 1. Introduction 1 1.1 Motivation 1 1.2 Literature Review 3 1.3 Contributions of the Thesis 5 1.4 Organization 6 Chapter 2. Coordinate Systems and Camera Model 7 2.1 Coordinate Systems 7 2.1.1 World Coordinate System 7 2.1.2 Vehicle Axis System 9 2.1.3 Camera Axis System 10 2.1.4 3D Coordinate Transformations 11 2.2 Modeling of Camera 13 Chapter 3. Vehicular Localization and Forward Collision Warning 18 3.1 Introduction of Kalman Filter 18 3.1.1 Kalman Filter 18 3.1.2 Extended Kalman Filter 21 3.1.3 Parameter Settings 22 3.2 EKF-SLAM with a Single Camera 23 3.2.1 Processing of Monocular EKF-SLAM 23 3.2.2 State Vector 24 3.2.3 Process Model and Prediction Step 25 3.2.4 Measurement Model and Update Step 28 3.2.5 Feature Measurement Using Template Tracking Algorithm 30 3.2.6 Feature Point Prediction 34 3.2.7 Map Management 37 3.3 Forward Collision Warning 38 3.3.1 Vehicle Detection 39 3.3.2 Warning Alarm 45 Chapter 4. System Implementation and Experiments 47 4.1 Mechatronic system 47 4.1.1 Embedded Controller 48 4.1.2 I/O Modules and Sensor Modules 51 4.2 Camera Calibration 53 4.3 Experiment Results 55 4.3.1 Simultaneous Localization and Mapping 55 4.3.2 Forward Collision Alarm 64 Chapter 5. Conclusions and Future Work 68 5.1 Summary of Results 68 5.2 Future Research 69 Reference 71

    [1] J. M. Barrett, M. A. Gennert, W. R. Michalson, M. D. Audi, J. L. Center, J. F. Kirk, et al., "Development of a Low-cost, Self-contained, Combined Vision and Inertial Navigation System," in IEEE International Conference on Technologies for Practical Robot Applications (TePRA), pp. 1-6, 2013.
    [2] J.-Y. Bouguet. (2013). Camera Calibration Toolbox for Matlab. Available: http://www.vision.caltech.edu/bouguetj/calib_doc/index.html
    [3] L. Chao, H. Yalou, K. Yewei, and Y. Jing, "Monocular SLAM Using Vertical Straight Lines with Inverse-depth Representation," in 7th World Congress on Intelligent Control and Automation, pp. 3015-3020, 2008.
    [4] T. Chu, N. Guo, S. Backén, and D. Akos, "Monocular Camera/IMU/GNSS Integration for Ground Vehicle Navigation in Challenging GNSS Environments," Sensors, vol. 12, pp. 3162-3185, 2012.
    [5] J. Civera, A. J. Davison, and J. Montiel, "Inverse Depth Parametrization for Monocular SLAM," IEEE Transactions on Robotics, vol. 24, pp. 932-945, 2008.
    [6] N. I. Corporation. (2013). Benefits of Programming Graphically in NI LabVIEW. Available: http://www.ni.com/white-paper/14556/en/
    [7] N. I. Corporation. (2013). NI LabVIEW Real-Time Module. Available: http://www.ni.com/labview/realtime/
    [8] A. J. Davison, "Real-time Simultaneous Localisation and Mapping with a Single Camera," in Proceedings of Ninth IEEE International Conference on Computer Vision, vol.2, pp. 1403-1410, 2003.
    [9] A. J. Davison, I. D. Reid, N. D. Molton, and O. Stasse, "MonoSLAM: Real-Time Single Camera SLAM," IEEE Transactions on Pattern Analysis and Machine Intelligence,, vol. 29, pp. 1052-1067, 2007.
    [10] M. S. Grewal and A. P. Andrews, Kalman Filtering:Theory and Practice, 2001.
    [11] H.-P. Halvorsen. (2012). Introduction to LabVIEW. Available: http://home.hit.no/~hansha/documents/labview/training/Introduction%20to%20LabVIEW/Introduction%20to%20LabVIEW.pdf
    [12] S. Han, Y. Han, and H. Hahn, "Vehicle Detection Method Using Haar-like Feature on Real Time System," World Academy of Science, Engineering and Technology, vol. 59, pp. 455-459, 2009.
    [13] H. Jihua and H. S. Tan, "A Low-Order DGPS-Based Vehicle Positioning System Under Urban Environment," IEEE/ASME Transactions on Mechatronics, , vol. 11, pp. 567-575, 2006.
    [14] G. Kim and J.-S. Cho, "Vision-based Vehicle Detection and Inter-vehicle Distance Estimation for Driver Alarm System," Optical Review, vol. 19, pp. 388-393, 2012.
    [15] L. Kun-Jui, "Application of Particle Filter Tracking Algorithm in Autonomous Vehicle Navigation," Master Thesis, Department of Electrical Engineering, National Cheng Kung University, 2013.
    [16] B. D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," in IJCAI, pp. 674-679, 1981.
    [17] J. C. McCall and M. M. Trivedi, "Video-based Lane Estimation and Tracking for Driver Assistance: Survey, System, and Evaluation," IEEE Transactions on Intelligent Transportation Systems, vol. 7, pp. 20-37, 2006.
    [18] C. Mei, G. Sibley, M. Cummins, I. Reid, and P. Newman, " A Constant Time Efficient Stereo SLAM System," in British Machine Vision Conference, 2009.
    [19] L. M. Paz, P. Pinies, J. D. Tardos, and J. Neira, "Large-Scale 6-DOF SLAM with Stereo-in-Hand," IEEE Transactions on Robotics, vol. 24, pp. 946-957, 2008.
    [20] P. Pinies, T. Lupton, S. Sukkarieh, and J. D. Tardos, "Inertial Aiding of Inverse Depth SLAM using a Monocular Camera," in IEEE International Conference on Robotics and Automation , pp. 2797-2802, 2007.
    [21] S. Rezaei and R. Sengupta, "Kalman Filter Based Integration of DGPS and Vehicle Sensors for Localization," in IEEE International Conference on Mechatronics and Automatio, vol. 1, pp. 455-460, 2005.
    [22] P. Smith, I. Reid, and A. Davison, "Real-Time Monocular SLAM with Straight Lines," in British Machine Vision Conference, pp. 17-26, 2006.
    [23] H. Strasdat, J. Montiel, and A. J. Davison, "Scale Drift-Aware Large Scale Monocular SLAM," Robotics: Science and Systems, p. 5, 2010.
    [24] Y. J. L. a. S. Sung, "Vision Based SLAM for Mobile Robot Navigation Using Distributed Filters," in Mobile Robots Navigation, 2010.
    [25] T. K. Xia, M. Yang, and R. Q. Yang, "Vision Based Global Localization for Intelligent Vehicles," in IEEE on Intelligent Vehicles Symposium, pp. 571-576, 2006.
    [26] L. Yuqiang, T. Bin, C. Songhang, Z. Fenghua, and W. Kunfeng, "A Survey of Vision-based Vehicle Detection and Tracking Techniques in ITS," in IEEE International Conference on Vehicular Electronics and Safety (ICVES), pp. 72-77, 2013.
    [27] L. Zhao, W. Y. Ochieng, M. A. Quddus, and R. B. Noland, "An Extended Kalman Filter Algorithm for Integrating GPS and Low Cost Dead Reckoning System Data for Vehicle Performance and Emissions Monitoring," The Journal of Navigation, vol. 56, pp. 257-275, 2003.
    [28] 唐世銘, "交互多模型定位演算法實現於車輛導航之研究," 電機工程學系碩士論文, 國立成功大學, 2012.

    下載圖示 校內:2017-08-19公開
    校外:2017-08-19公開
    QR CODE