簡易檢索 / 詳目顯示

研究生: 葉保宏
Yeh, Pao-Hung
論文名稱: 基於立體視覺之行人距離量測
Pedestrian Distance Measurement Based on Stereo Vision
指導教授: 王大中
Wang, Ta-Chung
學位類別: 碩士
Master
系所名稱: 工學院 - 航空太空工程學系
Department of Aeronautics & Astronautics
論文出版年: 2015
畢業學年度: 103
語文別: 英文
論文頁數: 63
中文關鍵詞: 立體視覺行人偵測距離量測
外文關鍵詞: Stereo vision, Pedestrian detection, Distance measurement
相關次數: 點閱:87下載:3
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 隨著科技的發展,電腦視覺已廣泛應用到許多日常生活中,例如人臉辨識和障礙物閃避。本論文則使用立體視覺之原理對目標物做距離量測,首先會先對兩台攝影機做校正得到相機的內外參數,再利用兩台攝影機在相同場景下取得兩張影像,但由於利用人工調整的兩台攝影機不一定會在同一水平面上,因此我們會先利用相機的內外參數去校正影像使兩張影像的對應點是水平的,最後我們會利用Oriented FAST and Rotated BRIEF (ORB)特徵點演算法,計算兩張影像的對應點和視差並求出攝影機與目標物的距離。本論文主要提出兩種距離量測系統,一個系統是對兩張影像手動選取目標物做立體匹配得到距離,另一個系統則是利用Histogram of Oriented Gradient (HOG)特徵點結合Support Vector Machine (SVM)去訓練行人偵測分類器,利用此分類器在兩張影像自動偵測行人,再用ORB特徵點去對行人的區域去做立體匹配得到距離。另外我們也重新修正原本的距離公式並與原公式去做比較。而本文的成果可以為車輛避撞系統對行人的識別與警示。

    With the development of technology, computer vision is now widely applied in daily life, in applications such as face recognition and obstacle avoidance. In this thesis, we use the principles of stereo vision to measure distance. Firstly, we calibrate two cameras to obtain the intrinsic and extrinsic parameters, and then we use the two cameras to capture images of the same scene. However, the two cameras are not necessarily on the same horizontal level, and thus we would use intrinsic and extrinsic parameters to rectify the images so that the corresponding points of two images are on the same horizontal level. After that we use the Oriented FAST and Rotated BRIEF (ORB) feature algorithm to obtain the corresponding points and calculate disparity and distance. This thesis proposes two distance measurement systems. One manually select objects from two images. The other system combines the concept of a Histogram of Oriented Gradient (HOG) and Support Vector Machine (SVM) to train a pedestrian classifier. We use the classifier to detect pedestrians in two images automatically, and then we use the ORB features to calculate the disparity and distance in the pedestrian region. In addition, we revise the original distance formula to compare with the existing distance formula. The results of this research can be used to avoid collisions with pedestrians.

    摘要 I ABSTRACT II 誌謝 III CONTENTS IV LIST OF FIGURES VII LIST OF TABLES IX CHAPTER 1 INTRODUCTION 1 1.1 Motivation 1 1.2 Literature Review 2 1.3 Outline of This Research 5 CHAPTER 2 COMPUTER VISION 6 2.1 Projective Geometry 6 2.2 Image Coordinate System and World Coordinate System 7 2.3 Camera Calibration 10 2.4 Stereo Vision 12 2.5 Revised Algorithm 13 2.6 Epipolar Geometry 15 2.7 Fundamental Matrix 16 2.8 Image Rectification 18 CHAPTER 3 PEDESTRIAN DETECTION SYSTEM 21 3.1 Histogram of Oriented Gradient 22 3.2 Integral Image 26 3.3 Support Vector Machine 28 CHAPTER 4 STEREO MATCHING & SYSTEM FRAME 33 4.1 ORB: Oriented FAST and Rotated BRIEF 33 4.1.1 Oriented FAST Keypoint 33 4.1.2 Rotated BRIEF 35 4.1.3 Matching the Keypoints 38 4.2 Set Image ROI 39 4.3 The Distance Measurement System 40 4.4 Pedestrian Distance Measurement System 41 CHAPTER 5 EXPERIMENT RESULTS 43 5.1 Pedestrian Detection Classifier 43 5.2 Experiment Hardware 49 5.3 Experiment Setup 51 5.4 Experiment Results 51 5.5 Discussion 58 CHAPTER 6 CONCLUSION 60 REFERENCES 61

    [1] T. Kanade, A. Yoshida, K. Oda, H. Kano, and M. Tanaka, "A stereo machine for video-rate dense depth mapping and its new applications," in Computer Vision and Pattern Recognition, 1996. Proceedings CVPR'96, 1996 IEEE Computer Society Conference on, 1996, pp. 196-202.
    [2] A. Carullo and M. Parvis, "An ultrasonic sensor for distance measurement in automotive applications," IEEE Sensors journal, vol. 1, 2001, pp. 143-147.
    [3] J. Wang, F. Gao, S. Shi, and J. Wang, "A new method for distance and relative velocity measurement in vehicle collision warning system," in Intelligent Systems Design and Applications, 2006. ISDA'06. Sixth International Conference on, 2006, pp. 1142-1147.
    [4] K. Konolige, "Small vision systems: Hardware and implementation," in Robotics Research, ed: Springer, 1998, pp. 203-212.
    [5] L. Iocchi, "Stereo Vision: Triangulation," in Dipartimento di Informatica e Sistemistica Universita di Roma, 2002.
    [6] K. A. Rahman, M. S. Hossain, M. A.-A. Bhuiyan, T. Zhang, M. Hasanuzzaman, and H. Ueno, "Person to Camera Distance Measurement Based on Eye-Distance," in Multimedia and Ubiquitous Engineering, 2009. MUE'09. Third International Conference on, 2009, pp. 137-141.
    [7] K. Muljowidodo, M. A. Rasyid, N. SaptoAdi, and A. Budiyono, "Vision based distance measurement system using single laser pointer design for underwater vehicle," Indian journal of marine science, vol. 38, 2009, pp. 324-331.
    [8] A.-L. Hou, C. Xue, G. Ying, Y. Wen-Ju, and H. Jie, "Measurement of safe driving distance based on stereo vision," in Image and Graphics (ICIG), 2011 Sixth International Conference on, 2011, pp. 902-907.
    [9] T. S. Hsu and T. C. Wang, "An Improved Stereo Vision Image Processing for Object Distance Measurement," in The 12th International Conference on Automation Technology, 2013.
    [10] C. Papageorgiou and T. Poggio, "A trainable system for object detection," International Journal of Computer Vision, vol. 38, 2000, pp. 15-33.
    [11] P. Viola, M. J. Jones, and D. Snow, "Detecting pedestrians using patterns of motion and appearance," in Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, 2003, pp. 734-741.
    [12] K. Mikolajczyk, C. Schmid, and A. Zisserman, "Human detection based on a probabilistic assembly of robust part detectors," in Computer Vision-ECCV 2004, ed: Springer, 2004, pp. 69-82.
    [13] N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, 2005, pp. 886-893.
    [14] 廖彥法, "立體影像於物件幾何重建之研究," 成功大學航空太空工程學系學位論文, 2005.
    [15] R. Y. Tsai, "A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses," Robotics and Automation, IEEE Journal of, vol. 3, 1987, pp. 323-344.
    [16] Z. Zhang, "Flexible camera calibration by viewing a plane from unknown orientations," in Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, 1999, pp. 666-673.
    [17] C. Loop and Z. Zhang, "Computing rectifying homographies for stereo vision," in Computer Vision and Pattern Recognition, 1999. IEEE Computer Society Conference on, 1999.
    [18] P. Viola and M. Jones, "Robust real-time object detection," International Journal of Computer Vision, vol. 4, 2001, pp. 51-52.
    [19] P. Viola and M. J. Jones, "Robust real-time face detection," International journal of computer vision, vol. 57, 2004, pp. 137-154.
    [20] Q. Zhu, M.-C. Yeh, K.-T. Cheng, and S. Avidan, "Fast human detection using a cascade of histograms of oriented gradients," in Computer Vision and Pattern Recognition, 2006 IEEE Computer Society Conference on, 2006, pp. 1491-1498.
    [21] V. N. Vapnik, "An overview of statistical learning theory," Neural Networks, IEEE Transactions on, vol. 10, 1999, pp. 988-999.
    [22] D. G. Lowe, "Distinctive image features from scale-invariant keypoints," International journal of computer vision, vol. 60, 2004, pp. 91-110.
    [23] E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: an efficient alternative to SIFT or SURF," in Computer Vision (ICCV), 2011 IEEE International Conference on, 2011, pp. 2564-2571.
    [24] E. Rosten and T. Drummond, "Machine learning for high-speed corner detection," in Computer Vision–ECCV 2006, ed: Springer, 2006, pp. 430-443.
    [25] P. L. Rosin, "Measuring corner properties," Computer Vision and Image Understanding, vol. 73, 1999, pp. 291-307.
    [26] M. Calonder, V. Lepetit, C. Strecha, and P. Fua, "Brief: Binary robust independent elementary features," Computer Vision–ECCV 2010, 2010, pp. 778-792.
    [27] National Institute for Research in Computer Science and Control, INRIA Peroson Dataset, available in March 2015 from website:
    http://pascal.inrialpes.fr/data/human/
    [28] I. P. Alonso, D. F. Llorca, M. Á. Sotelo, L. M. Bergasa, P. R. De Toro, J. Nuevo, et al., "Combination of feature extraction methods for SVM pedestrian detection," Intelligent Transportation Systems, IEEE Transactions on, vol. 8, 2007, pp. 292-307.
    [29] Y. M. Mustafah, R. Noor, and H. Hasbi, "Stereo Vision Images Processing for Real-Time Object Distance and Size Measurements," in International Conference on Computer and Communication Engineering, Malaysia, 2012.
    [30] J. C. Cheng and S. J. Feng, "A Real-Time Multiresolutional Stereo Matching Algorithm," in IEEE International Conference on Image Processing, Italy, 2005, pp. 373-376.
    [31] A. Fusiello, V. Roberto, and E. Trucco, "Efficient Stereo with Multiple Windowing," in IEEE Computer Society Conference on Computer Vision and Pattern Recognitio, Puerto Rico, 1997, pp. 858-863.
    [32] D. M. Gavrila and J. Giebel, "Shape-based pedestrian detection and tracking," in Intelligent Vehicle Symposium, 2002. IEEE, 2002, pp. 8-14.
    [33] S. Liu, Y. Luo, and S. Yang, "Shape-based pedestrian detection in infrared images," Journal of information science and engineering, vol. 23, 2007, pp. 271-283.

    下載圖示 校內:2016-08-13公開
    校外:2017-08-13公開
    QR CODE