簡易檢索 / 詳目顯示

研究生: 王健權
Wang, Chien-Chuan
論文名稱: 以數位影像處理搭配動態攝影機做 即時人臉追蹤之研究
The Study on Real-Time Human Face Tracking by the Technology of Digital Image Processing with Active Camera
指導教授: 毛齊武
Mao, Chi-Wu
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電機工程學系
Department of Electrical Engineering
論文出版年: 2002
畢業學年度: 90
語文別: 中文
論文頁數: 43
中文關鍵詞: 橢圓形頭部追蹤動態攝影機膚色分析
外文關鍵詞: active camera, elliptical head tracker, skin color
相關次數: 點閱:188下載:24
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 近來影像技術因電腦效能的提昇,其運用越來越廣泛,尤其以視訊會議系統、人臉辨識、機械視覺多有研究,本論文特以影像處理技術搭配動態攝影機作臉部追蹤的研究。
    在以往的相關研究中多以靜止的攝影機和固定的背景來做追蹤。而我們的研究,是改以動態的攝影機來做人臉的追蹤,並以影像作為系統的回授,修正攝影機的位置。在處理過程中,我們使用膚色(Skin-Color)將人臉從複雜的背景中分離出來,再配合數位影像處理的技巧,找出人臉的所在區域。最後以簡單而快速的橢圓形頭部追蹤演算法,找出人臉的位置,並以此位置來控制馬達的轉動。轉動時,我們設定馬達的轉動機制,讓攝影機所擷取的畫面能更加穩定。目標若超出範圍或消失,馬達將自動的轉回起始位置重新追蹤。使用動態的攝影機追蹤移動中的人臉,目的在於增加攝影機的可視角度,使移動的人臉始終維持在影像的中心位置。

    Recently, the technology of image process is greatly improved owing to the high upgrade of computers. The technology can be applied in a variety of applications, such as teleconference, the face recognition and machine vision. For this reason, we study the human face tracking with active camera.
    The early relevant researches are limited to static camera and stationary background. In our study, we trace by active camera the human face, as well as the face position in the image which served as the feedback control to revolve motors guiding the camera to correct position. In the process, we use the technology of Skin-Color analysis to segment the human face from complicated background and we also use the technology of digital image processing to find the region of the human face. In the end, we use a simple algorithm to trace the human face by elliptical head tracker to find the position of the face and then to control the motor. We set the rules of motor control in order to stabilize the frames taken by the camera. If the target goes beyond the scope of tracing range or misses from the frame, the motors will turn round to default position and restart the tracing. For the purpose of increasing the angle of view, the active camera is used to trace the moving human face, so that the moving human face always stays around the center of images.

    目錄 中文摘要 I 英文摘要 II 誌謝 III 目錄 IV 圖目錄 VI 第一章 序論 1 1.1 前言 1 1.2 研究目的 3 第二章 臉部追蹤之概略 4 2.1 簡介 4 2.2 人臉特徵判別 4 2.2.1 顏色分割(color segmentation) 4 2.2.2 動態的偵側 6 2.2.3 外形分析 7 2.2.4 立體影像 7 2.3 臉部特徵與判別方式 8 2.4 人臉偵測於靜態影像 9 2.5 人臉偵測及追蹤於動態影像 10 2.6 方向的判定 13 2.7 討論 15 第三章 臉部之追蹤 16 3.1 簡介 17 3.2 影像的前處理(preprocessing) 17 3.2.1 Skin Color分析 18 3.2.2 Binary Morphologic處理 19 3.2.3 Convex Hull 21 3.3 搜尋區域的設定 22 3.4 橢圓形頭部追蹤(Elliptical Head Tracker) 23 3.5 分析與結果 25 第四章 系統硬體 27 4.1 系統簡介 27 4.2 串列通訊 27 4.3 Altera及系統電路簡介 29 4.4 訊號處理 34 4.5 平台的設計 35 4.5.1平台轉動 35 4.5.2鏡心位置 36 4.5.3轉動限制 37 4.6 分析與結果 39 第五章 系統架構分析與結果討論 40 5.1 系統架構分析 40 5.2 結果討論 41 第六章 未來展望 43 參考資料 44 自述 46

    [1] Rainer Stiefelhagen, Jie Yang, Alex Waibel, “Tracking Eyes and Monitoring Eye Gaze”,
    Workshop on Perceptual User Interfaces, Banff, Canada
    [2] A.W.Senior " Recognizing faces in broadcast video ", Recognition, Analysis, and Tracking of Faces and
    Gestures in Real-Time Systems, 1999. Proceedings. International Workshop on , 1999 , Page(s): 105 -110
    [3] C.Kervrann, F.Davoine, P.Perez, R.Forchheimer, C.Labit ,“Generalized likelihood ratio-based face detection
    and extraction of mouth features”, Pattern Recognition Letters 18, 1997 , 899-912
    [4] Chun-Hung Lin; Ja-Ling Wu, ”Automatic facial feature extraction by genetic algorithms”,
    Image Processing, IEEE Transactions on Volume: 8 6 , June 1999 , Page(s): 834 –845
    [5] Bakic, V.; Stockman, G.,”Real-time tracking of face features and gaze direction determination”, Bakic, V.;
    Stockman, G. Applications of Computer Vision, 1998. WACV '98. Proceedings., Fourth IEEE Workshop
    on , 1998 , Page(s): 256 –257
    [6] B. Schiele and A. Wailbul. “Gaze Tracking Based on Face Color.”
    IWAGFR’95 International Workshop on Face and Gesture Recognition, Zurich, July 1995.
    [7] M. Irani and P. Anandan. “Video Indexing Based on Mosaic Representations. ”,
    Proceedings of IEEE, May 1998.
    [8] F.Preteux, M.Malciu, "Model-based head tracking and 3D pose estimation", Proceedings SPIE
    Conference on Mathematical Modeling and Estimation Techniques in Computer Vision, San Diego,
    CA, Vol. 3457, July 1998, pp. 94-110.
    [9] Simon Rowe, A.Blake, "Statistical Mosaics For Tracking",
    Department of Engineering Science, Oxford
    [10] Sobottka, K.; Pitas, I. “Face localization and facial feature extraction based on shape and
    Color information”, Image Processing, 1996. Proceedings., International Conference
    on Volume: 3 , 1996 , Page(s): 483 -486 vol.3
    [11] Matsumoto, Y.; Zelinsky, A., “Real-time Stereo Face Tracking for Visual Human Interfaces”,
    Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, 1999. Proceedings.
    International Workshop on , 1999 , Page(s): 77 –82
    [12] X. Xie; Sudhakar, R.; Hanqi Zhuang ,"Real-time eye feature tracking from a video
    image sequence using Kalman filter ", Systems, Man and Cybernetics, IEEE Transactions
    on Volume: 25 12 , Dec. 1995 , Page(s): 1568 -1577
    [13] X. Xie, R. Sudhakar, H.Zhuang, "A cascaded Scheme for Tracking and Head Movement
    Compensation", IEEE TRANSCATIONS ON SYSTEMS, MAN, AND
    CYBERNETICS-PART A: SYSTEMS AND HUMANS, VOL. 28, NO. 4, JULY 1998
    [14] Zhang Xin; Xu Yanjun; Du Limin, “Locating facial features with color information”, Signal
    Processing Proceedings, 1998. ICSP '98. 1998 Fourth International Conference on Volume: 2 , 1998 ,
    Page(s): 889 -892 vol.2
    [15] Wu, H.; Yokoyama, T.; Pramadihanto, D.; Yachida, M. “Face and facial feature extraction
    from color image”, Automatic Face and Gesture Recognition, 1996., Proceedings of the
    Second International Conference on , 1996 , Page(s): 345 –350
    [16] Beardsley, P.A., “A qualitative approach to classifying gaze direction”,
    Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE International Conference on ,
    1998 , Page(s): 160 –165
    [17] F.Preteux, M.Malciu, "Model-based head tracking and 3D pose estimation", Proceedings SPIE
    Conference on Mathematical Modeling and Estimation Techniques in Computer Vision, San Diego,
    CA, Vol. 3457, July 1998, pp. 94-110.
    [18] Rowley, H.A.; Baluja, S.; Kanade,T, ”Rotation invariant neural network-based face detection”,
    Computer Vision and Pattern Recognition, 1998. Proceedings. 1998 IEEE Computer Society Conference
    on, 1998, Page(s): 38 –44
    [19] K. Choong Yow,R. Cipolla, :"Feature-Based Human Face Detection",
    Department of Engineering, Cambridge
    [20] S. Birchfield. "Elliptical Head Tracking Using Intensity Gradients and Color Histograms",
    In IEEE Conf. on computer Vision and Pattern Recognitions, Santa Barara, California, June 1998
    [21] S. Birchfield." An elliptical head tracker", In Proc. Of the 31st Asilomar Conf. On Signal, Systems
    and Computers, 1997
    [22] Baumberg, A.M.; Hogg, D.C." An efficient method for contour tracking using active shape models",
    Motion of Non-Rigid and Articulated Objects, 1994., Proceedings of the 1994 IEEE Workshop on , 1994 ,
    Page(s): 194 –199
    [23] A. H. Gee and R. Cipolla ,“Fast Visual Tracking by Temporal consensus", CUED/F-INFENG/TR
    207 February 1995
    [24] Thanarat Horprasert, Yaser Yacoob, and Larry S. Davis, "An Anthropometric Shape Model
    for Estimating Head Orientation", 3rd International Workshop on Visual Form, Capri,
    Italy, May 1997.
    [25] K. Toyama and G.Haga. "Incremental focus of attention for robust visual tracking.", IN Computer
    Vision and Patt. Recog., pages 189-195,1996
    [26] R. Weeks, Jr. "Fundamentals of Electronic image Processing", BOOK, IEEE PRESS, 1996
    [27] J. Sullivan, A. Blake, M. Isard and J. MaCormick. "Object Localization by Bayesian Correlation",
    Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on Volume:
    2 , 1999 , Page(s): 1068 -1075 vol.2
    [28] Saeed Shiry Ghidary, Yasushi Nakata, Toshi Takamori, Motofumi Hattori,
    "Head and Face Detection at Indoor Environment by Home robot",
    8th Iranian Electrical Engineering Conference, ICEE2000, Isfahan,Iran,May2000
    [29] A. Blake, A. Yulille. "Active Vision". Book , The MIT Press
    [30] Baumberg, A.M.; Hogg, D.C." An efficient method for contour tracking using active shape models",
    Motion of Non-Rigid and Articulated Objects, 1994., Proceedings of the 1994 IEEE Workshop on , 1994 ,
    Page(s): 194 –199
    [31] 譚永恆, "以數位影像技術做㆟臉自動追蹤系統之研究", 國立成功大學碩士論文, 2000

    下載圖示 校內:立即公開
    校外:2002-06-18公開
    QR CODE