簡易檢索 / 詳目顯示

研究生: 吳琬蓉
Wu, Wan-Jung
論文名稱: 基於Kinect及運動學實現模仿機器人
Realization of the Imitation Robot Based on Kinect and Kinematics
指導教授: 廖德祿
Liao, Teh-Lu
學位類別: 碩士
Master
系所名稱: 工學院 - 工程科學系
Department of Engineering Science
論文出版年: 2016
畢業學年度: 104
語文別: 英文
論文頁數: 54
中文關鍵詞: Kinect 感測器人形機器人運動學骨架擷取
外文關鍵詞: Kinect Sensor, Humanoid Robot, Kinematics, Skeleton Capture
相關次數: 點閱:82下載:1
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在現今的領域中,機器人的應用極為廣泛,隨著科技的發展,機器人已逐漸取代人類從事一些重複性、危險性及粗重的工作,如拆除爆裂物或海底探勘等等。此類工作若由機器人來代替,可減少或避免造成一些不必要的傷亡,因此本論文主要目的是透過簡易的人機互動,來達到機器人控制,以利於完成指定的動作,協助進行困難度或危險性相對較高之工作問題解決。而在現今經濟蕭條的情況下,許多產業也都希望在成本部分能夠盡量減少,因此本論文也期望能夠以盡量低廉的成本,實現能夠達成模仿效果的系統架構。而因微軟公司推出的Xbox360遊戲機體感周邊Kinect感測器,其成本低廉且具有強大的影像識別函式庫,大幅降低影像識別應用成本,因此本論文選用Kinect感測器搭配16軸人形機器人RoboBuilder,建構一套價格較為低廉的互動式模仿系統。
    本論文內容主要分成Kinect感測器、軟體介面與運動學演算法計算關節角度三大部分,在軟體介面部分使用Microsoft Visual Studio 2012平台的開發介面C sharp(C#),搭配Kinect官方所提供的軟體開發套件Kinect for Windows SDK來進行開發。而在演算法的部分,則是使用反向運動學中的幾何解法來進行計算,以降低其運算時間,達到即時動作模仿的效果。本研究使用Kinect感測器擷取人體骨架資訊,經過演算法計算出各個關節的轉換角度,傳送給機器人的伺服馬達,使其做出對應之動作。由實驗結果顯示,本研究建構之系統,可達到視覺上即時模仿動作的效果。

    In the field these days, the robot application is extremely broad. With the development of science and technology, the robot has gradually replaced humans in repetitive, dangerous and heavy work, such as demolition explosives or seabed mining, and so on. If this kind of the works is replaced by a robot, you can reduce or avoid unnecessary casualties. Therefore, the main purpose of this thesis is through simple human-machine interaction to achieve the robot control, in order to facilitate the completion of the specified action to assist in the degree of difficulty or the relatively high risk of problem-solving work. In the case of the current recession, many industries also want to minimize the cost component, so this thesis is also desirable to be able to maximize low costs to reach the system structure of imitation. However, Microsoft launched Xbox360 somatosensory peripheral Kinect sensor, its low cost and a powerful image recognition library dramatically reduce the cost of image recognition applications. This thesis will select Kinect sensor with 16 degree of freedom (DOF) humanoid robot RoboBuilder to construct a less expensive system of the imitation.
    The content of the thesis is consisted of three parts including the Kinect sensor, the software interface, and calculating the joint angle by kinematics algorithms. As for the software interface, we use the C# of Microsoft Visual Studio 2012 with an official Kinect Software Development Kit (Kinect for Windows SDK) to develop the software interface. In the part of algorithms, inverse geometric kinematics is utilized to reduce the computational time to achieve the immediate imitation. In this study, we apply with Kinect sensor to capture human skeleton information, through the proposed algorithm to calculate the angle of each joint and then the corresponding control signal to the robot servo motor to make the corresponding operation. From the experimental results, it shows that the proposed system can immediately achieve the visual effect of imitation.

    摘要 I Abstract III 誌謝 V Contents VI List of Figures VIII List of Tables X Chapter 1 Introduction 1 1.1 Background 1 1.2 Motivation 2 1.3 Thesis Organization 3 CHAPTER 2 FUNDAMENTAL KNOWLEDGE 4 2.1 Kinect Sensor 4 2.1.1 Hardware Components and Specifications of Kinect Sensor 4 2.1.2 The Sensor Core and Depth Information Measurement of Kinect 7 2.1.3 Skeleton Tracking System 9 2.2 Kinect Development Tools 11 2.2.1 Kinect SDK Hardware and Software Requirements and Structure 12 2.3 RoboBuilder 14 2.3.1 Introduction of Intelligent Servo 17 CHAPTER 3 SYSTEM DESIGN AND ARCHITECTURE 20 3.1 System Architecture 20 3.2 The Algorithms of Motion Capture 23 3.2.1 Robot Servo Angle Conversion 35 CHAPTER 4 EXPERIMENTAL RESULTS 38 4.1 System Platform Introduction 38 4.2 Operation Display User Interface 39 4.3 Implementation and Its Verification 40 CHAPTER 5 CONCLUSION AND FUTURE WORK 49 5.1 Conclusion 49 5.2 Future Work 50 REFERENCES 52

    [1] Hartmut Surmann, Andreas Nüchter, Joachim Hertzberg, “An Autonomous Mobile Robot with a 3D laser Range Finder for 3D Exploration and Digitalization of Indoor Environments,” Robotics and Autonomous Systems, vol. 45, pp. 181-198, 2003
    [2] Reid G. Simmons, David Apfelbaum, Wolfram Burgard, Dieter Fox, Mark Moors, Sebastian Thrun, Håkan L. S. Younes, “Coordination for Multi-Robot Exploration and Mapping,” in AAAI/IAAI, pp. 852-858, 2000
    [3] Wolfram Burgard, Mark Moors, Cyrill Stachniss, Frank Schneider, “Collaborative Multi-Robot Exploration,” in Robotics and Automation, 2000. Proceedings. ICRA'00. IEEE International Conference on, pp. 476-481, 2000
    [4] “Industry 4.0,” https://en.wikipedia.org/wiki/Industry_4.0
    [5] Leo Kelion, “Toshiba's Robot is Designed to be More Human-Like,” BBC NEWS, http://www.bbc.com/news/technology-35763917
    [6] Kinect for windows team, “Starting February 1, 2012: Use the Power of Kinect for Windows to Change the World,” Microsoft, USA, 2012
    [7] Microsoft Developer Network, https://msdn.microsoft.com/zh-tw/library/jj131033.aspx
    [8] New Florence. New Renaissance. , “PrimeSense: The magic behind the Kinect,” http://florence20.typepad.com/renaissance/2010/12/primesense-the-magic-behind-the-kinect.html
    [9] RoboBuilder, http://rqworld.com/eng/
    [10] RoboBuilder User’s Guide, Available: https://robosavvy.com/RoboSavvyPages/Robobuilder/UsersManual/Robobuilder_User_Guide_EN.pdf

    [11] RoboBuilder Creator User’s Manual, Available: https://robosavvy.com/RoboSavvyPages/Robobuilder/robobuilder-creator-users-manual.pdf
    [12] Abdul Muis, Wisnu Indrajit, “Realistic Human Motion Preservation-Imitation Development on Robot with Kinect,” TELKOMNIKA, vol. 10, pp. 599-608, 2012
    [13] Mohammed Z. Al-Faiz, Ahmed F. Shanta, “Kinect-Based Humanoid Robotic Manipulator for Human Upper Limbs Movements Tracking,” Intelligent Control and Automation, vol. 6, pp. 29-37, 2015
    [14] Van Vuong Nguyen, Joo-Ho Lee, “Full-Body Imitation of Human Motions with Kinect and Heterogeneous Kinematic Structure of Humanoid Robot,” 2012 IEEE/SICE International Symposium on System Integration, pp. 93-98, 2012
    [15] Fernando Zuher, Roseli Romero, “Recognition of Human Motions for Imitation and Control of a Humanoid Robot,” 2012 Brazilian Robotics Symposium and Latin American Robotics Symposium, pp. 190-195, 2012
    [16] Liying Cheng, Qi Sun, Han Su, Yang Cong, Shuying Zhao, “Design and Implementation of Human-Robot Interactive Demonstration System Based on Kinect,” 2012 24th Chinese Control and Decision Conference (CCDC), pp. 971-975, 2012
    [17] Wisnu Indrajit, Abdul Muis, “Development of Whole Body Motion Imitation in Humanoid Robot,” 2013 IEEE International Conference on Quality in Research, pp. 138-141, 2013
    [18] Suk Jin Lee, Ross Mead, Maja J Matarić, “Orientation Invariant Human Joint Angle Estimation Using Vector Calculus,” University of Southern California Los Angeles, 2011
    [19] Ismail Almetwally, Malik Mallem, “Real-Time Tele-Operation and Tele-Walking of Humanoid Robot Nao Using Kinect Depth Camera,” 2013 10th IEEE International Conference on Networking, Sensing and Control (ICNSC), pp. 463-466, 2013
    [20] Rustam Rakhimov Igorevich, Eldor Primov Ismoilovich, Dugki Min, “Behavioral Synchronization of Human and Humanoid Robot,” 2011 8th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), pp. 655-660, 2011
    [21] 氣象部落客勞倫斯,“身體就是控制器,微軟Kinect是怎麼做到的?,”T客邦,http://www.techbang.com/posts/2936-get-to-know-how-it-works-kinect
    [22] 天下雜誌,“奔向工業4.0,富士康昆山廠一半工人換成機器人,”天下雜誌, http://www.cw.com.tw/article/article.action?id=5067853
    [23] 科技報導,“臺灣機器人產業現況與未來展望,”科技報導, http://scitechreports.blogspot.tw/2014/03/blog-post_28.html
    [24] 劉超群,“Kinect體感程式探索-使用c#,”松崗資產管理股份有限公司,2013年2月初版
    [25] David Catuhe,“寫給專業開發者用的Windows Kinect SDK技術手冊,”博碩文化股份有限公司,2013年5月初版

    無法下載圖示 校內:2021-07-08公開
    校外:不公開
    電子論文尚未授權公開,紙本請查館藏目錄
    QR CODE