簡易檢索 / 詳目顯示

研究生: 江宗錡
Chiang, Tsung-Chi
論文名稱: 六軸關節型機械手臂之手眼校正研究
Study on Hand Eye Calibration of Six-Axis Articulated Robot
指導教授: 鄭銘揚
Cheng, Ming-Yang
學位類別: 碩士
Master
系所名稱: 電機資訊學院 - 電機工程學系
Department of Electrical Engineering
論文出版年: 2014
畢業學年度: 102
語文別: 中文
論文頁數: 66
中文關鍵詞: 眼在手架構手眼校正機器視覺封閉形式轉換矩陣方程式
外文關鍵詞: Eye-in-Hand, Hand-Eye Calibration, Machine Vision, Closed-Form Transformation Matrix Equation
相關次數: 點閱:142下載:13
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 自動化產線於現今工業製造場合中已相當普遍。另一方面,為了適應變化快速的產品供應需求,機器人之智能勢必非提升不可,其中整合機器視覺於機械手臂系統尤其關鍵。若機械手臂系統採用眼在手架構,亦即攝影機架設於機械手臂末端點時,可減輕系統對於工作空間與硬體之依賴程度。此類架構目前廣泛應用於三維機器視覺視覺、物件夾取擺放等,然而其操作精度取決於攝影機座標系相對於機械手臂末端點座標系之轉換關係(即手眼關係)是否準確,而求取手眼關係之過程稱為手眼校正。ㄧ般而言,手眼校正過程需移動機械手臂末端點至不同姿態,並且記錄不同姿態下機械手臂末端點座標系相對於機械手臂基底座標系轉換關係以及攝影機外部參數,並以封閉形式轉換矩陣方程式求解,因此必須考量攝影機參數校正和機器人運動學。不言可喻的,若上述之攝影機或機械手臂參數含有高度不確定性,則手眼校正之可靠性及精度將大幅降低,連帶影響機械手臂操作精度。因此,本論文針對此議題進行深入探討,於未經過高精度設備校正過之機械手臂進行手眼校正,以分析不確定因素如機械手臂原點復歸正確與否對於手眼校正準確性所造成之影響。本論文引入雷射水平儀進行原點復歸校正並探討校正前後手眼校正精度之差異。另外並針對最佳化演算法參數調整、轉換矩陣方程式中旋轉矩陣描述方式及平移向量於目標函數中的單位、機械手臂姿態數目多寡等因素進行實驗並討論。本論文將誤差較大之姿態過濾後再次進行手眼校正以提升校正精度,實驗結果顯示本論文所提出之手眼校正方法性能良好。

    SUMMARY
    Automatic production lines are commonly seen in modern manufacturing. On the other hand, in order to adapt to rapid changes in the product supply chain, robot intelligence must be elevated to a higher level. In particular, incorporating machine vision into a robot manipulator system is crucial. If the eye-in-hand camera configuration is adopted, i.e. the camera is mounted on the end-effector, the degree of dependence on hardware/workspace for an industrial manipulator can be much reduced. In fact, this kind of camera configuration is extensively adopted in fields such as 3D machine vision, object grasping, pick-and-place, etc. However, the precision of the industrial manipulator that adopts eye-in-hand camera configuration depends on the accuracy of the transformation between the camera coordinate system and the end-effector coordinate system that is often called “hand-eye relation”. Hand-eye calibration is the process for solving the hand-eye relation. Generally, the end-effector of the manipulator will be moved to different poses during the hand-eye calibration process. The transformation matrices between the end-effector coordinate system and the base coordinate system and extrinsic camera parameters at different poses will be recorded. Based on these recorded data at different poses, the closed-form transformation matrix equation is used to solve the hand-eye transformation matrix. Clearly, the hand-eye calibration process involves camera parameter calibration and robot kinematics. If there are uncertainties in camera and robot kinematic parameters, the reliability and accuracy of hand-eye calibration will be significantly decreased so that the precision of the manipulator will be affected as well. As a result, this thesis conducts an in-depth study on the aforementioned problem. In particular, the hand-eye calibration is implemented with an industrial manipulator which has not been accurately calibrated by a high precision device so as to analyze the effect caused by uncertainty upon hand-eye calibration. The accuracy of home point return could affect the result of hand-eye calibration. One laser line level will be adopted to perform home point return, and the difference in before-and-after results will be compared. This thesis conducts several experiments and also discusses issues such as the parameter adjustment of the optimization algorithm, different types of representation of rotation matrix, unit of the translation vector in the object function, and the number of different poses used in the calibration process. After discarding the poses that leads to large calibration error, the calibration process is performed again to obtain better hand-eye calibration accuracy. Experimental results indicate that the proposed hand-eye calibration method exhibits satisfactory performance.

    目錄 中文摘要 I EXTENDED ABSTRACT II 誌謝 X 目錄 XI 表目錄 XIII 圖目錄 XV 第一章 緒論 1 1.1 前言 1 1.2 研究動機與目的 2 1.3 文獻回顧 4 1.4 本文架構 7 第二章 手眼校正介紹 8 2.1 三維空間轉換矩陣 8 2.2 攝影機內外部參數 10 2.3 機械手臂順向運動學 13 2.4 眼在手手眼校正架構 14 2.5 封閉形式轉換矩陣方程式 17 2.6 封閉形式轉換矩陣方程式解法 18 第三章 手眼校正精確度探討 22 3.1 驗證方法 22 3.2 實驗一:調整旋轉矩陣及平移向量單位 26 3.3 實驗二:調整最佳化演算法疊代方式 32 3.4 實驗三:機械手臂原點復歸校正影響之分析 34 3.5 實驗四:手眼校正姿態數目 38 3.6 實驗五:篩選式手眼校正 40 第四章 實驗設備與實驗結果 44 4.1 實驗場景 44 4.2 實驗設備 46 4.3 實驗流程 52 4.4 實驗結果 54 第五章 結論與建議 59 5.1 結論 59 5.2 未來工作與建議 60 參考文獻 62

    參考文獻
    [1] M. Shah, R. D. Eastman, and T. Hong, "An overview of robot-sensor calibration methods for evaluation of perception systems," in Proceedings of the Workshop on Performance Metrics for Intelligent Systems, 2012, pp. 15-20.
    [2] F. Dornaika and R. Horaud, "Simultaneous robot-world and hand-eye calibration," IEEE Transactions on Robotics and Automation, vol. 14, pp. 617-622, Aug 1998.
    [3] R. Y. Tsai and R. K. Lenz, "Real time versatile robotics hand/eye calibration using 3D machine vision," in Proceedings of IEEE International Conference on Robotics and Automation, 1988, pp. 554-561.
    [4] E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, and P. Sayd, "Real time localization and 3d reconstruction," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 363-370.
    [5] S. Avidan and A. Shashua, "Trajectory triangulation: 3D reconstruction of moving points from a monocular image sequence," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, pp. 348-357, 2000.
    [6] S.-K. Chang and Y. Wang, "Three-dimensional object reconstruction from orthogonal projections," Pattern Recognition, vol. 7, pp. 167-176, 1975.
    [7] C. Hernandez Esteban and F. Schmitt, "Multi-stereo 3d object reconstruction," in Proceedings of First International Symposium on 3D Data Processing Visualization and Transmission 2002, pp. 159-166.
    [8] "http://mathworld.wolfram.com/Closed-FormSolution.html."
    [9] Y. Motai and A. Kosaka, "Hand–eye calibration applied to viewpoint selection for robotic vision," IEEE Transactions on Industrial Electronics, vol. 55, pp. 3731-3741, 2008.
    [10] Y. C. Shiu and S. Ahmad, "Calibration of Wrist-Mounted Robotic Sensors by Solving Homogeneous Transform Equations of the Form Ax = Xb," IEEE Transactions on Robotics and Automation, vol. 5, pp. 16-29, Feb 1989.
    [11] J.-S. Hu and Y.-J. Chang, "Calibration of an eye-to-hand system using a laser pointer on hand and planar constraints," in IEEE International Conference on Robotics and Automation (ICRA), 2011, pp. 982-987.
    [12] K. H. Strobl and G. Hirzinger, "Optimal hand-eye calibration," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2006, pp. 4647-4653.
    [13] R. Y. Tsai and R. K. Lenz, "A new technique for fully autonomous and efficient 3D robotics hand/eye calibration," IEEE Transactions on Robotics and Automation, vol. 5, pp. 345-358, 1989.
    [14] A. Malti and J. P. Barreto, "Hand–eye and radial distortion calibration for rigid endoscopes," The International Journal of Medical Robotics and Computer Assisted Surgery, vol. 9, pp. 441-454, 2013.
    [15] J. C. Chou and M. Kamel, "Quaternions approach to solve the kinematic equation of rotation, A a A x= A x A b, of a sensor-mounted robotic manipulator," in Proceedings of IEEE International Conference on Robotics and Automation, 1988, pp. 656-662.
    [16] J. C. Chou and M. Kamel, "Finding the position and orientation of a sensor on a robot manipulator using quaternions," The International Journal of Robotics Research, vol. 10, pp. 240-254, 1991.
    [17] F. C. Park and B. J. Martin, "Robot sensor calibration: solving AX= XB on the Euclidean group," IEEE Transactions on Robotics and Automation, vol. 10, pp. 717-721, 1994.
    [18] T. Ruland, T. Pajdla, and L. Kruger, "Globally optimal hand-eye calibration," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1035-1042.
    [19] H. H. Chen, "A screw motion approach to uniqueness analysis of head-eye geometry," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1991, pp. 145-151.
    [20] H. Zuang and Y. C. Shiu, "A noise-tolerant algorithm for robotic hand-eye calibration with or without sensor orientation measurement," IEEE Transactions on Systems, Man and Cybernetics, vol. 23, pp. 1168-1175, 1993.
    [21] I. Fassi and G. Legnani, "Hand to sensor calibration: A geometrical interpretation of the matrix equation AX= XB," Journal of Robotic Systems, vol. 22, pp. 497-506, 2005.
    [22] G.-Q. Wei, K. Arbter, and G. Hirzinger, "Active self-calibration of robotic eyes and hand-eye relationships with model identification," IEEE Transactions on Robotics and Automation, vol. 14, pp. 158-166, 1998.
    [23] J. Heller, M. Havlena, A. Sugimoto, and T. Pajdla, "Structure-from-motion based hand-eye calibration using L∞ minimization," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 3497-3503.
    [24] S.-J. Kim, M.-H. Jeong, J.-J. Lee, J.-Y. Lee, K.-G. Kim, B.-J. You, et al., "Robot Head-Eye Calibration Using the Minimum Variance Method," in IEEE International Conference on Robotics and Biomimetics (ROBIO), 2010, pp. 1446-1451.
    [25] C.-C. Wang, "Extrinsic calibration of a vision sensor mounted on a robot," Robotics and Automation, IEEE Transactions on, vol. 8, pp. 161-175, 1992.
    [26] H. Zhuang, Z. S. Roth, and R. Sudhakar, "Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation equations of the form AX= YB," Robotics and Automation, IEEE Transactions on, vol. 10, pp. 549-554, 1994.
    [27] A. Li, L. Wang, and D. Wu, "Simultaneous robot-world and hand-eye calibration using dual-quaternions and Kronecker product," Inter. J. Phys. Sci, vol. 5, pp. 1530-1536, 2010.
    [28] M. Shah, "Solving the Robot-World/Hand-Eye Calibration Problem Using the Kronecker Product," Journal of Mechanisms and Robotics, vol. 5, p. 031007, 2013.
    [29] S. Remy, M. Dhome, J.-M. Lavest, and N. Daucher, "Hand-eye calibration," in Intelligent Robots and Systems, 1997. IROS'97., Proceedings of the 1997 IEEE/RSJ International Conference on, 1997, pp. 1057-1065.
    [30] R. L. Hirsh, G. N. DeSouza, and A. C. Kak, "An iterative approach to the hand-eye and base-world calibration problem," in Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on, 2001, pp. 2171-2176.
    [31] K. S. Fu, R. Gonzalez, and C. G. Lee, Robotics: Control Sensing Vision and Intelligence: Tata McGraw-Hill Education, 1987.
    [32] M. W. Spong, S. Hutchinson, and M. Vidyasagar, Robot modeling and control: John Wiley & Sons New York, 2006.
    [33] K. Levenberg, "A method for the solution of certain problems in least squares," Quarterly of applied mathematics, vol. 2, pp. 164-168, 1944.
    [34] D. W. Marquardt, "An algorithm for least-squares estimation of nonlinear parameters," Journal of the Society for Industrial & Applied Mathematics, vol. 11, pp. 431-441, 1963.
    [35] J. J. Moré, "The Levenberg-Marquardt algorithm: implementation and theory," in Numerical analysis, ed: Springer, 1978, pp. 105-116.
    [36] E. K. Chong and S. H. Zak, An introduction to optimization vol. 76: John Wiley & Sons, 2013.
    [37] S. Roweis, "Levenberg-marquardt optimization," Notes, University Of Toronto, 1996.
    [38] "http://docs.opencv.org/modules/calib3d/doc/calib3d.html."
    [39] Z. Zhang, "Flexible camera calibration by viewing a plane from unknown orientations," in Proceedings of the Seventh IEEE International Conference on Computer Vision 1999, pp. 666-673.
    [40] "http://www.vision.caltech.edu/bouguetj/calib_doc/."

    下載圖示 校內:2017-08-08公開
    校外:2017-08-08公開
    QR CODE