| 研究生: |
江宗錡 Chiang, Tsung-Chi |
|---|---|
| 論文名稱: |
六軸關節型機械手臂之手眼校正研究 Study on Hand Eye Calibration of Six-Axis Articulated Robot |
| 指導教授: |
鄭銘揚
Cheng, Ming-Yang |
| 學位類別: |
碩士 Master |
| 系所名稱: |
電機資訊學院 - 電機工程學系 Department of Electrical Engineering |
| 論文出版年: | 2014 |
| 畢業學年度: | 102 |
| 語文別: | 中文 |
| 論文頁數: | 66 |
| 中文關鍵詞: | 眼在手架構 、手眼校正 、機器視覺 、封閉形式轉換矩陣方程式 |
| 外文關鍵詞: | Eye-in-Hand, Hand-Eye Calibration, Machine Vision, Closed-Form Transformation Matrix Equation |
| 相關次數: | 點閱:142 下載:13 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
自動化產線於現今工業製造場合中已相當普遍。另一方面,為了適應變化快速的產品供應需求,機器人之智能勢必非提升不可,其中整合機器視覺於機械手臂系統尤其關鍵。若機械手臂系統採用眼在手架構,亦即攝影機架設於機械手臂末端點時,可減輕系統對於工作空間與硬體之依賴程度。此類架構目前廣泛應用於三維機器視覺視覺、物件夾取擺放等,然而其操作精度取決於攝影機座標系相對於機械手臂末端點座標系之轉換關係(即手眼關係)是否準確,而求取手眼關係之過程稱為手眼校正。ㄧ般而言,手眼校正過程需移動機械手臂末端點至不同姿態,並且記錄不同姿態下機械手臂末端點座標系相對於機械手臂基底座標系轉換關係以及攝影機外部參數,並以封閉形式轉換矩陣方程式求解,因此必須考量攝影機參數校正和機器人運動學。不言可喻的,若上述之攝影機或機械手臂參數含有高度不確定性,則手眼校正之可靠性及精度將大幅降低,連帶影響機械手臂操作精度。因此,本論文針對此議題進行深入探討,於未經過高精度設備校正過之機械手臂進行手眼校正,以分析不確定因素如機械手臂原點復歸正確與否對於手眼校正準確性所造成之影響。本論文引入雷射水平儀進行原點復歸校正並探討校正前後手眼校正精度之差異。另外並針對最佳化演算法參數調整、轉換矩陣方程式中旋轉矩陣描述方式及平移向量於目標函數中的單位、機械手臂姿態數目多寡等因素進行實驗並討論。本論文將誤差較大之姿態過濾後再次進行手眼校正以提升校正精度,實驗結果顯示本論文所提出之手眼校正方法性能良好。
SUMMARY
Automatic production lines are commonly seen in modern manufacturing. On the other hand, in order to adapt to rapid changes in the product supply chain, robot intelligence must be elevated to a higher level. In particular, incorporating machine vision into a robot manipulator system is crucial. If the eye-in-hand camera configuration is adopted, i.e. the camera is mounted on the end-effector, the degree of dependence on hardware/workspace for an industrial manipulator can be much reduced. In fact, this kind of camera configuration is extensively adopted in fields such as 3D machine vision, object grasping, pick-and-place, etc. However, the precision of the industrial manipulator that adopts eye-in-hand camera configuration depends on the accuracy of the transformation between the camera coordinate system and the end-effector coordinate system that is often called “hand-eye relation”. Hand-eye calibration is the process for solving the hand-eye relation. Generally, the end-effector of the manipulator will be moved to different poses during the hand-eye calibration process. The transformation matrices between the end-effector coordinate system and the base coordinate system and extrinsic camera parameters at different poses will be recorded. Based on these recorded data at different poses, the closed-form transformation matrix equation is used to solve the hand-eye transformation matrix. Clearly, the hand-eye calibration process involves camera parameter calibration and robot kinematics. If there are uncertainties in camera and robot kinematic parameters, the reliability and accuracy of hand-eye calibration will be significantly decreased so that the precision of the manipulator will be affected as well. As a result, this thesis conducts an in-depth study on the aforementioned problem. In particular, the hand-eye calibration is implemented with an industrial manipulator which has not been accurately calibrated by a high precision device so as to analyze the effect caused by uncertainty upon hand-eye calibration. The accuracy of home point return could affect the result of hand-eye calibration. One laser line level will be adopted to perform home point return, and the difference in before-and-after results will be compared. This thesis conducts several experiments and also discusses issues such as the parameter adjustment of the optimization algorithm, different types of representation of rotation matrix, unit of the translation vector in the object function, and the number of different poses used in the calibration process. After discarding the poses that leads to large calibration error, the calibration process is performed again to obtain better hand-eye calibration accuracy. Experimental results indicate that the proposed hand-eye calibration method exhibits satisfactory performance.
參考文獻
[1] M. Shah, R. D. Eastman, and T. Hong, "An overview of robot-sensor calibration methods for evaluation of perception systems," in Proceedings of the Workshop on Performance Metrics for Intelligent Systems, 2012, pp. 15-20.
[2] F. Dornaika and R. Horaud, "Simultaneous robot-world and hand-eye calibration," IEEE Transactions on Robotics and Automation, vol. 14, pp. 617-622, Aug 1998.
[3] R. Y. Tsai and R. K. Lenz, "Real time versatile robotics hand/eye calibration using 3D machine vision," in Proceedings of IEEE International Conference on Robotics and Automation, 1988, pp. 554-561.
[4] E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, and P. Sayd, "Real time localization and 3d reconstruction," in IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2006, pp. 363-370.
[5] S. Avidan and A. Shashua, "Trajectory triangulation: 3D reconstruction of moving points from a monocular image sequence," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, pp. 348-357, 2000.
[6] S.-K. Chang and Y. Wang, "Three-dimensional object reconstruction from orthogonal projections," Pattern Recognition, vol. 7, pp. 167-176, 1975.
[7] C. Hernandez Esteban and F. Schmitt, "Multi-stereo 3d object reconstruction," in Proceedings of First International Symposium on 3D Data Processing Visualization and Transmission 2002, pp. 159-166.
[8] "http://mathworld.wolfram.com/Closed-FormSolution.html."
[9] Y. Motai and A. Kosaka, "Hand–eye calibration applied to viewpoint selection for robotic vision," IEEE Transactions on Industrial Electronics, vol. 55, pp. 3731-3741, 2008.
[10] Y. C. Shiu and S. Ahmad, "Calibration of Wrist-Mounted Robotic Sensors by Solving Homogeneous Transform Equations of the Form Ax = Xb," IEEE Transactions on Robotics and Automation, vol. 5, pp. 16-29, Feb 1989.
[11] J.-S. Hu and Y.-J. Chang, "Calibration of an eye-to-hand system using a laser pointer on hand and planar constraints," in IEEE International Conference on Robotics and Automation (ICRA), 2011, pp. 982-987.
[12] K. H. Strobl and G. Hirzinger, "Optimal hand-eye calibration," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2006, pp. 4647-4653.
[13] R. Y. Tsai and R. K. Lenz, "A new technique for fully autonomous and efficient 3D robotics hand/eye calibration," IEEE Transactions on Robotics and Automation, vol. 5, pp. 345-358, 1989.
[14] A. Malti and J. P. Barreto, "Hand–eye and radial distortion calibration for rigid endoscopes," The International Journal of Medical Robotics and Computer Assisted Surgery, vol. 9, pp. 441-454, 2013.
[15] J. C. Chou and M. Kamel, "Quaternions approach to solve the kinematic equation of rotation, A a A x= A x A b, of a sensor-mounted robotic manipulator," in Proceedings of IEEE International Conference on Robotics and Automation, 1988, pp. 656-662.
[16] J. C. Chou and M. Kamel, "Finding the position and orientation of a sensor on a robot manipulator using quaternions," The International Journal of Robotics Research, vol. 10, pp. 240-254, 1991.
[17] F. C. Park and B. J. Martin, "Robot sensor calibration: solving AX= XB on the Euclidean group," IEEE Transactions on Robotics and Automation, vol. 10, pp. 717-721, 1994.
[18] T. Ruland, T. Pajdla, and L. Kruger, "Globally optimal hand-eye calibration," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 1035-1042.
[19] H. H. Chen, "A screw motion approach to uniqueness analysis of head-eye geometry," in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1991, pp. 145-151.
[20] H. Zuang and Y. C. Shiu, "A noise-tolerant algorithm for robotic hand-eye calibration with or without sensor orientation measurement," IEEE Transactions on Systems, Man and Cybernetics, vol. 23, pp. 1168-1175, 1993.
[21] I. Fassi and G. Legnani, "Hand to sensor calibration: A geometrical interpretation of the matrix equation AX= XB," Journal of Robotic Systems, vol. 22, pp. 497-506, 2005.
[22] G.-Q. Wei, K. Arbter, and G. Hirzinger, "Active self-calibration of robotic eyes and hand-eye relationships with model identification," IEEE Transactions on Robotics and Automation, vol. 14, pp. 158-166, 1998.
[23] J. Heller, M. Havlena, A. Sugimoto, and T. Pajdla, "Structure-from-motion based hand-eye calibration using L∞ minimization," in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 3497-3503.
[24] S.-J. Kim, M.-H. Jeong, J.-J. Lee, J.-Y. Lee, K.-G. Kim, B.-J. You, et al., "Robot Head-Eye Calibration Using the Minimum Variance Method," in IEEE International Conference on Robotics and Biomimetics (ROBIO), 2010, pp. 1446-1451.
[25] C.-C. Wang, "Extrinsic calibration of a vision sensor mounted on a robot," Robotics and Automation, IEEE Transactions on, vol. 8, pp. 161-175, 1992.
[26] H. Zhuang, Z. S. Roth, and R. Sudhakar, "Simultaneous robot/world and tool/flange calibration by solving homogeneous transformation equations of the form AX= YB," Robotics and Automation, IEEE Transactions on, vol. 10, pp. 549-554, 1994.
[27] A. Li, L. Wang, and D. Wu, "Simultaneous robot-world and hand-eye calibration using dual-quaternions and Kronecker product," Inter. J. Phys. Sci, vol. 5, pp. 1530-1536, 2010.
[28] M. Shah, "Solving the Robot-World/Hand-Eye Calibration Problem Using the Kronecker Product," Journal of Mechanisms and Robotics, vol. 5, p. 031007, 2013.
[29] S. Remy, M. Dhome, J.-M. Lavest, and N. Daucher, "Hand-eye calibration," in Intelligent Robots and Systems, 1997. IROS'97., Proceedings of the 1997 IEEE/RSJ International Conference on, 1997, pp. 1057-1065.
[30] R. L. Hirsh, G. N. DeSouza, and A. C. Kak, "An iterative approach to the hand-eye and base-world calibration problem," in Robotics and Automation, 2001. Proceedings 2001 ICRA. IEEE International Conference on, 2001, pp. 2171-2176.
[31] K. S. Fu, R. Gonzalez, and C. G. Lee, Robotics: Control Sensing Vision and Intelligence: Tata McGraw-Hill Education, 1987.
[32] M. W. Spong, S. Hutchinson, and M. Vidyasagar, Robot modeling and control: John Wiley & Sons New York, 2006.
[33] K. Levenberg, "A method for the solution of certain problems in least squares," Quarterly of applied mathematics, vol. 2, pp. 164-168, 1944.
[34] D. W. Marquardt, "An algorithm for least-squares estimation of nonlinear parameters," Journal of the Society for Industrial & Applied Mathematics, vol. 11, pp. 431-441, 1963.
[35] J. J. Moré, "The Levenberg-Marquardt algorithm: implementation and theory," in Numerical analysis, ed: Springer, 1978, pp. 105-116.
[36] E. K. Chong and S. H. Zak, An introduction to optimization vol. 76: John Wiley & Sons, 2013.
[37] S. Roweis, "Levenberg-marquardt optimization," Notes, University Of Toronto, 1996.
[38] "http://docs.opencv.org/modules/calib3d/doc/calib3d.html."
[39] Z. Zhang, "Flexible camera calibration by viewing a plane from unknown orientations," in Proceedings of the Seventh IEEE International Conference on Computer Vision 1999, pp. 666-673.
[40] "http://www.vision.caltech.edu/bouguetj/calib_doc/."