儘管科技日新月異，人類本身對於許多環境如：核電廠中的某些空間、接近爆炸性物質之區域、外太空、深海等高危險性的地區，仍無法完全安全的接近。雖然人類在機器人技術方面已有很好的成績，但是於上述環境下，應用完全自主式機器人系統仍是困難重重，故長控機器人系統的發展就由此而生。此系統能整合機器人技術與人類技能，藉由遠端資訊回傳給近端的操作者，不但能讓操作者於安全且方便的地方操作遠端的僕機械手臂，且能將操作者的感覺、判斷與靈巧性完全融入僕機械手臂所執行的任務中。

　　本論文主要的目的，在於提升以虛擬實境為基礎並利用網際網路通訊的長控機器人系統雙向控制方法。於本研究中所使用的長控機器人系統主要包含有一個架設於近端的手控器，以及架設於遠端的一個雙眼機械頭和一個工業機械手臂。使用一個六軸力量反射式手控器，並配合智慧型阻抗控制架構，使得操作者能藉由手控器感受到遠端僕機械臂的接觸力，並提高操控性。而於視覺回授方面，透過遠端的雙眼機械頭所得到的影像資訊回傳及虛擬實境的技術，於近端建立一個遠端的虛擬場景，並依據遠端回傳的資訊來更新此虛擬場景，以提供操作者視覺的感受。針對雙眼機械頭控制上，使用一個以影像為基礎的看而後動控制架構，使其能於遠端操作的過程中，搜尋並鎖定目標物。而目標物的空間姿態則藉由立體視覺的方式計算其三維空間姿態，並將目標物空間姿態回傳以更新近端的虛擬場景。

　　最後，以實驗來驗證本文所建構的長控機器人系統性能，所做的實驗包含有自由空間之遠端操作以及遠端操作執行插梢工作。

　　Despite rapid advances in life-support technology, there are still many environments that may be hazardous or inaccessible to humans, such as dangerous rooms in a nuclear plant, areas near explosives, outer space, and under water. Also the application of fully-autonomous robotic systems in the same environments remains difficult or impractical in spite of advances in robot technology. Telerobotic systems, by which a human operator can enslave a remote robot manipulator using a hand controller according to information from feedback sensors, are a practical way to combine robot technology with human versatility. Such a system can bring a human operator’s perception, judgement, and dexterity to a task while allowing the operator to control the slave manipulator from a position of safety and convenience.

　　The objective of this thesis is to advance the bilateral control method of the VR-based telerobotic system operated through the Internet. The telerobotic system adopted in this study is mainly composed of a hand controller in local site, and a robotic binocular head and an industrial robot manipulator in remote site. A six-axis force-reflecting hand controller is used to make the operator feel the contact force in remote site and enhance the manipulation with the implementation of the proposed intelligent impedance control law. A virtual scene of the remote site is created in local site by the visual information provided by the binocular head in remote site and virtual reality (VR) technique to support the operator with visual information. One image-based look-and-move control strategy is proposed to enable the robotic head to saccade and fixate the target during the teleoperation. The pose of the target is then estimated by applying static stereo analysis to determine the three-dimensional information by a process called triangulation. The VR scene is created according to the pose information of the target.

　　Finally, the theoretical results are experimentally verified on the adopted telerobotic system. Specific experimental demonstrations include the unconstrained teleoperation and the peg-in-hole task to examine the performance of the system.

[1] C. H. Chen, “A Networked VR-Based Telerobotic System: Vision and Camera Calibration,” M. S. Thesis, Dept. of Electrical and Control Engineering, National Chiao Tung University, July 2001.
[2] K. C. Ching, “Construction of a Six DOF Force-Reflecting Hand Controller and Its Application to Teleoperation of a VR-Based Telerobotic System Through the Internet,“ M.S. Thesis, Department of Mechanical Engineering, N.C.K.U., 2001.
[3] J. L. Craig and M. H. Raibert, “A Systematic Method of Hybrid Position/Force Control of a Manipulator,” In IEEE COMPSAC, Chicago, IL., 1979.
[4] C. R. Flatau, J. Vertut, J. P. Guilbaud, and J. C. Germond, “A Compact Bi-lateral Servo Master-Slave Electric Manipulator,” In Proc. of the 20th Conf. on Remote Systems Technology, 1973.
[5] D. A. Forsyth, J. Ponce, “Computer Vision – a Modern Approach,” Prentice Hall, 2002.
[6] M. Friedman, A. Kandel, “Fundamentals of Computer Numberical Analysis,” CRC Press, 2000.
[7] R. Goertz, “Manipulator Systems Development at ANL,” In Proc. of 12th Conf.on Remote Systems Technology, ANS, Nov. 1964.
[8] R. C. Goertz, R. A. Blomgren, J. H. Grimson, G. A. Forster, W. M. Thompson, and W. H. Kline, “The ANL Model 3 Master-Slave Electric Manipulator – Its Design and Use in a Cave,” In Proc. of the 9th Conference on Hot Laboratories and Equipment, 1961.
[9] H. Hall, T. C. Way, and I. L. Belyea, “Design and Evaluation of Primary Hand Controller for Fighter Aircraft,” Technical Report AFFDL-TR-71-16, Wright Patterson AFB, OH, 1970.
[10] C. Harris, “Tracking with Rigid Models,” In Active Vision, A Blake and A. Yuille, Eds. Cambridge, MA: MIT Press, pp. 59-73, 1992.
[11] W. Hong, “Robotic Catching and Manipulation Using Active vision,” M. S. Thesis, Department of Mechanical Engineering, MIT, Sep. 1995.
[12] S. Hutchinson, G. D. Hager, P. I. Corke, “A Tutorial on Visual Servo Control,” IEEE Transactions on Robotics and Automation, Vol.12, No.5, pp.651-670, 1996.
[13] T. Itoh, K. Kosuge, T. Fukuda, “Human-Machine Cooperative Telemanipulation with Motion and Force Scaling Using Task-Oriented Virtual Tool Dynamics,” IEEE Trans. on Robotics and Automation, Vol. 16, No. 5, October 2000.
[14] W. S. Kim, B. Hannaford, and A. K. Bejczy, “Force-Reflection and Shared Compliant Control in Operating Telemanipulators with Time Delay,” IEEE Trans. on Robotics and Automation, Vol. 8, No. 2, pp. 176-185, April 1992.
[15] R. Klette, K. Schluns, A. Koschan, “Compter Vision – Three Dimensional Data from Images,” Springer-Verlag Singapore Pte. Ltd., 1998.
[16] K. Kosuge, K. Takeo, and T. Fukuda, “Unified Approach for Teleoperation of Virtual and Real Environment – Manipulation Based on Reference Dynamics-,” in Proc. of IEEE Int. Conf. Robotics and Automation, pp. 938-943, 1995.
[17] K. Kosuge, T. Itoh, and T. Fukuda, “Tele-manipulation System Based on Task-Oriented Virtual Tool,” in Proc. of IEEE Int. Conf. Robotics and Automation, pp. 351-356, 1995.
[18] K. Kosuge, T. Itoh, T. Fukuda, “Semi-autonomous tele-operation system using virtual tool,” Proceedings of the ROMAN94, pp. 327-332, 1994.
[19] M. K. Lee, “Binocular Tracking with the Application of Ultrasonic Sensors,” M.S. Thesis, Department of Mechanical Engineering, N.C.K.U., 2001.
[20] G. J. Lee, “Design of a Binocular Robot Head and Its Application to Visual Servoing,” M.S. Thesis, Department of Mechanical Engineering, N.C.K.U., 1997.
[21] F. L. Lewis, K. Liu, and A. Yesildirek, “ Multilayer neural-net robot controller with guaranteed tracking performance, “ IEEE Trans. Neural Networks, Vol. 7, No. 2, pp. 388-399, Mar., 1996.
[22] F. L. Lewis, “ Neural network control of robot manipulators, “ IEEE Expert, pp. 64-75, 1996.
[23] F. L. Lewis, K. Liu, and A. Yesildirek, “ Neural net robot controller with guaranteed tracking performance, “ IEEE Trans. Neural Networks, Vol. 6, No. 3, pp. 703-715, May, 1995.
[24] R. S. Lin, “Development of a Mobile Robot for Vision Guided Material Handling,” M.S. Thesis, Department of Mechanical Engineering, N.C.K.U., 2001.
[25] W.-S. Lu and Q.-H. Meng, “Impedance Control with Adaptation for robotic manipulators,” IEEE Transactions on Robotics and Automation, Vol. 7, No. 3, pp. 408-415, 1991.
[26] G. F. McLean, B. Prescorr, and R. Podhorodeski, “Teleoperated System Performance Evaluation,” IEEE Trans. on Systems, Man, and Cybernetics, Vol. 24, No. 5, pp. 796-804, May, 1994.
[27] I. Pitas, “Digital Image Processing Algorithms and Applications,” John Wiley & Sons, Inc., 2000.
[28] M. Sonka, V. Hlavac, R. Boyle, “Image Processing, Analysis, and Machine Vision,” PWS Publishing, 1998.
[29] R. L. Thompson, I. D. Reid, A. Munoz and D. W. Murray, “Providing Synthetic Views for Teleoperation using Visual Pose Tracking in Multiple Cameras,” IEEE Trans, on System, Man and Cybernetics, Vol. 31, No. 1, pp. 43-54, 2001.
[30] R. Y. Tsai, “A Versatile Camera Calibration Technique for High Accuracy 3D Machine Vision Metrology Using off the Self TV Cameras and Lens,” IEEE J. Robotics Automat., Vol. 3, No. 4, pp. 323-344, 1987.
[31] R. Y. Tsai, “An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision”, International Conference on Computer Vision and Pattern Recognition, USA, pp.364-374, 1986.
[32] G. L. Wang, “Hand-Eye Coordination of the Robotic Binocular Head and Manipulator,“ M.S. Thesis, Department of Mechanical Engineering, N.C.K.U., 2002.
[33] C. H. Wang, “Intelligent Control of Constrained Robot Manipulators,” M.S. thesis, Department of Mechanical Engineering, N.C.K.U., 2000.
[34] C. R. Wang, “Design and Construction of a Five-Axis Hand Controller and Its Application to Telerobotic Control,” M.S. Thesis, Department of Mechanical Engineering, N.C.K.U., 1996.
[35] W. G. Yau, “Design and Implementation of Visual Servoing System for Realistic Air Target Tracking,” M.S. Thesis, Department of Electrical Engineering, N.T.U., 1999.
[36] Z. Zhang, “A Flexible New Technique for Camera Calibration,” Technical Report MSR-TR-98-71, Update on Microsoft Corporation, pp.1-21, 1998.
[37] JR3 Universal Force-Moment Sensor System Operation Manual, JR3, Inc., 1988.
[38] Mitsubishi Industrial Robot CR2 Controller Instruction Manual, Mitsubishi electric corporation, 1999.
[39] Mitsubishi Industrial Robot RV-3AL Robot Manual, Mitsubishi electric corporation, 1999.
[40] WorldToolKit Release 9 Reference Manual, Engineering Animation, Inc., 1999.