Control of robot-camera system with actuator's dynamics to track moving object

Nguyen Tien Kiem, Pham Thuong Cat
Author affiliations


  • Nguyen Tien Kiem Hanoi University of Industry
  • Pham Thuong Cat



Robot control, artificial neural network, visual servoing


This study presents a solution to the control of robot–camera system with actuator's dynamics to track a moving object where many uncertain parameters exist in the system’s dynamics.

After modeling and analyzing the system, this paper suggests a new control method using an on-line learning neural network in closed-loop to control the Pan-Tilt platform that moves the Camera to keep track an unknown moving object. The control structure based on the image feature error determines the necessary rotational velocities on the Pan joint and Tilt joint and computes the voltage controlling the DC motor in joints such that the object image should always be at the center point in the image plane. The global asymptotic stability of the closed-loop is proven by the Lyapunov direct stability theory. Simulation results on Matlab show the system tracking fast and stable.


Metrics Loading ...


S.Hutchinson, G.D.Hager, and P.I.Cork., A Tutorial On Visual Servo Control, IEEE Transactions On Robotics And Automation, 12(5) October 1996.

F. Chaumette, S.Hutchinson., Visual servo control .II. Advanced approaches [Tutorial], Robotics & Automation magazine, IEEE, volume 14, issue 1, March, 2007 , pp. 109-118.

C.S Kim, E.J Mo, S.Han, M.Jie and K.W.Lee., Image-based Robust control of Robot Manipulators With Image Jacobian And Dynamics Uncertainties, 4th IEEE conference on Automation Science and Engineering Key Bridge Marriott, Washington DC, USA August 23-26, 2008, pp. 723-737.

G.Loreto and R.Garrido., Stable Neuro-Visual Servoing For Robot Manipulators, IEEE Transactions On Neural Network, Vol.17, No.4, July 2006, pp. 183-1898.

L.Hernandez, R.Gonzalez, H.Sahli, E.Rubio and Y.Guerra., A Decoupled Control For Visual Servoing Of Camera-In-Hand Robot With 2D Movement, Proceeding of the electronics, Robotics and Automotive mechanics conference 2008, CERMA’08, pp. 301-304.

Q.Zhao, L.Zhang, Y.Chen., On-Line Estimation Technique For Jacobian Matrix In Robot Visual Servo Systems, Industrial electronics and applications , 2008, ICIEA 2008.3rd IEEE conference on 3-5 June 2008, pp. 1270-1275.

Pham Thuong Cat , Robust Neural Control Of N-DOF Robot With Many Uncertainties In Cartesian Space, Proceedings Of The 2009 National Conference On Mechanics, Hanoi Vietnam April 8-9. pp. 192-200 (in Vietnamese).

Wen Yu, Marco A Moreno-Armendariz., Robust Visual Servoing Of Robot Manipulators With Neuro Compensation, Journal Of The Franklin Institute.

Hyroiuki Ukida, Masayuki Kawanami, Yasuhiro Terama., 3D Object Tracking By Pan-Tilt Moving Camera And Robot Using Sparse Template Matching And Particle Filter, SICE Annual Conference 2011september 13-18, 2011, Waseda university, Tokyo, Japan.

Tingting Wang, Guodong Liu, Wenfiang Xie, member IEEE., Visual Servoing Control Of Video Tracking System For Tracking A Flying Target, 2011 IEEE/ASME International Conference On Advance Intelligent Machetronics (AIM2011), Budapest, Hungary, July 3-7, 2011.

. Chengxian Zhou, Wei Fu., A Study Of Robot Control Technology Base On Stereo Vision, 2011 International Conference On Electronics And Optoelectronics (ICEOE 2011).

Hesheng Wang, Yun-Hui Liu, Weidong Chen., Zhongli Wang. A New Approach To Dynamic Eye-In-Hand Visual Tracking Using Nonlinear Observers, IEEE/ASME Transactions On Mechatronics, Vol.16, No.2, April 2011.

G.Loreto, R.Garrido. Stable Neurovisual Servoing For Robot Manipulator. IEEE Transaction Neural Networks Vol.17, No.4, July 2006.

Pham Thuong Cat, Modern control methods for industrial robots, The Publishing House of Thai Nguyen University, 2009 (in Vietnamese).




How to Cite

N. T. Kiem and P. T. Cat, “Control of robot-camera system with actuator’s dynamics to track moving object”, JCC, vol. 31, no. 3, p. 255, Sep. 2015.




Most read articles by the same author(s)

1 2 > >>