A Neural Controller based Binocular Vision System for Object Tracking

Abstract

In this paper, we present a learning control approach to the problem of visual tracking using an active binocular vision system. The simulated vision system used here is composed of two cameras which have freedom of pan and are mounted on a plate that can tilt. A self organizing map is trained to learn the mapping between visual feedback as received from the simulated CCD cameras and the incremental values in the orientation angles of the vision system to fixate continuously on a mobile target. A direct implication of this is that the object should be centered at the vergence point of the cameras. This is accomplished by ensuring minimum disparity of the target vector from the center of the images of both the cameras. The learning algorithm is presented and the simulation study shows an average focussing error of 0.15 pixels after 1200 iterations for a small, defined joint angle space of the vision system. Thus, a significant contribution of this work is the application of a self organizing map in dynamic object tracking.

Indexing terms:

• Neural controller
• Binocular vision system
• Object tracking
• Self organizing map

Additional information

Notes on contributors

Laxmidhar Behera

Laxmidhar Behera obtained his PhD from IIT, Delhi. He is currently assistant professor and coordinator of Centre for Robotics and Intelligent Systems at Birla Institute of Technology and Science, Pilani. He has published more than 30 papers in refereed journals and conference proceedings. He is recipient of career award for young teacher from AICTE in 1998. His field of interests are brain modelling, quantum neuro-dynamics, intelligent systems and control.

G Prem Krishna

G Prem Krishna is a final year student in the department of computer science at Birla Institute of Technology and Science, Pilani. He is an active student member in Centre for Robotics and Intelligent Systems where he heads a project student group in the area of active vision. He will pursue his masters degree in Purdue University from Fall, 1999.