Active vision

An area of computer vision is active vision, sometimes also called active computer vision. An active vision system is one that can manipulate the viewpoint of the camera(s) in order to investigate the environment and get better information from it.[1][2][3][4]

Background

The interest in active camera system started as early as two decades ago. Beginning in the late 1980s, Aloimonos et al. introduced the first general framework for active vision in order to improve the perceptual quality of tracking results.[5] Active vision is particularly important to cope with problems like occlusions, limited field of view and limited resolution of the camera.[6] Other advantages can be reducing the motion blur of a moving object [7] and enhancing depth perception of an object by focusing two cameras on the same object or moving the cameras.[3] Active control of the camera view point also helps in focusing computational resources on the relevant element of the scene.[8] In this selective aspect, active vision can be seen as strictly related to (overt & covert) visual attention in biological organisms, which has been shown to enhance the perception of selected part of the visual field. This selective aspect of human (active) vision can be easily related to the foveal structure of the human eye,[9][10] where in about 5% of the retina more than the 50% of the colour receptors are located.

It has also been suggested that visual attention and the selective aspect of active camera control can help in other tasks like learning more robust models of objects and environments with less labeled samples or autonomously .[4][11][12]

Approaches

The Autonomous Camera Approach

Autonomous cameras are cameras that can direct themselves in their environment. There has been some recent work using this approach. In work from Denzler et al., the motion of a tracked object is modeled using a Kalman filter while the focal length that minimizes the uncertainty in the state estimations is the one that is used. A stereo set-up with two zoom cameras was used. A handful of papers have been written for zoom control and do not deal with total object-camera position estimation. An attempt to join estimation and control in the same framework can be found in the work of Bagdanov et al., where a Pan-Tilt-Zoom camera is used to track faces.[13] Both the estimation and control models used are ad hoc, and the estimation approach is based on image features rather than 3D properties of the target being tracked.[14]

The Master/Slave Approach

In a master/slave configuration, a supervising static camera is used to monitor a wide field of view and to track every moving target of interest. The position of each of these targets over time is then provided to a foveal camera, which tries to observe the targets at a higher resolution. Both the static and the active cameras are calibrated to a common reference, so that data coming from one of them can be easily projected onto the other, in order to coordinate the control of the active sensors. Another possible use of the master/slave approach consists of a static (master) camera extracting visual features of an object of interest, while the active (slave) sensor uses these features to detect the desired object without the need of any training data.[14]

The Active Camera Network Approach

In recent years there has been growing interest in building networks of active cameras and optional static cameras so that you can cover a large area while maintaining high resolution of multiple targets. This is ultimately a scaled-up version of either the master/slave approach or the autonomous camera approach. This approach can be highly effective, but also incredibly costly. Not only are multiple cameras involved but you also must have them communicate with each other which can be computationally expensive.[14]

Controlled Active Vision Framework

Controlled active vision can be defined as a controlled motion of a vision sensor can maximize the performance of any robotic algorithm that involves a moving vision sensor. It is a hybrid of control theory and conventional vision. An application of this framework is real-time robotic servoing around static or moving arbitrary 3-D objects. See Visual Servoing. Algorithms that incorporate the use of multiple windows and numerically stable confidence measures are combined with stochastic controllers in order to provide a satisfactory solution to the tracking problem introduced by combining computer vision and control. In the case where there is an inaccurate model of the environment, adaptive control techniques may be introduced. The above information and further mathematical representations of controlled active vision can be seen in the thesis of Nikolaos Papanikolopoulos.[15]

Examples

Examples of active vision systems usually involve a robot mounted camera,[16] but other systems have employed human operator mounted cameras (AKA "wearables").[17] Applications include automatic surveillance, human robot interaction (video),[18][19] SLAM, route planning,[20] etc. In the DARPA Grand Challenge most of the teams used LIDAR combined with active vision systems to guide driverless vehicles across an off road course.

A good example of active vision can be seen in this YouTube video. It shows face tracking using active vision with a pan-tilt camera system. https://www.youtube.com/watch?v=N0FjDOTnmm0

Active Vision is also important to understand how humans.[9][21] and organism endowed with visual sensors, actually see the world considering the limits of their sensors, the richness and continuous variability of the visual signal and the effects of their actions and goals on their perception.[8][22][23]

The controllable active vision framework can be used in a number of different ways. Some examples might be vehicle tracking, robotics applications,[24] and interactive MRI segmentation.[25]

Interactive MRI segmentation uses controllable active vision by using a Lyapanov control design to establish a balance between the influence of a data-driven gradient flow and the human’s input over time. This smoothly couples automatic segmentation with interactivity. More information on this method can be found in.[25] Segmentation in MRIs is a difficult subject, and it takes an expert to trace out the desired segments due to the MRI picking up all fluid and tissue. This could prove impractical because it would be a very lengthy process. Controllable active vision methods described in the cited paper could help improve the process while relying on the human less.

Various downloads of different implementations of active vision can be found from this link to the active vision lab at Oxford University. http://www.robots.ox.ac.uk/ActiveVision/Downloads/index.html

References

  1. ↑ http://axiom.anu.edu.au/~rsl/rsl_active.html
  2. ↑ Ballard, D.H., "Animate vision," Artificial Intelligence Journal 48, 57-86, 1991
  3. 1 2 Active Vision, J. Aloimonos, I. Weiss, A. Bandopadhay, 1988, International Journal of Computer Vision 1 (4), pages 333-356
  4. 1 2 Ecological Active Vision: Four Bio-Inspired Principles to Integrate Bottom-Up and Adaptive Top-Down Attention Tested With a Simple Camera-Arm Robot, D. Ognibene, G. Baldassarre, 2014, Autonomous Mental Development, IEEE Transactions on
  5. ↑ Aloimonos, J., Weiss, I., Bandyopadhyay, A.: Active vision. Int. J. Comput. Vis. 1(4), 333– 356 (1988)
  6. ↑ Denzler, J.; Zobel, M. & Niemann, H. Information theoretic focal length selection for real-time active 3D object tracking Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, 2003, 400 -407 vol.1
  7. ↑ Control of a Camera for Active Vision: Foveal Vision, Smooth Tracking and Saccade International Journal of Computer Vision, Springer, 2000, 39, 81-96
  8. 1 2 Tatler, B. W.; Hayhoe, M. M.; Land, M. F. & Ballard, D. Eye guidance in natural vision: Reinterpreting salience J Vis, 2011, 11, 1-23
  9. 1 2 Findlay, J. M. & Gilchrist, I. D. Active Vision, The Psychology of Looking and Seeing Oxford University Press, 2003
  10. ↑ Tistarelli, M. & Sandini, G. On the Advantages of Polar and Log-Polar Mapping for Direct Estimation of Time-To-Impact from Optical Flow IEEE Trans. Pattern Anal. Mach. Intell., IEEE Computer Society, 1993, 15, 401-410
  11. ↑ Walther, D.; Rutishauser, U.; Koch, C. & Perona, P. Selective visual attention enables learning and recognition of multiple objects in cluttered scenes Computer Vision and Image Understanding, 2005, 100, 41-63
  12. ↑ Larochelle, H. & Hinton, G. Learning to combine foveal glimpses with a third-order Boltzmann machin, NIPS, 2010
  13. ↑ Bagdanov, A.D., Del Bimbo, A., Nunziati, W.: Improving evidential quality of surveillance imagery through active face tracking. In: International Conference on Pattern Recognition, pp. 1200–1203 (2006)
  14. 1 2 3 Al Haj, M., Fernandez, C., Huerta, I., Gonzalez, J., Roca, X., Xiong, Z.: Visual Analysis of Humans (2011)
  15. ↑ Papanikolopoulos, Nikolaos Panagiotis. "Controlled Active Vision." Order No. 9238824 Carnegie Mellon University, 1992. Ann Arbor: ProQuest. Web. 2 Dec. 2014.
  16. ↑ Mak, Lin Chi; Furukawa, Tomonari; Whitty, Mark (2008). "A localisation system for an indoor rotary-wing MAV using blade mounted LEDs". Sensor Review. Emerald. 28 (2): 125–131. doi:10.1108/02602280810856688.
  17. ↑ Mapping Large Loops with a Single Hand-Held Camera. LA Clemente, AJ Davison, ID Reid, J Neira, JD Tardós - Robotics: Science and Systems, 2007
  18. ↑ Hierarchical attentive multiple models for execution and recognition of actions, Y Demiris, B Khadhouri, Robotics and autonomous systems 54 (5), 361-369
  19. ↑ Towards active event recognition D Ognibene, Y Demiris The 23rd International Joint Conference of Artificial Intelligence (IJCAI13)
  20. ↑ http://www.surrey.ac.uk/eng/research/mechatronics/robots/Activities/ActiveVision/activevis.html Archived August 17, 2007, at the Wayback Machine.
  21. ↑ Land, M. F. Eye movements and the control of actions in everyday life. Prog Retin Eye Res, 2006, 25, 296-32
  22. ↑ Lungarella, M. & Sporns, O. Mapping information flow in sensorimotor networks. PLoS Comput Biol, 2006, 2, e144
  23. ↑ Verschure, P.; Voegtlin, T.; Douglas, R. & others Environmentally mediated synergy between perception and behaviour in mobile robots Nature, 2003, 425, 620-624
  24. ↑ Smith, C.E.; Papanikolopoulos, N.P.; Brandt, S.A., "Application of the controlled active vision framework to robotic and transportation problems," Applications of Computer Vision, 1994., Proceedings of the Second IEEE Workshop on , vol., no., pp.213,220, 5-7 Dec 1994
  25. 1 2 Karasev, P.; Kolesov, I.; Chudy, K.; Tannenbaum, A.; Muller, G.; Xerogeanes, J., "Interactive MRI segmentation with controlled active vision," Decision and Control and European Control Conference (CDC-ECC), 2011 50th IEEE Conference on , vol., no., pp.2293,2298, 12-15 Dec. 2011

See also

This article is issued from Wikipedia - version of the 11/27/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.