Skip to Main content Skip to Navigation
Journal articles

Embedded and real-time architecture for bio-inspired vision-based robot navigation

Laurent Fiack 1 Nicolas Cuperlier 2 Benoit Miramond 1
1 ASTRE [Cergy-Pontoise]
ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes
2 Neurocybernetique
ETIS - UMR 8051 - Equipes Traitement de l'Information et Systèmes
Abstract : A recent trend in several robotics tasks is to consider vision as the primary sense to perceive the environment or to interact with humans. Therefore, vision processing becomes a central and challenging matter for the design of real-time control architectures. We follow in this paper a biological inspiration to propose a real-time and embedded control system relying on visual attention to learn specific actions in each place recognized by our robot. Faced with a performance challenge, the attentional model allows to reduce vision processing to a few regions of the visual field. However, the computational complexity of the visual chain remains an issue for a processing system embedded onto an indoor robot. That is why we propose as the first part of our system, a full-hardware architecture prototyped onto reconfigurable devices to detect salient features at the camera frequency. The second part learns continuously these features in order to implement specific robotics tasks. This neural control layer is implemented as embedded software making the robot fully autonomous from a computation point of view. The integration of such a system onto the robot enables not only to accelerate the frame rate of the visual processing, to relieve the control architecture but also to compress the data-flow at the output of the camera, thus reducing communication and energy consumption. We present in this paper the complete embedded sensorimotor architecture and the experimental setup. The presented results demonstrate its real-time behavior in vision-based navigation tasks.
Complete list of metadata
Contributor : Nicolas Cuperlier <>
Submitted on : Monday, January 19, 2015 - 7:20:20 PM
Last modification on : Wednesday, May 5, 2021 - 9:52:28 AM



Laurent Fiack, Nicolas Cuperlier, Benoit Miramond. Embedded and real-time architecture for bio-inspired vision-based robot navigation. Journal of Real-Time Image Processing, Springer Verlag, 2015, 10, pp.699-722. ⟨10.1007/s11554-013-0391-9⟩. ⟨hal-01105153⟩



Record views