A new EU-project for developing an intelligent camera-sensor technology

AMO GmbH is partner of MISEL (Multispectral Intelligent Vision System with Embedded Low-Power Neural Computing), a project that aims at developing a bio-inspired vision system able to implement advanced recognition tasks, but with much smaller size, weight and power consumption than off-the-shelf components. The project is funded by the European Commission through the Horizon 2020 Research and Innovation Programme with a total budget of 4.96 million Euros.

Inspired by the neurobiological structures of the human vision system

The architecture of the vision system targeted by MISEL is inspired by the neurobiological structures of the human vision system. The key idea is to implement certain learning and decision-making capabilities directly into the camera sensor. This will increase substantially the speed and the energy-efficiency of the vision system, allowing for fast situation-awareness in dynamically changing environments. To achieve this goal, MISEL will develop camera sensors equipped with pixels with build-in synaptic weights, which can be trained to recognize different patterns through targeted learning processes.

Possible areas of application: autonomous driving, autonomous robotics, and surveillance systems

The new camera sensors will be based on classic silicon CMOS electronics, extended by newly developed neuromorphic elements and by graphene-based photodetectors with adaptive sensitivity for visible and infrared light. This multispectral sensitivity will allow for operation also in challenging environmental conditions, such as darkness, fog, etc. Possible areas of application of MISEL’s vision system include autonomous driving, autonomous robotics, and surveillance systems. 

MISEL is a highly interdisciplinary project that involves nine European research teams with complementary expertise in computer vision, machine learning theory and algorithms, nano- and device technologies, circuit design, and evaluation of artificial-intelligence systems. Coordinated by the VTT Technical Research Centre of Finland, MISELS’s consortium includes AMO GmbH, the University of Wuppertal (Germany), the Fraunhofer Centre for Applied Nanotechnology (Germany), Kovilta Oy (Finland), Lund University (Sweden), Lodz University of Technology (Poland), the University of Santiago de Compostela (Spain) and the Laboratoire national de métrologie et d'Essais (France). MISEL is funded by the European Union’s Horizon 2020 Research and Innovation Programme, under grant agreement Nr. 101016734.

Contact: Dr. Federica Haupt, AMO GmbH
haupt@amo.de