Hybrid Learning for Event-Based Visual Motion Detection and Tracking of Pedestrians

Revolutionize traffic safety with neuromorphic visual sensing. Explore award-winning solutions for pedestrian detection and tracking, emphasizing sustainability and city-level deployment. Join Dr. Cristian Axenie in this groundbreaking AI exploration

The Vision Zero Program’s purpose is to reduce traffic-related fatalities and serious injuries while promoting equitable, safe, and healthy mobility for all. Ultimately, the challenge is to detect pedestrians during the day and especially at night in order to implement safety measures.

The current study introduces an award-winning low-power solution employing neuromorphic visual sensing and hybrid neuro-statistical processing developed by the Technische Hochschule Nürnberg team for the TinyML Vision Zero San Jose Competition. The solution proposes a novel neuromorphic edge fusion of spiking neural networks and event-based expectation maximization for the detection and tracking of pedestrians and bicyclists.

We provide a deployment-ready evaluation of the detection performance along with robustness, energy footprint, and weatherization while emphasizing the advantages of the neuro-statistical edge solution and its city-level scaling capabilities.

~ Share this Site ~

Upcoming Workshops

Accelerating Neuromorphic Inference and Training at the Edge - Rain
Maxence Ernoult
2024, Mar 5    6:00 - 7:30 CET
Advances in Neuromorphic Visual Place Recognition
Tobias Fischer
2024, Mar 20    6:00 - 7:30 CET
Hybrid Learning for Event-based Visual Motion Detection and Tracking of Pedestrians

About the Speaker

Dr. Axenie is Professor of Artificial Intelligence and Research Group Leader in Cognitive Neurocomputing at the Technische Hochschule Nürnberg Georg Simon Ohm in Germany.

After earning a Dr. Eng. Sc. in Neuroscience and Robotics from the Technical University of Munich in 2016, Dr. Axenie joined the Huawei Research Center in Munich. Between 2017 and 2023 Dr. Axenie was Staff Research Engineer with Huawei Research Center. At the same time, Dr. Axenie was the Principal Investigator and Head of the Audi Konfuzius-Institut Ingolstadt Laboratory at the Technische Hochschule Ingolstadt.

Dr. Axenie is a seasoned researcher with more than 15 years of academic research and more than 10 years of industrial research experience. His research was disseminated in more than 50 peer-reviewed publications and more than 10 patents. Currently Dr. Axenie focuses on sustainable and efficient deployment of intelligent algorithms for sensor fusion and closed-loop control.

Lava: An Open-Source Software Framework for Developing Neuro-Inspired Applications

Lava: An Open-Source Software Framework for Developing Neuro-Inspired Applications

  • Andreas Wild, Mathis Richter
  • 2023, May 31

Discover Lava, an open-source software framework for neuro-inspired applications, presented by Andreas Wild and Mathis Richter. Dive into the future of neuromorphic computing.

Spyx Hackathon: Speeding up Neuromorphic Computing

Spyx Hackathon: Speeding up Neuromorphic Computing

  • Kade Heckel
  • 2023, December 13

Explore the power of Spyx in a hands-on hackathon session and dive into the world of neuromorphic frameworks with Kade Heckel.

Hands-On with Sinabs and Speck

Hands-On with Sinabs and Speck

  • Gregor Lenz
  • 2023, April 4

Join Gregor Lenz for an engaging hands-on session featuring Sinabs and Speck. Explore the world of neuromorphic engineering and spike-based machine learning.