Hybrid Learning for Event-Based Visual Motion Detection and Tracking of Pedestrians

Revolutionize traffic safety with neuromorphic visual sensing. Explore award-winning solutions for pedestrian detection and tracking, emphasizing sustainability and city-level deployment. Join Dr. Cristian Axenie in this groundbreaking AI exploration

The Vision Zero Program’s purpose is to reduce traffic-related fatalities and serious injuries while promoting equitable, safe, and healthy mobility for all. Ultimately, the challenge is to detect pedestrians during the day and especially at night in order to implement safety measures.

The current study introduces an award-winning low-power solution employing neuromorphic visual sensing and hybrid neuro-statistical processing developed by the Technische Hochschule Nürnberg team for the TinyML Vision Zero San Jose Competition. The solution proposes a novel neuromorphic edge fusion of spiking neural networks and event-based expectation maximization for the detection and tracking of pedestrians and bicyclists.

We provide a deployment-ready evaluation of the detection performance along with robustness, energy footprint, and weatherization while emphasizing the advantages of the neuro-statistical edge solution and its city-level scaling capabilities.

Social share preview for Hybrid Learning for Event-based Visual Motion Detection and Tracking of Pedestrians

Upcoming Workshops

No workshops are currently scheduled. Check back soon for new events!

Are you an expert in a neuromorphic topic? We invite you to share your knowledge with our community. Hosting a workshop is a great way to engage with peers and share your work.

About the Speakers

Cristian Axenie

Cristian Axenie

Professor of AI at TH Nürnberg, leading Cognitive Neurocomputing. Focuses on sustainable, efficient intelligent algorithms for sensor fusion and control.
Jens E. Pedersen

Jens E. Pedersen

Doctoral student at KTH, modeling neuromorphic systems to solve real-world challenges. Maintainer of Norse, AEStream, Faery, and co-author of NIR.

Inspired? Share your work.

Share your expertise with the community by speaking at a workshop, student talk, or hacking hour. It’s a great way to get feedback and help others learn.

Related Workshops

Making Neuromorphic Computing Mainstream

Making Neuromorphic Computing Mainstream

Join us for a workshop with Timoleon Moraitis, research group leader in neuromorphic computing, at the interface of computational neuroscience with artificial intelligence.

IBM NorthPole - Neural inference at the frontier of energy, space, and time

IBM NorthPole - Neural inference at the frontier of energy, space, and time

NorthPole outperforms all prevalent architectures, even those that use more-advanced technology processes.

NIR: A unified instruction set for brain-inspired computing

NIR: A unified instruction set for brain-inspired computing

We show how to use the Neuromorphic Intermediate Representation to migrate your spiking model onto neuromorphic hardware.