Hybrid Learning for Event-Based Visual Motion Detection and Tracking of Pedestrians

Revolutionize traffic safety with neuromorphic visual sensing. Explore award-winning solutions for pedestrian detection and tracking, emphasizing sustainability and city-level deployment. Join Dr. Cristian Axenie in this groundbreaking AI exploration

The Vision Zero Program’s purpose is to reduce traffic-related fatalities and serious injuries while promoting equitable, safe, and healthy mobility for all. Ultimately, the challenge is to detect pedestrians during the day and especially at night in order to implement safety measures.

The current study introduces an award-winning low-power solution employing neuromorphic visual sensing and hybrid neuro-statistical processing developed by the Technische Hochschule Nürnberg team for the TinyML Vision Zero San Jose Competition. The solution proposes a novel neuromorphic edge fusion of spiking neural networks and event-based expectation maximization for the detection and tracking of pedestrians and bicyclists.

We provide a deployment-ready evaluation of the detection performance along with robustness, energy footprint, and weatherization while emphasizing the advantages of the neuro-statistical edge solution and its city-level scaling capabilities.

About the Speakers

Cristian Axenie

Cristian Axenie

Professor of AI at TH Nürnberg, leading Cognitive Neurocomputing. Focuses on sustainable, efficient intelligent algorithms for sensor fusion and control.
Jens E. Pedersen

Jens E. Pedersen

Doctoral student at KTH, modeling neuromorphic systems to solve real-world challenges. Maintainer of Norse, AEStream, Faery, and co-author of NIR.
Social share preview for Hybrid Learning for Event-based Visual Motion Detection and Tracking of Pedestrians

Upcoming Workshops

No workshops are currently scheduled. Check back soon for new events!

Are you an expert in a neuromorphic topic? We invite you to share your knowledge with our community. Hosting a workshop is a great way to engage with peers and share your work.

Inspired? Share your work.

Share your expertise with the community by speaking at a workshop, student talk, or hacking hour. It’s a great way to get feedback and help others learn.

Related Workshops

Building Neuromorphic Applications Using Talamo

Building Neuromorphic Applications Using Talamo

This offers a sneak-peek into Innatera’s technology stack allowing application development from scratch and deploying it on mixed-signal neuromorphic hardware.

Hands-on with Xylo and Rockpool

Hands-on with Xylo and Rockpool

Discover Xylo and Rockpool in a hands-on session with Dylan Muir, exploring cutting-edge neural computation architectures and signal processing.

Programming Scalable Neuromorphic Algorithms with Fugu

Programming Scalable Neuromorphic Algorithms with Fugu

Explore neural-inspired computing with Brad Aimone, a leading neuroscientist at Sandia Labs. Join us for insights into next-gen technology and neuroscience.