iniVation Neuromorphic Vision Systems: Core Technology, Software, and Applications

Event: iniVation Company Overview · Duration: 12 min · ▶ Watch on YouTube

Abstract

This video provides an overview of iniVation’s cutting-edge neuromorphic vision systems, which leverage event-based sensing inspired by the human retina for superior performance. It details the evolution of their core hardware technology, including the DVS and DAVIS sensors, emphasizing advancements in speed, efficiency, and dynamic range. The presentation also introduces DV software, an open-source, multi-platform development kit designed to facilitate rapid application development for these unique sensors. Finally, it showcases diverse applications, from high-speed laser profiling and space missions to micropower intelligent scene analysis and the world’s fastest eye tracker.

Speakers

  • Kynan Eng — iniVation CEO
  • Chenghan Li — iniVation Head of Hardware
  • Thomas Debrunner — iniVation Head of Software

Talks (9)

  • 00:00:09 — Kynan Eng: Introduction to iniVation and Neuromorphic Vision
    • Introduces iniVation’s mission to produce high-performance, ultra-efficient intelligent computer vision systems, highlighting the inefficiencies of traditional frame-based processing versus the advantages of dynamic vision sensors like faster response times, higher dynamic range, and improved efficiency.
  • 00:01:19 — Chenghan Li: Core Technology Evolution
    • Traces the evolution of iniVation’s event-based vision hardware from the 2005 DVS sensor and 2008 DVS128 camera to the 2011 DAVIS concept (combining events and frames), and further advancements in readout architecture and in-pixel noise filtering, culminating in the ultra-low power DVS132 prototype.
  • 00:05:07 — Thomas Debrunner: DV Software for Event-Based Vision
    • Presents DV software, a modular and extensible runtime framework launched in 2019, designed for rapid real-time development of high-performance vision applications, supporting iniVation’s neuromorphic cameras and other sensors, with multi-platform compatibility and a C++ API for custom pipelines.
  • 00:07:45 — Kynan Eng: Applications Overview
    • Briefly introduces the diverse application areas where iniVation’s neuromorphic vision technology is making an impact.
  • 00:08:14 — Kynan Eng: DVL-5000 High-Speed Laser Profiler
    • Showcases the DVL-5000, an ultra-fast 5 kHz laser profiler leveraging patented neuromorphic technology for high accuracy, low latency, and high dynamic range in applications like real-time quality control, glue/sealant application, and infrastructure scanning.
  • 00:09:29 — Kynan Eng: Space Applications
    • Highlights iniVation’s entry into space applications, noting the DAVIS240 camera’s launch as the first neuromorphic technology in space for satellite monitoring, positioning, and atmospheric monitoring.
  • 00:10:01 — Kynan Eng: Speck Micropower Intelligent Scene Analysis
    • Introduces ‘Speck,’ a micropower intelligent scene analysis solution developed in partnership with SynSense, designed for mobile and IoT applications.
  • 00:10:29 — Kynan Eng: Foveator Eye Tracker
    • Presents ‘Foveator,’ touted as the world’s fastest eye tracker, boasting sub-3ms latency, sub-1.0° accuracy, 1 kHz update rate, and a compact 2mm sensor, offering benefits like higher quality graphics, faster refresh rates, and longer battery life.
  • 00:11:28 — Kynan Eng: The Future
    • Concludes the presentation by emphasizing the ongoing developments and future potential of iniVation’s neuromorphic vision systems.

Key Takeaways

  • iniVation’s neuromorphic vision systems offer significant advantages over traditional frame-based cameras, including ultra-fast response times (<0.1ms), high dynamic range (120dB), and superior power efficiency.
  • The company has a strong history of innovation in event-based sensor hardware, continuously improving readout speed, efficiency, and noise suppression, leading to highly power-efficient prototypes.
  • The DV software provides a comprehensive, open-source, and multi-platform development environment, enabling rapid prototyping and deployment of neuromorphic vision applications on various embedded and IoT devices.
  • iniVation’s technology is being applied across diverse high-demand sectors, including high-speed laser profiling (DVL-5000), space applications (DAVIS240), micropower scene analysis (Speck), and ultra-fast eye tracking (Foveator).

Methods / Models / Datasets Mentioned

  • DVS
  • DAVIS
  • Neuromorphic algorithms
  • C++
  • Python
  • ROS
  • libcaer

Topics

Neuromorphic Vision · Event-Based Sensors · Dynamic Vision Sensor (DVS) · DAVIS Sensor · Low Latency · High Dynamic Range · Ultra-Low Power · Computer Vision Software · Embedded Systems · Space Applications · Laser Profiling · Eye Tracking · IoT · Real-time Processing · Hardware Development · Software Development

Notes

Open for commentary — connections to other work, critiques, follow-up reading.