CVPR 2021 Workshop on Event-based Vision - OCULI SPU: Real-time Vision Intelligence at the Edge with Software-Defined Features

Event: CVPR 2021 Workshop on Event-based Vision · Duration: 11 min · ▶ Watch on YouTube

Abstract

This presentation introduces OCULI’s Sensing and Processing Unit (SPU), a novel single-chip architecture designed to deliver real-time vision intelligence at the edge. The SPU aims to overcome the limitations of traditional artificial vision systems by mimicking the efficiency and speed of human vision, consuming significantly less power and bandwidth. It achieves this through integrated neuromorphic sensing and processing, parallel processing at the pixel level, and software-defined features, making it highly versatile and efficient for various applications.

Speakers

  • Joe Maljian — Oculi

Talks (1)

  • 00:00:00 — Joe Maljian: OCULI SPU: Real-time Vision Intelligence at the Edge with Software-Defined Features
    • A presentation on OCULI’s SPU technology, a single-chip vision solution for real-time, efficient, and software-defined vision intelligence at the edge, mimicking human vision capabilities.

Key Takeaways

  • OCULI SPU offers real-time vision intelligence at the edge, being over 30 times more efficient than traditional alternatives by integrating sensing and processing on a single chip.
  • The SPU architecture mimics human eye-brain communication with bi-directional links and parallel processing at the pixel level, significantly reducing data transfer and power consumption.
  • It is sensor-agnostic, capable of working with various sensor types including infrared (SWIR, MWIR, LWIR), and operates entirely in the digital domain.
  • The SPU provides software-defined features, allowing dynamic configuration to output events, smart events, edges, full frames, or actionable metadata, with up to 99% bandwidth reduction.
  • Demonstrates ultra-fast motion detection (e.g., gun flashes at >30kHz) with very low power consumption (<300mW), outperforming military-grade systems in speed and efficiency.

Methods / Models / Datasets Mentioned

  • OCULI S11 SPU
  • OCULI S41 SPU
  • IntelliPixel
  • FusionSensor
  • OCULI P11B VI Platform

Topics

Bionic Vision · Edge AI · Neuromorphic Sensing · Real-time Vision Intelligence · Low Power Consumption · Low Bandwidth · Software-Defined Features · Sensor Agnostic · Event-based Vision


Notes

Open for commentary — connections to other work, critiques, follow-up reading.