• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Microcontroller Tips

Microcontroller engineering resources, new microcontroller products and electronics engineering news

  • Products
    • 8-bit
    • 16-bit
    • 32-bit
    • 64-bit
  • Applications
    • 5G
    • Automotive
    • Connectivity
    • Consumer Electronics
    • EV Engineering
    • Industrial
    • IoT
    • Medical
    • Security
    • Telecommunications
    • Wearables
    • Wireless
  • Learn
    • eBooks / Tech Tips
    • EE Training Days
    • FAQs
    • Learning Center
    • Tech Toolboxes
    • Webinars/Digital Events
  • Resources
    • Design Guide Library
    • DesignFast
    • LEAP Awards
    • Podcasts
    • White Papers
  • Videos
    • EE Videos & Interviews
    • Teardown Videos
  • EE Forums
    • EDABoard.com
    • Electro-Tech-Online.com
  • Engineering Training Days
  • Advertise
  • Subscribe

Camera simultaneously monitors drivers, captures vehicle occupants for one-way videoconferencing

November 10, 2020 By Redding Traiger Leave a Comment

OmniVision Technologies, Inc. announced in advance of AutoSens Detroit the automotive industry’s first complete solution for dual-mode camera applications. This joint solution simultaneously monitors drivers while capturing vehicle occupants for one-way video conferencing. It features OmniVision’s automotive industry-first OV2312 image sensor, with a dual-mode global shutter that captures both RGB color images and IR images under low-light conditions. These dual captures are then processed simultaneously by Ambarella’s CV22AQ CVflow computer vision processor, which runs Smart Eye’s algorithms to analyze the driver’s state and alert the vehicle to any unsafe indicators, such as drowsiness. The companies worked together to integrate and fine-tune this solution, which is available as a complete reference design, allowing automotive designers to focus on differentiating their final application while simplifying the overall design effort.

The companies are currently in discussions with automotive OEMs regarding the implementation of this reference design in upcoming car models. This joint solution enables the full range of driver and cabin monitoring implementations, from safety applications to augmented reality displays and interior sensing with deep neural networks and AI. The solution’s one-way video conferencing allows remote conference participants to see those in the vehicle, while the vehicle receives only audio to reduce driver distraction.

The OmniVision OV2312 is a dual-mode automotive image sensor, enabling single-camera driver state monitoring and viewing applications, such as the videoconferencing capability in this reference design. It remains the automotive industry’s only RGB-IR global shutter image sensor while offering the smallest size in its class of 2MP sensors. The OV2312 provides advanced ASIL functional safety and industry-leading near-infrared (NIR) light performance of 14% quantum efficiency at the 940nm wavelength, along with excellent modulation transfer function (MTF). Its power consumption is also industry-leading, consuming just 190mW in typical conditions. The end result is that the OV2312 reduces the number of image sensors in the system, saving both power and space by eliminating the need for multiple rolling shutter sensors.

The OV2312 is the latest member of OmniVision’s automotive global shutter image sensor family. It is pin-to-pin compatible with the OV2310 and OV2311 family members, which provides designers with the flexibility to choose the best feature set for their needs.

Ambarella’s scalable CVflow processor family provides a full range of systems on chip (SoCs) across multiple performance and price points. The company’s powerful image signal pipeline (ISP), with support for OmniVision’s dual-mode RGB-IR color filter arrays, enables high-accuracy detection and monitoring, even in low-light, in-cabin environments. Its high dynamic range (HDR) processing extracts maximum image detail in high-contrast scenes, further enhancing the chip’s computer vision capabilities and the performance potential of Smart Eye algorithms.

Smart Eye’s DMS solution offers eye-tracking software for integration in passenger cars and other vehicles to facilitate better safety and other functions that improve the user experience. By carefully studying eye, facial and head movement, Smart Eye’s interior vehicle algorithms can draw conclusions about a person’s alertness, attention, and focus.

This joint reference design, including a demo board equipped with the three companies’ pre-tuned devices and software, is expected to be available to qualified customers later this quarter. Customers interested in obtaining this 3-way demo should contact their local sales representative for one of the three companies.

You may also like:


  • What is the HART protocol?

  • Quantum compasses and optical imaging for global positioning and navigation

  • Securing embedded systems in a hostile world
  • SPI protocol
    How does the SPI protocol work?
  • Memory technologies
    Memory technologies and packaging options

Filed Under: Applications, Automotive, Industrial, Reference designs, Security, Sensor modules, Software, Tools, Tracking Tagged With: omnivisiontechnologies

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Featured Contributions

Five challenges for developing next-generation ADAS and autonomous vehicles

Securing IoT devices against quantum computing risks

RISC-V implementation strategies for certification of safety-critical systems

What’s new with Matter: how Matter 1.4 is reshaping interoperability and energy management

Edge AI: Revolutionizing real-time data processing and automation

More Featured Contributions

EE TECH TOOLBOX

“ee
Tech Toolbox: 5G Technology
This Tech Toolbox covers the basics of 5G technology plus a story about how engineers designed and built a prototype DSL router mostly from old cellphone parts. Download this first 5G/wired/wireless communications Tech Toolbox to learn more!

EE Learning Center

EE Learning Center

EE ENGINEERING TRAINING DAYS

engineering
“bills
“microcontroller
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for EE professionals.

DesignFast

Design Fast Logo
Component Selection Made Simple.

Try it Today
design fast globle

Footer

Microcontroller Tips

EE World Online Network

  • 5G Technology World
  • EE World Online
  • Engineers Garage
  • Analog IC Tips
  • Battery Power Tips
  • Connector Tips
  • DesignFast
  • EDA Board Forums
  • Electro Tech Online Forums
  • EV Engineering
  • Power Electronic Tips
  • Sensor Tips
  • Test and Measurement Tips

Microcontroller Tips

  • Subscribe to our newsletter
  • Advertise with us
  • Contact us
  • About us

Copyright © 2025 · WTWH Media LLC and its licensors. All rights reserved.
The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media.

Privacy Policy