Ambarella, Inc. announced its new Artificial Intelligence Image Signal Processor (AISP). The company is showcasing this technology at its invitation-only event during CES 2022 in Las Vegas this week, running on its CV2 edge AI perception systems on chip (SoCs).

Drawing on its 17 years of experience in ISP processing and best-in-class CVflow AI engine, Ambarella’s new AI-based ISP architecture uses neural networks to augment the image processing done by the hardware ISP integrated into its SoCs. This approach enables color imaging with low light at very low lux levels and minimal noise, a 10 to 100X improvement over state-of-the-art traditional ISPs, and new levels of high dynamic range (HDR) processing with more natural color reproduction and higher dynamic range.

Initially demonstrated on the CV2 SoCs during CES this week, the new AISP will become available across Ambarella’s entire CVflow SoC portfolio at resolutions up to 4K. The applications of this technology encompass all of the company’s target markets, where low-light and HDR processing are critical. This includes security and automotive cameras, where full-color night vision is a key operating point, and where better low-light and HDR enable reductions in external illumination, the use of lower-cost sensors, and cleaner video for both human viewing and analytics processing.

A good example of this new technology in action, which will be demonstrated during CES running on the CV2, is a typical security camera trying to identify a license plate at night. With noisy video, the text on the license plate would be unreadable, even to the best AI algorithm. And with black and white video, all color information on the car would be lost. By using Ambarella’s AISP technology and restoring colors at the source before AI processing, the license plate can be clearly read and the color of the car identified.

The AISP processing happens in parallel on the silicon with other higher-level AI applications running on Ambarella’s CVflow AI engine. This enables customers to build their next-generation of cameras with both higher visual quality and more accurate AI algorithms, while staying within the low power budgets required by small embedded systems.

Other Key features of the AISP include:

• Support for mainstream sensors
• Seamless switching between different lighting conditions, including day, night, and HDR scenes
• A set of tuning tools for sharpening, CE, AE, AWB, etc.
• Ability to run in parallel with other AI algorithms on the CVflow engine
• Advanced operational modes to fit application-specific use cases

The new AISP is expected to be made available across Ambarella’s entire CVflow SoC portfolio during 2022, with different price and performance options.