Ambarella, Inc. announced its autonomous driving (AD) software stack, which is primarily based on deep learning AI processing for all of its modular components, including environmental perception, sensor fusion and vehicle path planning. This leading-edge AD stack and Ambarella’s CV3-AD AI domain controller system-on-chip (SoC) family were designed in conjunction, so the stack runs optimally on the SoC’s CVflow AI engines, minimizing power consumption and the processing load for its on-chip Arm cores. Likewise, these SoCs provide optimal processing for vision and radar sensing and fusion, based on the company’s deep knowledge and experience with these sensing modalities. Additionally, Ambarella’s stack provides a flexible implementation model, enabling automotive OEMs to leverage any or all of its modules in combination with their own software intellectual property.
The latest members of this R&D vehicle fleet include a sensing suite that consists of mono and stereo cameras, as well as Ambarella’s Oculii 4D imaging radar; and all of the processing is being done by the CV3-AD. While Ambarella’s many years of AD and sensor-processing experience led to this optimal configuration, its solutions are flexible to support OEMs’ specific sensing suites (including the option for adding LiDAR).
Another key feature of Ambarella’s software stack is that it only requires readily available, standard-definition (SD) maps; eliminating the need for pre-generated high-definition (HD) maps. Instead, the stack (running on the CV3-AD), generates HD maps in real time using live environmental data from the vehicle’s sensing suite. In contrast, the pre-generated HD maps used by other AD systems are brittle and expensive to maintain, requiring centimeter-level localization capability. They are also unreliable under dynamic conditions such as road construction or accidents. Additionally, Ambarella’s real-time HD map generation is ideal for handling difficult AD scenarios, such as downtown areas in large cities with roundabouts, narrow roads with parked vehicles, heavy traffic, construction, and a high density of pedestrians, cyclists and other vulnerable road users.
Ambarella’s modular AD software and hardware solutions provide OEMs with a scalable platform that enables them to select the CV3-AD family member with the right mix of performance and features for each model in their fleets, opening the door for autonomous features in mass-market vehicles. This includes a broad range of autonomous and semi-autonomous vehicle implementations, from fully featured L2+ systems through to higher levels of autonomy.
The CV3-AD SoCs run Ambarella’s entire AD stack with industry-leading power consumption, providing superior AI performance per watt and simplifying thermal management. In the growing electric vehicle (EV) market, that processing efficiency is particularly important in order to increase battery range. Additionally, because this software and hardware were designed to work optimally together—with the stack using just a small fraction of the CV3-AD’s Arm processing power—automakers have plenty of headroom for integrating additional software to create differentiated features, including those for functional safety.
In addition to its optimized AD software and hardware solutions, Ambarella provides automotive OEMs with a complete tool chain—both in-house and from ecosystem partners. This includes tailored tools for data collection (in conjunction with the CV3-AD’s on-chip encoder), simulation and annotation. Development is streamlined via accelerated software-in-the-loop (SIL) simulations using CV3-AD PCIe server cards, while Ambarella also provides a fully automated 3D annotation pipeline to support AI training.
Leave a Reply