Renesas Electronics Corporation has expanded its AI-capable RZ/V Series of microprocessors (MPUs), with a new device that enables AI processing of image data from multiple cameras, offering a new level of highly accurate image recognition for vision AI applications. Equipped with two 64-bit Arm Cortex-A53 cores, the new device is capable of delivering high computing performance with a maximum operating frequency of 1GHz. The RZ/V2MA features a proprietary low-power DRP-AI (Dynamically Reconfigurable Processor) accelerator which can process vision AI at 1 TOPS/W (tera operations per second, per watt) class performance.
The RZ/V2MA device offers high-speed interfaces such as Ethernet, USB, and PCI Express that allow image input from multiple external cameras. In addition to the DRP-AI accelerator, the RZ/V2MA includes an OpenCV accelerator that allows rule-based image processing simultaneously. These features bring highly accurate image recognition capabilities for machine vision products such as AI-equipped gateways, video servers, security gates, POS terminals, and robotic arms.
The new RZ/V2MA offers a full suite of development tools to aid vision AI system design. In addition to the existing DRP-AI Translator, the new device adds DRP-AI TVM (Note 1), which is based on the open-source deep learning compiler Apache TVM technology (Note 2). While DRP AI Translator is designed to convert AI models into DRP-AI executables, the DRP-AI TVM compiler lets the DRP-AI accelerator work together with the CPU, allowing DRP-AI to convert and generate more AI models than ever before. As a first phase, Renesas supports ONNX and PyTorch AI models and plans to support Tensorflow in the future.
Key Features of the RZ/V2MA include Two 64-bit Arm Cortex-A53 cores with a maximum operating frequency of 1 GHz; AI accelerator DRP-AI (1 TOPS/W class), achieving 52 fps (frames per second) when executing TinyYoloV3 programs; OpenCV accelerator for rule-based image processing; Ethernet, USB, and PCI Express interfaces for image input from external cameras; Video codecs (H.265 and H.264); DRP-AI TVM tool for converting AI models based on TVM technology. Support ONNX and PyTorch formats initially; High-speed memory interfaces include LPDDR4 (3200Mbps), USB 3.1 (up to 5Gbps), and PCI Express (2 lanes); Available in 15mm square BGA package;
Renesas has developed the “Vision AI Gateway Solution,” which is an AI-based object detection and recognition platform that uses multiple cameras to collect and efficiently transmit data wirelessly. This high-speed processing solution combines the RZ/V2MA MPU with complimentary Renesas products such as power ICs, VersaClock clock generator, and communication modules for Wi-Fi, Bluetooth, and LTE. This solution not only provides flexible connectivity options but has an optimized power supply system and has been tested to accelerate the development of robust AI gateway devices. This solution is part of Renesas’ Winning Combinations, which optimally combine mutually compatible Renesas devices that work together seamlessly to reduce user design risk and shorten the time to market. Renesas offers more than 300 other Winning Combinations with a wide range of products from its portfolio.
The RZ/V2MA and development tools are available now.