• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Microcontroller Tips

Microcontroller engineering resources, new microcontroller products and electronics engineering news

  • Products
    • 8-bit
    • 16-bit
    • 32-bit
    • 64-bit
  • Applications
    • Automotive
    • Connectivity
    • Consumer Electronics
    • Industrial
    • Medical
    • Security
  • EE Forums
    • EDABoard.com
    • Electro-Tech-Online.com
  • Videos
    • TI Microcontroller Videos
  • EE Resources
    • DesignFast
    • eBooks / Tech Tips
    • FAQs
    • LEAP Awards
    • Podcasts
    • Webinars
    • White Papers
  • EE Learning Center
    • Design Guides
      • WiFi & the IOT Design Guide
      • Microcontrollers Design Guide
      • State of the Art Inductors Design Guide
      • Power Electronics & Programmable Power

The three approaches to AI design

April 25, 2019 By John Koon

One of the hottest tech trends is artificial intelligence (AI) and its applications. Various sectors are using AI to solve problems and gain productivity. For instance, a school recently deployed a virtual telephone assistant, also known as a conversational agent, to help students with questions on what classes to take. Students were happy with the answers, and some were completely unaware that they were talking to a robot.

Beyond education, AI can be applied in various sectors, including supply chain, transportation, natural language processing, healthcare, factories, security, object detection, image processing, farming, entertainment, and much more. AI in the audio/video field has also made a marked difference. A California-based start-up, Babblelab, has applied AI using graphics processing unit (GPU) hardware to improve on noise cancellation. The results are remarkable — you can hear the difference before and after AI is deployed.

Designing an AI product

AI is an integration of AI algorithms and AI-based hardware. AI is computation-intensive, requiring fast processing and access to memory.

“AI can demand a great deal of computational power from a chip. It is one matter to process one to two frames per second for a facial recognition application, something which can easily be done on an MCU. It’s a totally different matter to process HD video streaming at 1024×1024, where the processor must process 50 frames a second,” commented Markus Levy, Director of AI and Machine Learning Technologies, NXP Semiconductors.

There are three different approaches to designing AI:

  • Using an all-in-one GPU module
  • Taking the AI chipset approach
  • Just add the AI accelerators to your own host processor

Using an all-in-one GPU module

The NVIDIA CUDA-X AI computer measures 70mm x 45mm and can crank out 472 GFLOPS of compute performance, which can handle most AI or deep learning workloads. Based on the G128-core NVIDIA Maxwell architecture-based GPU and Quad-core Arm A57, this GPU machine consumes 5 watts of power.

Additionally, it supports 16 GB eMMC 5.1 Flash, Gigabit Ethernet, video, camera, and HDMI display. Perhaps its most attractive feature is the library of software-acceleration codes to make development work easier. Developers using this approach can integrate the module into their own systems with Linux for Tegra

ai design
Figure 1: The NVIDIA CUDA-X AI computer measures 70mm x 45mm and can crank out 472 GFLOPS of compute performance. (Image: NVIDIA)

Taking the AI chipset approach

Not everyone needs a muscle car when it comes to driving. Similarly, in AI design, there are plenty of applications that need a low-cost, scalable AI chip. That is where NXP’s i.MX 8M Nano – Arm Cortex-A53, Cortex-M7 would be a good fit. This 14LPC FinFET based chip brings AI functions to many industrial and IoT applications.  Uses include smart home and building automation, machine learning (i.e., face recognition and anomaly detection), test and measurement, human-machine interface (HMI), health care diagnostics, health care monitoring, and other medical devices.

For machine vision applications, the  3D GPU with OpenGL ES 3.1 and Vulkan support enables graphical UI or 3D GPU with OpenCL using all four Cortex-A53 cores to accelerate machine learning. The 14 x 14, 0.5mm package supports a 6-8 layer board design. Operating systems available are Android, Linux, and FreeRTOS. The unit operates from -40 ºC to 105 ºC. Additionally, a software library is available for AI specific applications.

Figure 2: NXP’s i.MX 8M Nano block diagram. (Image: NXP)

Just add the AI accelerators to your own host processor

Taking a different approach, Gyrfalcon Technology, founded in 2017 in California, offers three production level AI accelerator chips using the company’s proprietary matrix processing engine, which combines the processing with memory to augment the host processor to perform audio and video processing from edge to cloud. The Lightspeeur 2801S measures 7mm x 7mm delivers 2.8 TOPS at 0.3 watts and is ideal for Edge AI applications.

There is also the Lightspeeur 2803S, which measures 9mm x 9mm and has been optimized for advanced edge or data center applications. It can be used in single-chip designs or configured in multiple chip configurations for data center applications. For example, 16 of those chips can be offered on a GAINBOARD 2803 PCIe card to deliver up to 270 TOPS  consuming 28 watts for server applications. Additionally, its Lightspeeur 2802M is the first AI accelerator combining the magnetoresistive random access memory (MRAM) technology and its matrix processing design to form an MRAM AI engine. This can be used in video security monitoring, autonomous vehicles, robotics, and other AI applications. Gyrfalcon’s approach helps developers to increase the AI computation power without replacing host processors (CPU, GPU, etc.).

Figure 3: Gyrfalcon Technology’s AI acceleration chips provide AI computing without replacing the host processor (GPU, CPU). (Image: Gyrfalcon Technology)

Conclusion

The three approaches described here offer unique solutions to design for AI. Using the less than $100 NVIDIA module approach developers can integrate the unit in the OEM system. With the NXP AI chip priced at under $10, developers have more flexibility, but also more PCB development and layout work. Finally, the Gyrfalcon accelerator chip solution means adding another chip to the existing processor design, and it can come in handy for developers with legacy designs already in place. Now you can take your pick.

You may also like:


  • AI platform understands textual info, processes natural language
  • Artificial Intelligence
    DIY Artificial Intelligence
  • AI platform
    AI platform provides hardware blocks for low-power AI at the…
  • Tape-outs for SoCs
    Software helps explore processing and memory architecture options for AI…

Filed Under: Applications, Artificial intelligence, FAQ, Featured, microcontroller Tagged With: cyrafalcontechnology, nvidia, nxpsemiconductors

Primary Sidebar

DesignFast

Design Fast Logo
Component Selection Made Simple.

Try it Today
design fast globle

EE Training Center Classrooms

EE Classrooms

CURRENT DIGITAL ISSUE

A frequency you can count on There are few constants in life, but what few there are might include death, taxes, and a U.S. grid frequency that doesn’t vary by more than ±0.5 Hz. However, the certainty of the grid frequency is coming into question, thanks to the rising percentage of renewable energy sources that…

Digital Edition Back Issues

Subscribe to our Newsletter

Subscribe to weekly industry news, new product innovations and more.

Subscribe today

RSS Current EDABoard.com discussions

  • Why is the voltage negative in this circuit
  • Extract spice netlist from Prime Time
  • AD75019 input loading
  • Why this antenna azimuth and elevation direction are the same?
  • Input Reference Clock for PLL aside from Crystal Oscillator

RSS Current Electro-Tech-Online.com Discussions

  • Seeking Help to compile code
  • Nokia 5110 HW in Oshonsoft
  • Digital Display Information
  • 2nd pcb design program?
  • Door exit button

Footer

Microcontroller Tips

EE World Online Network

  • DesignFast
  • EE World Online
  • EDA Board Forums
  • Electro Tech Online Forums
  • Connector Tips
  • Analog IC Tips
  • Power Electronic Tips
  • Sensor Tips
  • Test and Measurement Tips
  • Wire and Cable Tips
  • 5G Technology World

Microcontroller Tips

  • Subscribe to our newsletter
  • Advertise with us
  • Contact us
  • About us
Follow us on Twitter Add us on Facebook Follow us on YouTube  Follow us on Instagram

Copyright © 2022 · WTWH Media LLC and its licensors. All rights reserved.
The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media.

Privacy Policy