Developers can turn to model optimization frameworks and libraries, model optimization, distillation, and compression tools, plus hardware-specific optimization tools and development platforms for optimizing edge AI performance. Kubernetes and containerization provide additional tools for optimizing AI edge performance. Frameworks and libraries are collections of pre-written code. Libraries are collections of components, classes, and methods that […]
Featured
What are the hardware strategies for building energy-efficient AI accelerators?
Artificial intelligence (AI) applications are spreading to more industries every day. However, the amount of energy used by these AI systems has become a significant issue. Modern deep neural networks require a considerable amount of computing power. This article examines five key hardware strategies for building energy-efficient AI acceleration: dedicated accelerator architectures, analog in-memory computing, […]
How to select and place antennas in IoT devices
Impacting range and performance, antenna selection and placement are key design considerations for Internet of Things (IoT) device manufacturers. This article reviews the most widely used IoT antennas and discusses their application-specific functions. It also highlights optimal design and placement strategies, offering detailed guidelines for each antenna type. Range and frequency requirements Range and frequency […]
How can silent data corruption be detected and corrected in AI systems?
Silent data corruption (SDC), sometimes called bit rot or silent data errors (SDEs), refers to errors in data that are not detected by standard error-checking mechanisms, leading to potentially significant data loss or incorrect calculations. SDCs can lead to inaccurate training, incorrect predictions, and unreliable performance. Detecting SDC requires specialized techniques and tools. SDCs can […]
How can neuromorphic devices be harnessed in edge AI computing?
Neuromorphic computing, which mimics the human brain’s architecture and function, can be leveraged in edge computing to improve power efficiency, speed, and adaptability. By processing data locally and using event-driven computation, neuromorphic chips can optimize resource usage in edge AI applications, reducing reliance on centralized cloud processing. Spiking neural networks (SNNs) are the most common […]
What is ‘compute-in-memory’ and why is it important for AI?
If you are running AI workloads, here is something that might surprise you. Your processors are wasting more energy shuffling data around than actually doing the calculations you care about. This inefficiency is becoming a serious limit for the next generation of artificial intelligence systems. As neural networks grow to billions of parameters, traditional von […]
How does the Zenoh protocol enhance edge device operation?
Zenoh is an open-source platform that manages data in transit and at rest across the entire edge-to-cloud continuum, as well as facilitates computations on edge devices. Targeted applications include robotics, automotive, and IoT. Its low overhead makes it compatible with low-power or bandwidth-limited networks like LPWAN, LoWPAN, and Bluetooth Low Energy (BLE). Zenoh is primarily […]
How do AI agents and model context protocol work together?
An AI agent, combined with a model context protocol (MCP), can create more contextual AI systems that can perform a wide range of tasks, from automating processes to providing insights and interacting with users. MCP helps AI agents connect to data sources, enabling them to access information, collaborate with other systems, and make decisions based […]
What is the math of negative feedback and how is it used to ensure stability?
Negative feedback can create a control system where the output of a process is used to counteract any deviations from a desired set point, effectively “correcting” the system, bringing it back to equilibrium, and maintaining stable operation. It’s used in a variety of applications, including voltage regulation, temperature controllers, audio amplifiers, and operational amplifiers. This […]
What are the different key layers of IoT architecture? part 2
This second part of the FAQ discusses the three upper layers of the IoT architecture, which extend beyond the physical and network layers. The middleware layer processes and manages raw IoT data from connected devices. The application layer provides user interfaces and visualization tools. The business layer converts technical capabilities into actionable business outcomes. Part […]
