Generative artificial intelligence (AI) hallucinations, where an AI delivers incorrect or fabricated information, can offer benefits, especially in creative and exploratory domains like drug discovery. There are four common types of AI hallucinations (Figure 1). Not all types are equally desirable or useful. General contradictions include context conflicts and sentence contradictions. For example, an AI […]
Why is the Matter 1.4.2 update important?
Matter 1.4.2 is a maintenance release that improves security, streamlines certification, and optimizes infrastructure operation. This article presents only highlights. In addition to improving certain areas of performance, it adds more new features than most maintenance releases. And, like most maintenance releases, it addresses issues found in previous versions and fine-tunes operations to improve reliability, […]
When should you use RAG, TAG, and RAFT AI?
Retrieval-augmented generation (RAG) and table-augmented generation (TAG) are both techniques to improve the ability of artificial intelligence (AI) to generate accurate and relevant information by leveraging external data. Other choices include retrieval-augmented fine-tuning (RAFT) and retrieval-centric generation (RCG). Understanding when to use RAG, TAG, RAFT, and RCG can be crucial to successful and efficient AI […]
What is JESD209-6 and why is it important for edge AI?
JESD209-6, the recently released LPDDR6 (low power double data rate 6) standard by JEDEC, represents a significant leap forward in memory technology, particularly for devices with limited power budgets. It’s crucial for the next generation of mobile devices, AI applications, and edge computing, where high performance and power efficiency are paramount. It’s also expected to […]
What kinds of tools are available for optimizing edge AI performance?
Developers can turn to model optimization frameworks and libraries, model optimization, distillation, and compression tools, plus hardware-specific optimization tools and development platforms for optimizing edge AI performance. Kubernetes and containerization provide additional tools for optimizing AI edge performance. Frameworks and libraries are collections of pre-written code. Libraries are collections of components, classes, and methods that […]
How can silent data corruption be detected and corrected in AI systems?
Silent data corruption (SDC), sometimes called bit rot or silent data errors (SDEs), refers to errors in data that are not detected by standard error-checking mechanisms, leading to potentially significant data loss or incorrect calculations. SDCs can lead to inaccurate training, incorrect predictions, and unreliable performance. Detecting SDC requires specialized techniques and tools. SDCs can […]
How can neuromorphic devices be harnessed in edge AI computing?
Neuromorphic computing, which mimics the human brain’s architecture and function, can be leveraged in edge computing to improve power efficiency, speed, and adaptability. By processing data locally and using event-driven computation, neuromorphic chips can optimize resource usage in edge AI applications, reducing reliance on centralized cloud processing. Spiking neural networks (SNNs) are the most common […]
How does the Zenoh protocol enhance edge device operation?
Zenoh is an open-source platform that manages data in transit and at rest across the entire edge-to-cloud continuum, as well as facilitates computations on edge devices. Targeted applications include robotics, automotive, and IoT. Its low overhead makes it compatible with low-power or bandwidth-limited networks like LPWAN, LoWPAN, and Bluetooth Low Energy (BLE). Zenoh is primarily […]
How do AI agents and model context protocol work together?
An AI agent, combined with a model context protocol (MCP), can create more contextual AI systems that can perform a wide range of tasks, from automating processes to providing insights and interacting with users. MCP helps AI agents connect to data sources, enabling them to access information, collaborate with other systems, and make decisions based […]
What is the math of negative feedback and how is it used to ensure stability?
Negative feedback can create a control system where the output of a process is used to counteract any deviations from a desired set point, effectively “correcting” the system, bringing it back to equilibrium, and maintaining stable operation. It’s used in a variety of applications, including voltage regulation, temperature controllers, audio amplifiers, and operational amplifiers. This […]
