• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer

Microcontroller Tips

Microcontroller engineering resources, new microcontroller products and electronics engineering news

  • Products
    • 8-bit
    • 16-bit
    • 32-bit
    • 64-bit
  • Applications
    • 5G
    • Automotive
    • Connectivity
    • Consumer Electronics
    • EV Engineering
    • Industrial
    • IoT
    • Medical
    • Security
    • Telecommunications
    • Wearables
    • Wireless
  • Learn
    • eBooks / Tech Tips
    • EE Training Days
    • FAQs
    • Learning Center
    • Tech Toolboxes
    • Webinars/Digital Events
  • Resources
    • Design Guide Library
    • DesignFast
    • LEAP Awards
    • Podcasts
    • White Papers
  • Videos
    • EE Videos & Interviews
    • Teardown Videos
  • EE Forums
    • EDABoard.com
    • Electro-Tech-Online.com
  • Engineering Training Days
  • Advertise
  • Subscribe

Memory stack design reaches 4 TB/s bandwidth with eight dies

January 22, 2025 By Redding Traiger Leave a Comment

Numem will be at the upcoming Chiplet Summit to showcase its high-performance solutions. By accelerating the delivery of data via new memory subsystem designs, Numem solutions are re-architecting the hierarchy of AI memory tiers to eliminate the bottlenecks that negatively impact power and performance.

The rapid growth of AI workloads and AI Processor/GPUs are exacerbating the memory bottleneck caused by the slowing performance improvements and scalability of SRAM and DRAM – presenting a major obstacle to maximizing system performance. To overcome this, there is a pressing need for intelligent memory solutions that offer higher power efficiency and greater bandwidth, coupled with a reevaluation of traditional memory architectures.

Numem is redefining traditional memory paradigms with its advanced SoC Compute-in-Memory solutions. Built on its patented NuRAM (MRAM-based) and SmartMem technologies, these innovations tackle critical memory challenges head-on. The result is a groundbreaking approach to scalable memory performance, designed specifically for the demands of HPC and AI applications.

At the Summit, Numem will preview its innovative chiplets – nonvolatile, high-speed, ultra-low power solutions that leverage MRAM to overcome memory challenges in chiplet architectures. Sampling is expected to begin in late Q4’25.

Key features and benefits include: Unparalleled Bandwidth: Delivers up to 4TB/sper 8-die memory stack, exceeding existing AI memoryHBM solutions; High Capacity: Supports 4GB per stack package, enabling scalability for demanding AI workloads; Nonvolatile with SRAM-Like Performance: Combines ultra-low read/write latency with persistent data retention, offering unmatched reliability and efficiency. Provides the scalability and power needed to address the demands of future AI and data-centric workloads; Power Smart: Game-changing power efficiency and AI Edge and Data Center based solutions with the ability to implement multi-state flex power functions (active/standby/deep sleep); Broad Application Compatibility: Optimized for AI applications across OEMs, hyperscalers, and AI accelerator developers to drive the adoption of chiplet-based designs in high-growth markets. Designed with standard industry interfaces such as UCIe to facilitate ecosystem compatibility; Advanced Integration: Complement other chiplet components (e.g., CPUs, GPUs, and accelerators), enhancing the performance and efficiency of the overall system; In-Compute Intelligence: Makes memory smarter by helping to manage incoming data, read/write times, dynamic programmable multi-state flex power, and self-testability; Proven Technology: State-of-the-art memory subsystem IP based on proven foundry MRAM process. Offers improved radiation performance that mitigates exposure to soft errors.

Numem will also demonstrate its patented NuRAM/SmartMem technology, which achieves significantly faster speeds, lower latency and dynamic power consumption compared to other MRAM solutions. It reduces standby power by up to 100x compared to SRAM, with similar bandwidth, and delivers up to 4x faster performance than HBM while operating at ultra-low power.

Demonstrations will be given in Numem’s booth #322 on the show floor of the Santa Clara Convention Center from January 21-23.

You may also like:


  • What are the elements of secure boot processes?

  • How does DMA enable efficient data transfer in microcontrollers?

  • How is Zephyr used for edge AI and sensors?

  • How does a recurrent neural network (RNN) remember?

  • What’s the difference between GPUs and TPUs for AI processing?

Filed Under: Artificial intelligence, Memory, Products, Storage, Tools Tagged With: numem

Reader Interactions

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Featured Contributions

Five challenges for developing next-generation ADAS and autonomous vehicles

Securing IoT devices against quantum computing risks

RISC-V implementation strategies for certification of safety-critical systems

What’s new with Matter: how Matter 1.4 is reshaping interoperability and energy management

Edge AI: Revolutionizing real-time data processing and automation

More Featured Contributions

EE TECH TOOLBOX

“ee
Tech Toolbox: 5G Technology
This Tech Toolbox covers the basics of 5G technology plus a story about how engineers designed and built a prototype DSL router mostly from old cellphone parts. Download this first 5G/wired/wireless communications Tech Toolbox to learn more!

EE Learning Center

EE Learning Center

EE ENGINEERING TRAINING DAYS

engineering
“bills
“microcontroller
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, tools and strategies for EE professionals.

DesignFast

Design Fast Logo
Component Selection Made Simple.

Try it Today
design fast globle

Footer

Microcontroller Tips

EE World Online Network

  • 5G Technology World
  • EE World Online
  • Engineers Garage
  • Analog IC Tips
  • Battery Power Tips
  • Connector Tips
  • DesignFast
  • EDA Board Forums
  • Electro Tech Online Forums
  • EV Engineering
  • Power Electronic Tips
  • Sensor Tips
  • Test and Measurement Tips

Microcontroller Tips

  • Subscribe to our newsletter
  • Advertise with us
  • Contact us
  • About us

Copyright © 2025 · WTWH Media LLC and its licensors. All rights reserved.
The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media.

Privacy Policy