Micron unveils the evolution of server memory: DDR5 at 9200 MT/s and 256 GB per single module

Micron has raised the bar in the server memory sector with the launch of sampling for the new 256 GB DDR5 RDIMMs, a solution designed for AI infrastructures, Large Language Models (LLM), real-time inference, and HPC systems. The main innovation lies in the combination of capacity and speed: each module achieves 9,200 MT/s, compared to the current limit of 6,400 MT/s of widely deployed DDR5 RDIMMs.

With this configuration, Micron has claimed performance improvements of over 40%, with a theoretical increase of up to 43.75% compared to current DDR5 server modules. In enterprise scenarios, where numerous memory channels operate in parallel, this translates into a significant growth in overall bandwidth, a crucial element for high-intensity AI workloads and processors with a large number of cores.

At the core of the new module is the latest generation 1-gamma DRAM manufacturing technology, complemented by advanced 3D Stacking (3DS) packaging with Through-Silicon Via (TSV) connections. This architecture allows for stacking multiple DRAMs, doubling the capacity per module from 128 GB to 256 GB without sacrificing density or efficiency.

The increase in capacity is not the only advantage. Micron emphasizes that a single 256 GB module can reduce operational power consumption by over 40% compared to two 128 GB modules, offering direct benefits in energy efficiency, thermal dissipation, and rack server space optimization. For modern data centers, where power and temperature limits are becoming increasingly stringent, this aspect carries considerable weight.

The new memory is designed for current and future server platforms. At this stage, Micron is collaborating with major ecosystem partners for validation on platforms based on AMD EPYC Turin (9005 series) and Intel Granite Rapids-SP, as well as next-generation systems. Compatibility with these environments is a crucial step before large-scale commercial adoption.

With the expansion of language models, agent AI, and advanced enterprise workloads, the demand for more memory per socket is rapidly increasing. Micron's new DDR5-9200 RDIMMs meet this need with a proposal centered on three pillars: more capacity, more bandwidth, and better energy efficiency.

It remains to be seen what the economic positioning will be when the modules enter the market, but extremely high costs are expected, at least in the initial phase, consistent with a product primarily aimed at hyperscalers, AI data centers, and ultra-high-end enterprise infrastructures.