Next-Generation EPYC: AMD to Support LPDDR5X Memory on SOCAMM2 Modules

AMD has announced its intention to support LPDDR5X memory in SOCAMM2 format with its sixth-generation EPYC server platforms, while still supporting traditional DDR5. This choice reflects a broader evolution in the datacenter market, where energy efficiency, computational density, and bandwidth are becoming critical factors, particularly with the rise of workloads related to artificial intelligence and large-scale data analysis.

The SOCAMM2 format (Small Outline Compression Attached Memory Module), standardized by JEDEC, represents an attempt to combine the efficiency characteristics of LPDDR memory - historically used in mobile applications - with the modularity and maintainability required in servers. Unlike LPDDR implementations that are soldered onto the motherboard, SOCAMM2 introduces replaceable modules, making this technology more suitable for enterprise environments.

One of the main advantages highlighted by AMD concerns energy consumption. LPDDR5X operates at lower voltages compared to DDR5. This aspect is particularly relevant in modern servers, where memory increasingly impacts both the energy budget and operational costs. With configurations that can reach 8, 12, or more memory channels, even small efficiency improvements per module translate into significant savings on a datacenter scale.

In addition to efficiency, SOCAMM2 introduces a more compact form factor compared to traditional RDIMM modules. The reduced size and horizontal mounting on the motherboard favor better airflow management and simplify the design of cooling systems. This approach can facilitate the creation of higher-density servers.

From a performance standpoint, LPDDR5X offers high transfer speeds, with a roadmap aimed at exceeding 8,000 MT/s and approaching 12,800 MT/s. These characteristics are particularly relevant for bandwidth-sensitive workloads, such as AI inference, distributed databases, and cloud-native applications.

However, the technology still presents some limitations compared to established DDR5 solutions, particularly in terms of RAS (Reliability, Availability, Serviceability) features. LPDDR memories are designed for consumer and mobile devices, where the requirements for continuous operation and error correction are less stringent than those required in servers. In contrast, RDIMM modules have long integrated advanced mechanisms such as chip-level and module-level ECC, as well as capabilities for managing multiple errors and faults at the connection level.

The ecosystem is working to bridge this gap, introducing improvements at the controller, firmware, and packaging levels. However, in the short term, LPDDR5X SOCAMM2 solutions may primarily find application in specific scenarios, such as highly scalable AI environments or software-resilient architectures.

“The sixth-generation AMD EPYC server CPU family will support industry-standard DDR5 RDIMM and MRDIMM-based memories. It will also offer models that support the new LPDDR5x SOCAMM2-based memory. In the server market, AMD expects to support LPDDR5x SOCAMM2 memory with the sixth-generation AMD EPYC server CPU, codenamed 'Verano,' which will be available in 2027. Verano will be the host CPU optimized for future generations of AMD Instinct GPUs and leverage LPDDR5X SOCAMM2 to deliver optimized performance per watt in AMD’s AI Rack Scale solutions,” writes AMD in a post.

Overall, LPDDR5X SOCAMM2 emerges as a complementary rather than a replacement solution for DDR5. While traditional DIMMs will continue to represent the standard for many years due to their maturity, costs, and RAS features, the new low-power memories could carve out a growing role in energy-efficient datacenters and high-density applications.