Memory Revolution for Artificial Intelligence: SOCAMM memory is coming

17
Memory Revolution for Artificial Intelligence: SOCAMM memory is coming

Memory manufacturers Micron and SK Hynix introduced the new SOCAMM (Small Outline Compression Attached Memory Module) memory solutions at the Nvidia GTC 2025 event held a few days ago.

This new modular memory form factor is specially designed for Nvidia’s Grace Blackwell platform and developed to meet the needs of high -performance artificial intelligence applications.

SOCAMM: Special memory for artificial intelligence

SOCAMM is based on LPDDR5X technology and optimized to meet the increasing performance and efficiency demands of artificial intelligence servers. This innovative form factor offers higher bandwidth, lower power consumption and a more compact design than traditional RDDMM and MRDIMM modules. SOCAMM, which is compatible with Nvidia’s AI architecture, cannot be used in AMD or Intel systems, which shows that it is a special solution for Nvidia platforms.

Micron announced that it will be the first company to introduce SOCAMM products. Stating that the 128 GB SOCAMM modules are designed for the Nvidia GB300 Grace Blackwell Ultra Superchip, Micron stressed that these modules consume a power of one -third of RDIMMs, while providing 2.5 times more bandwidth. In addition, the modules have a compact size of 14x90mm, supports efficient server editing and thermal management.

Raj Narasimhan, Senior Vice President of Micron’s calculation and network business unit, said that artificial intelligence has created a radical change in the IT world and that memory technology plays a critical role in this change.

SK Hynix’s SOCAMM Solution

In GTC 2025, SK Hynix introduced SOCAMM solutions that consume low power as part of the artificial intelligence memory portfolio. Although the company does not share much details about this technology, it positions SOCAMM as a key component for future artificial intelligence infrastructures.

SK Hynix announced that SOCAMM solutions are planning to start mass production in parallel with the development of the market. The company’s chairman Juston Kim said that they have a differentiated competitive advantage in artificial intelligence memory technology.

SOCAMM solutions introduced by Micron and SK Hynix offer innovative solutions to respond to the increasing demands of artificial intelligence platforms. With higher performance, energy saving and compact design features, SOCAMM stands out as a powerful option for artificial intelligence applications. These developments in the field of artificial intelligence can also be a harbinger of more efficient and innovative memory solutions in the future.