Morning Edition · Friday, September 18, 2026Published at 2:27 AM EDT · New York
A single module draws 16.0 watts against 44.2 watts for four 128-gigabyte modules of the same total capacity, and Micron says a 24-slot dual-socket server could hold 12 terabytes.

Micron demonstrated a 512-gigabyte registered dual in-line memory module (RDIMM) running across multiple server platforms, and describes it as the first module of its kind. The module stacks dynamic random-access memory dies using through-silicon vias, a vertical interconnect method that raises capacity per slot without adding slots. Micron cites speeds up to 9,200 megatransfers per second and says a 24-slot dual-socket server could carry 12 terabytes of main memory. Volume production is targeted for the second half of 2027, and both Advanced Micro Devices and Intel are validating the part, per reporting on the demonstration.
The power figures are the operationally significant part. One 512-gigabyte module draws 16.0 watts, against 44.2 watts for four 128-gigabyte modules delivering the same capacity, a reduction of more than 60 percent in operating power for that capacity. In a data center where the power budget per rack is fixed, capacity that arrives without a proportional increase in power draw converts directly into more usable memory per rack.
The Russian-language technical channel that circulated the announcement framed the target market plainly: large language models, agent systems, real-time inference and in-memory databases, on the logic that more main memory means fewer accesses to slower storage. That framing is accurate. Long-context serving, key-value cache offload, and mixture-of-experts models that page expert weights between host memory and accelerators are all memory-capacity problems rather than arithmetic-throughput problems.
Two caveats belong on the demonstration. A validated part in 2026 with volume production in late 2027 does not relieve any constraint in the current serving generation, and Micron's superlative is the company's own. What the announcement confirms is the direction of supplier roadmaps.
What this means
Serving economics for long-context and agentic workloads increasingly depend on how much state a host can hold near the accelerator, which shifts bargaining power toward memory suppliers and toward whoever controls memory-tier software. Micron, SK Hynix and Samsung gain pricing leverage on high-density server memory, while cloud operators gain a path to more context per dollar without buying more accelerators. The timing matters for capital planning: the relief arrives in the 2027 to 2028 build cycle, so inference providers facing capacity limits this year still have to solve them in software, through cache compression and token reduction.
Start a discussion in Townsquare.
More from this edition
What to watch
Observations to monitor, not financial advice.
Synthesized from: Polylog editors · Micron investor relations · Unite.AI
Comments
0No comments yet.