Morning Edition · Saturday, November 21, 2026Published at 1:18 AM EST · New York
Nvidia's Blackwell generations accounted for 74% of the added inference capacity, according to Epoch's new Inference Performance Index, which accounts for memory bandwidth.

Epoch AI, the research group that tracks AI compute, estimates that the agentic inference capacity of all AI chips sold to date rose 4.6 times between the second quarter of 2025 and the second quarter of 2026. Peak 8-bit compute for the sam…
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
Track all trends and read every AI and Crypto article for $19/month.
Part of a tracked trend
The Inference-Cost Efficiency Race
Techniques that cut tokens generated and KV-cache memory per query will keep compressing the marginal cost of serving reasoning models, making inference efficiency a recurring competitive axis alongside raw capability.
Start a discussion in Townsquare.
More from this edition
Comments
0No comments yet.