Polylog
The Polylog AI Intelligence Brief

Morning Edition · Tuesday, July 7, 2026

Amodei Says 100-Million-Word Context Is Possible, With Inference the Bottleneck

Anthropic's chief executive frames context length, not learning ability, as the near-term frontier for in-context learning.

Amodei Says 100-Million-Word Context Is Possible, With Inference the Bottleneck

Anthropic chief executive Dario Amodei argued in a recent interview that a context window of 100 million words is already technically possible, a span he compared to roughly everything a person hears in a lifetime. His framing puts the cons…

Continue the AI Intelligence Brief

Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.

  • 5 AI intelligence signals a day
  • Frontier labs, compute, and chips
  • Model releases and AI infrastructure
  • Source-grounded analysis with confidence labels

The Global Intelligence Brief stays free.

Part of a tracked trend

Frontier Model Efficiency Gains

Capability per unit of training and inference compute keeps improving, letting newer models match prior frontier performance far more cheaply and gradually loosening the link between raw scale and capability.