Polylog
The Polylog AI Intelligence Brief

Morning Edition · Saturday, June 27, 2026

Ai2's OLMo Hybrid Argues Attention Plus Linear RNNs Beats Either Alone

The Allen Institute's 7-billion-parameter hybrid interleaves transformer attention with Gated DeltaNet, reaching OLMo 3's accuracy on the Massive Multitask Language Understanding (MMLU) benchmark using 49 percent fewer tokens.

Ai2's OLMo Hybrid Argues Attention Plus Linear RNNs Beats Either Alone

The Allen Institute for AI published the work behind OLMo Hybrid, a 7-billion-parameter model that interleaves standard transformer attention layers with Gated DeltaNet, a modern linear recurrent neural network. The Russian-language summary…

Continue the AI Intelligence Brief

Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.

  • 5 AI intelligence signals a day
  • Frontier labs, compute, and chips
  • Model releases and AI infrastructure
  • Source-grounded analysis with confidence labels

The Global Intelligence Brief stays free.