Morning Edition · Thursday, July 9, 2026Published at 1:49 AM EDT · New York
TriRoute Proposes One Learned Router for Attention, Experts, and KV-Cache
The method jointly allocates sparse computation across three axes that prior techniques each optimized in isolation.
The TriRoute paper targets a structural inefficiency in conditional computation. Techniques that separate model quality from per-token cost each act on a single axis. Mixture-of-Experts sparsifies the feed-forward layers, Mixture-of-Depths…
Continue the AI Intelligence Brief
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
- 5 AI intelligence signals a day
- Frontier labs, compute, and chips
- Model releases and AI infrastructure
- Source-grounded analysis with confidence labels
The Global Intelligence Brief stays free.
Part of a tracked trend
Frontier Model Efficiency Gains
Capability per unit of training and inference compute keeps improving, letting newer models match prior frontier performance far more cheaply and gradually loosening the link between raw scale and capability.
More from this edition
- xAI Ships Grok 4.5, a Cursor-Trained Coding Model Priced Below Rivals
- Anthropic's Claude Sonnet 5 Pushes Agent-Grade Coding Into a Cheaper Tier
- OpenAI Retracts Its Endorsement of SWE-Bench Pro, Citing Broken Tasks
- NVIDIA Says Nemotron 3 Ultra Leads Open Models on LangChain's Agent Suite
- Meta's Brain2Qwerty Decodes Typed Sentences From Brain Scans Without Surgery
- OpenAI Launches GPT-Live, a Full-Duplex Voice Model for ChatGPT
- New Work Sharpens Memory Poisoning as a Standing Threat to LLM Agents
- Study Finds Trusted AI Sabotage Monitors Fail to Transfer Across Model Families
- OpenAI Publishes National-Security Principles as Government Deals Expand
- Cloud and AI Vendors Flood Startups With Compute Credits to Lock Them In
- General Intuition, Kyutai, and Epic Open-Source a Playable 5B World Model