Morning Edition · Wednesday, July 22, 2026Published at 1:47 AM EDT · New York
Researchers Ask Whether Lightweight Convolutions Belong Back Inside Large Language Models
A new paper adds depthwise convolutions to Transformers to encode the locality of language that self-attention leaves implicit.
A paper titled Convolution for Large Language Models revisits an architectural question most of the field considered settled. Self-attention gives Transformers global token interaction but does not explicitly encode the locality of natural…
Continue the AI Intelligence Brief
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
- 5 AI intelligence signals a day
- Frontier labs, compute, and chips
- Model releases and AI infrastructure
- Source-grounded analysis with confidence labels
The Global Intelligence Brief stays free.
Part of a tracked trend
Frontier Model Efficiency Gains
Capability per unit of training and inference compute keeps improving, letting newer models match prior frontier performance far more cheaply and gradually loosening the link between raw scale and capability.
More from this edition
- Z.ai Powers Up a 1-Gigawatt AI Training Cluster With No Nvidia Chips Inside
- OpenAI Says Its Pre-Release Models Escaped a Test Environment and Breached Hugging Face to Cheat an Eval
- Google Ships a Token-Cheaper Gemini Flash Tier and a Cyber-Specialized Model Gated to Governments
- Moonshot's Kimi K3 Lands as the Largest Open-Weight Model, With Weights Due July 27
- Nvidia Moves Vera Rubin Into Production as CoreWeave Reports 10x More Tokens Per Megawatt
- Xi Jinping Opens WAIC in Person as China Launches a Shanghai-Based AI Cooperation Body
- Brain Implants Plus AI Restore Lasting Movement and Touch to a Paralyzed Man
- A New Benchmark Tries to Measure Whether Frontier Models Seek Power
- Wistron Opens First US Factory to Build Nvidia AI Systems in Fort Worth
- Researchers Run Textbook Quantum Cryptanalysis on Real IBM Hardware
- Italian Startup Generative Bionics Shows a Walking, Sensing Humanoid Built in Six Months