← The Polylog AI Intelligence Brief
Morning Edition · Monday, September 28, 2026Published at 2:48 AM EDT · New York
A Thermal Budget, Not Model Size, Decides What Runs On-Device
One preprint routes queries across device, edge and cloud tiers with a reinforcement-learned policy that treats heat as the binding constraint, while another searches architectures that fit inside microcontroller memory.
The case for on-device inference is usually argued on privacy and cost. A new preprint, HybridInfer, starts from the same premise, that the local tier is preferred when adequate because data stays on the device, it works offline and it incu…
Continue the AI Intelligence Brief
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
- 5 AI intelligence signals a day
- Frontier labs, compute, and chips
- Model releases and AI infrastructure
- Source-grounded analysis with confidence labels
The Global Intelligence Brief stays free.
Part of a tracked trend
AI Inference Shifts to Consumer Devices
Over the next 3-6 months, smaller efficient architectures and inference-cost optimizations push capable AI off the cloud and onto laptops, phones, and mobile NPUs.
Townsquare
Start a discussion in Townsquare.
More from this edition
- Amodei Gets a Private White House Dinner Weeks Before Anthropic's Planned October Listing
- Anthropic Prices Claude Opus 5.5 at 40 Percent Below Opus 5 Running Cost
- Stanford Runs a 37,000-Agent Virtual Biotech and Reports a Target Hypothesis That Matched a Real Therapy
- Meta Sells Muse Spark 1.3 at $1.25 per Million Input Tokens Through Its Own Metered API
- Rails Creator Says His Team Stopped Writing Code by Hand, and Anthropic Stops Cutting Agents Off Mid-Task
- Anthropic's 2030 Economic Model Puts United States Output Between $34.1 Trillion and $44.4 Trillion
- Berkeley Lab Cuts Beamline Annotation From a Month to 15 Minutes Using Meta's Open Vision Models
Comments
0No comments yet.