Morning Edition · Monday, October 19, 2026Published at 2:14 AM EDT · New York
A 46 MB ternary model with a frozen 16 MB vocabulary generates 615 to 740 tokens per second on a laptop CPU, and a second paper finds that about 4% of prompt tokens need full expert routing to preserve accuracy.

Nvidia said RTX Spark laptops are now available from ASUS, Dell, HP, Lenovo, Microsoft and MSI. They combine Blackwell RTX graphics with up to 128GB of unified memory and Nvidia's full AI software stack, and Nvidia quotes a starting price o…
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
The Global Intelligence Brief stays free.
Part of a tracked trend
AI Inference Shifts to Consumer Devices
Over the next 3-6 months, smaller efficient architectures and inference-cost optimizations push capable AI off the cloud and onto laptops, phones, and mobile NPUs.
Start a discussion in Townsquare.
More from this edition
Comments
0No comments yet.