Morning Edition · Thursday, July 9, 2026Published at 1:49 AM EDT · New York
The model resolves SWE-Bench Pro tasks with about a quarter of the output tokens Anthropic's Opus 4.8 uses, even as it scores lower on the benchmark itself.
xAI released Grok 4.5 on July 8, its first model built from the start for software engineering and autonomous agents. The training run was conducted alongside the code editor Cursor. The model is available in Cursor on every plan, in xAI's build tools, and through the application programming interface (API) at $2 per million input tokens and $6 per million output tokens, roughly half the price of comparable frontier models, and it runs at about 80 tokens per second.
The benchmark results are mixed, and they come from xAI's own numbers, which no third party has yet reproduced. On SWE-Bench Pro xAI reports Grok 4.5 at 64.7 percent, behind Anthropic's Opus 4.8 at 69.2 percent and the Fable line above it, though it leads on the longer-horizon SWE Marathon test at 29.0 percent. The more consequential claim is efficiency. xAI says Grok 4.5 completes SWE-Bench Pro tasks using an average of 15,954 output tokens against 67,020 for Opus 4.8. That is a 4.2-times gap, and if it holds outside the vendor's own test setup, it changes the cost of running an agent far more than a few points of accuracy do.
The release comes the same week that Anthropic shipped Sonnet 5 and OpenAI questioned the reliability of SWE-Bench Pro itself, so the headline percentages should be read with the benchmark's known problems in mind. What is verifiable now is the price and the token accounting. The capability ranking is asserted by the vendor and awaits independent runs.
xAI and Cursor, whose competitive pitch against Anthropic and OpenAI rests on cost-per-task rather than the accuracy ranking they lose; both companies sell the integration the numbers promote.
Part of a tracked trend
Frontier Labs Race on AI Coding Capability
Coding is becoming a primary competitive battleground among frontier labs, with incumbents standing up permanent coding teams and investing in new training stages (e.g. midtraining) to match leaders like Anthropic; expect recurring reorganizations, benchmarks, and model releases aimed specifically at code.
Start a discussion in Townsquare.
More from this edition
The $2/$6 price and 80 tokens per second are confirmed, but the load-bearing 4.2x token-efficiency figure and all rival scores are self-reported by xAI on a benchmark it does not top, with no independent reproduction yet.
An open-source-intelligence read of how likely this story is true with its real nuance, not a judgment of any outlet. It assesses the claim, weighing independent and adversarial reporting. How we label confidence.
What this means
Coding is now the explicit training objective of a third frontier lab, and the competition is shifting from raw pass rate to tokens per task, which is what appears on an enterprise inference bill. If Grok 4.5's efficiency claim survives independent testing, the competitive pressure on Anthropic and OpenAI comes through cost rather than capability. A buyer running thousands of agent loops a day cares more about a 4x token reduction than a 5-point benchmark difference. The Cursor co-training also ties the model's distribution to a specific tool, giving xAI a route to working developers it did not previously have.
What to watch
Observations to monitor, not financial advice.
Synthesized from: Polylog editors · MarkTechPost · VentureBeat
Comments
0No comments yet.