# An Adapted 27-Billion-Parameter Open-Weight Model Outscored Claude Opus 4.8 on Legal Work at a Tenth of the Cost

Engram and Harvey gave the open-weight Qwen3.8-27B parametric memory of a synthetic law firm, and it reached 30 percent on strict all-or-nothing correctness, against Opus 4.8's 25 percent, at about 13 cents per query.

- Published: 2026-08-20T06:25:18.874Z
- Canonical: https://polylog.news/ai/2026-08-20/an-adapted-27-billion-parameter-open-weight-model-outscored
- Publisher: Polylog (AI desk)
- Section: tech
- Sources: [Polylog editors](https://polylog.news), [Anthropic News](https://www.anthropic.com/news/claude-opus-5)

The AI-memory startup Engram and the legal AI company Harvey built a fictional law firm, Calderwood and Harkness, with more than 100 million tokens across roughly 10,000 documents and 266 matters. They then adapted the open-weight Qwen3.8-27B to that firm using parametric memory, compressed notes, and a retrieval tool. Across 250 legal tasks, the adapted model averaged 67 percent, ahead of every model tested, and on strict all-or-nothing correctness it led Claude Opus 4.8 by 30 percent to 25 percent, [according to Engram's writeup](https://engram.com/blog/legal-agents-with-memory). The Russian-language channel AI ML Big Data [summarized the result](https://t.me/ai_machinelearning_big_data/10734) for its readers.

The cost difference is the number engineers should note. Engram reports roughly 0.13 dollars per query for the adapted 27-billion-parameter agent, against 1.32 dollars for Opus 4.8, a tenfold difference on the same task set. Alibaba separately promotes Qwen3.8-27B as the leading open-weight model on [Harvey's Legal Agent Benchmark](https://www.harvey.ai/blog/legal-agent-benchmark-initial-results), which scores end-to-end completion of complex legal work under an all-pass standard where absolute scores stay low for every model.

Treat the headline claim with the caution any vendor-run evaluation deserves. Engram sells agent memory, Harvey sells legal AI, the firm tested is synthetic rather than a real client corpus, and no independent group has reproduced the comparison. Harvey also [runs Opus 4.8 in its own product](https://www.harvey.ai/blog/opus-4-8-now-live-in-harvey), so this is not a competitor attacking an incumbent from outside. What the numbers do support is narrower, and still important: on a domain the test was built around in advance, an adapted small open-weight model narrowed the difference with a frontier model that Anthropic prices as premium work, alongside its newer [Opus 5 tier](https://www.anthropic.com/news/claude-opus-5).

The mechanism is the adaptation process, not the underlying weights. A model that has already absorbed a workspace does not have to reread it on every call, which converts context tokens into a one-time adaptation cost.

## What this means

The competitive value in vertical AI is shifting from which frontier model a company calls to how much of a customer's own material the agent has already absorbed. Closed frontier vendors are exposed through per-query pricing, because a buyer who can run a 27-billion-parameter model on rented or owned hardware pays roughly a tenth as much for comparable output on domains the model has studied. Alibaba gains distribution for Qwen in regulated Western industries that previously defaulted to United States frontier application programming interfaces (APIs), and memory-layer startups gain a reason to exist independent of any single model vendor.

## What to watch

- Whether an independent group reproduces the Engram and Harvey comparison on real client documents rather than a synthetic firm, which is what would turn a vendor claim into a real benchmark.
- Whether Anthropic or OpenAI ship a comparable workspace-adaptation feature, which would fold the cost advantage back inside the closed APIs.
- Whether large law firms and financial compliance teams start self-hosting Qwen-class models, the clearest signal that open-weight models are moving into regulated production work.