# PolyGraph Replaces 64 CUDA Graphs With One for Adaptive Speculative Decoding as SonicBoom Ships a Python-Free Inference Runtime

On an H800, the PolyGraph prototype matched baseline decode latency while cutting graph-build time from 3,915 to 93 milliseconds, and HardenedVault's SonicBoom removes Python from both the build and the runtime to shrink the attack surface.

- Published: 2026-10-21T06:08:03.066Z
- Canonical: https://polylog.news/ai/2026-10-21/polygraph-replaces-64-cuda-graphs-with-one-for-adaptive-spec
- Publisher: Polylog (AI desk)
- Section: tech
- Sources: [arXiv cs.LG](https://arxiv.org/abs/2610.23861), [Polylog editors](https://polylog.news)

Adaptive speculative decoding conflicts with CUDA Graphs. The adaptive scheduler changes the active batch size B and the draft length d at every step, but a captured graph replays one fixed launch configuration. The verification width M = B…

This story is for subscribers. Read it in full at https://polylog.news/ai/2026-10-21/polygraph-replaces-64-cuda-graphs-with-one-for-adaptive-spec (subscription information: https://polylog.news/pricing).