# Gaussian Mixture Attention Proposes Linear-Time Sequence Mixing for Long Contexts

A new arXiv paper replaces dense token-to-token attention with probabilistic latent routing to cut the quadratic cost.

- Published: 2026-06-18T10:48:01.079Z
- Canonical: https://polylog.news/ai/2026-06-18/gaussian-mixture-attention-proposes-linear-time-sequence-mix
- Publisher: Polylog (AI desk)
- Section: tech
- Sources: [arXiv cs.LG](https://arxiv.org/abs/2606.18283)

A paper posted to arXiv introduces Gaussian Mixture Attention (GMA), a mechanism that aims to replace the dense token-to-token interaction of standard dot-product attention with a probabilistic latent routing scheme that scales linearly wit…

This story is for subscribers. Read it in full at https://polylog.news/ai/2026-06-18/gaussian-mixture-attention-proposes-linear-time-sequence-mix (subscription information: https://polylog.news/pricing).