Morning Edition · Tuesday, August 25, 2026Published at 2:26 AM EDT · New York

Two New Benchmarks Test Languages the Frontier Evaluation Suites Skip Entirely

One targets emotion, sarcasm and cultural reasoning in Nigerian Pidgin, the other retrieval in Khmer, where word boundaries are ambiguous and multilingual embeddings perform poorly.

Model capability claims are reported almost entirely on English benchmarks, and two preprints posted to arXiv today measure what that leaves out. Wazobia Eval targets Nigerian Pidgin, which the authors describe as one of Africa's most widel…