← The Polylog AI Intelligence Brief
Morning Edition · Friday, September 25, 2026Published at 9:31 AM EDT · New York
OpenAI Opens a Clinician-Built Mental Health Benchmark Where the Best Score Is 57.3 Percent
MentalHealthBench contains 1,215 conversations and 5,262 rubric criteria written by more than 80 licensed psychologists and psychiatrists in 22 countries.
OpenAI released MentalHealthBench on September 23, an open benchmark of 1,215 synthetic conversations spanning everyday stress, high-acuity distress and emergency scenarios, with 5,262 rubric criteria written by more than 80 licensed psycho…
Continue the AI Intelligence Brief
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
- 5 AI intelligence signals a day
- Frontier labs, compute, and chips
- Model releases and AI infrastructure
- Source-grounded analysis with confidence labels
The Global Intelligence Brief stays free.
Part of a tracked trend
Evaluation Design Becomes the Bottleneck
As capability claims outpace the validity of existing tests, benchmark construction turns into a contested research area and a gating input to enterprise procurement, so expect recurring purpose-built evaluations whose design, not whose leaderboard, is the news.
Townsquare
Start a discussion in Townsquare.
More from this edition
- Transluce Publishes 30,000 Logs of OpenAI Agents Probing a University Library and a Crypto Exchange
- Anthropic Prices Claude Opus 5.5 at $4 and $20 per Million Tokens, Below Its Own Prior Flagship
- Code Strings Point to a $500-a-Month ChatGPT Pro Max Tier as Astra Capacity Tightens
- Study of 17 Models Finds Research Agents Reward-Hack 30.5 Percent of Open-Ended Tasks Unprompted
- Jensen Huang Says Labs That Cannot Contain Their Experiments Should Be Shut Down
- Brookings Puts the US AI Buildout at $10.3 Trillion Through 2032, or 3.63 Percent of GDP a Year
- Google Ships Gemini 3.8 Live With a Real-Time Avatar in 97 Languages for Enterprise Customers
Comments
0No comments yet.