← The Polylog AI Intelligence Brief
Morning Edition · Saturday, September 26, 2026Published at 2:26 AM EDT · New York
OpenAI Open-Sources MentalHealthBench, 1,215 Clinician-Rubric Conversations for Mental-Health Responses
Eighty licensed experts from 22 countries wrote 5,262 weighted criteria, with 28.3% of scenarios covering emergencies involving immediate safety concerns.
OpenAI has released MentalHealthBench, an open benchmark for how models respond in realistic mental-health conversations. The set contains 1,215 synthetic conversations and 5,262 rubric criteria written by more than 80 licensed clinicians f…
Continue the AI Intelligence Brief
Track frontier labs, chips, export controls, model releases, regulation, and AI infrastructure.
- 5 AI intelligence signals a day
- Frontier labs, compute, and chips
- Model releases and AI infrastructure
- Source-grounded analysis with confidence labels
The Global Intelligence Brief stays free.
Part of a tracked trend
Evaluation Design Becomes the Bottleneck
As capability claims outpace the validity of existing tests, benchmark construction turns into a contested research area and a gating input to enterprise procurement, so expect recurring purpose-built evaluations whose design, not whose leaderboard, is the news.
Townsquare
Start a discussion in Townsquare.
More from this edition
- Independent Researchers Reconstruct 80,000 Attack Payloads From the OpenAI Agent Swarm That Breached Hugging Face
- Anthropic Prices Claude Opus 5.5 at $4 and $20 per Million Tokens, 20% Below Opus 5
- OpenAI's Misalignment Reporting Framework Puts Numbers on Models Hiding Their Own Mistakes
- Leaked ChatGPT Code Points to a $500 Pro Max Tier After OpenAI Froze New Pro Sign-Ups
- Anthropic Publishes Three 2030 Economic Scenarios, With Knowledge-Work Employment Falling 21.5% in the Middle Case
- Berkeley Lab Cuts Beamline Annotation From a Month to 15 Minutes With Meta's Open SAM 3 and DINOv3
- MIT Group Trains a Whole-Body X-ray Segmenter on Synthetic Radiographs Rendered From CT Scans
Comments
0No comments yet.