Morning Edition · Thursday, July 23, 2026Published at 1:46 AM EDT · New York

Study Finds Reasoning Fine-Tuning Collapses Behavioral Diversity in Game Play

Supervised fine-tuning narrows the range of moves models make in sequential decisions, a hidden cost of adapting models to downstream tasks.

A controlled study examines how supervised fine-tuning (SFT) affects behavioral diversity in sequential decision-making, documenting what the authors call diversity collapse in game play. Adapting a model to a downstream task with SFT tends…