FairStress: Testing whether LLMs hold correct answers equally across demographics
Allen AI's new benchmark reveals that models abandon correct decisions at different rates depending on demographic identity—even when choosing the same candidate in both versions.