'Humanity's Last Exam' Benchmark Published in Nature, Adopted by All Major Labs

The Center for AI Safety's ultra-hard benchmark, designed to test the outer limits of frontier model capabilities, is now a Nature paper and an industry standard.

The Center for AI Safety's "Humanity's Last Exam" — a benchmark composed of questions at the very edge of human expert knowledge — has been formally published in Nature, as @CAIS announced. The benchmark is reportedly now used by OpenAI, Anthropic, Google DeepMind, and xAI to evaluate their frontier models.

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Vestibulum ante ipsum primis in faucibus orci luctus et ultrices posuere cubilia curae.

Unlock the full briefing

Get every story in today's briefing, the full archive, and the daily AI intelligence brief.

All stories today

Full archive

Daily brief