# Humanity's Last Exam (HLE)

> A test of 2,500 expert questions over 100+ subjects. It was built to stay hard.

**Field:** Artificial Intelligence  
**Category:** Evaluation & Benchmarks  
**Also known as:** HLE, Humanity's Last Exam Benchmark

## Think of it like

It is like one huge test on every subject. It was made to be very, very hard.

## Definition

Humanity's Last Exam is a benchmark of 2,500 hard questions across more than a hundred subjects. Nearly 1,000 experts from over 500 places around the world wrote them. Some questions come with a picture. Each one is multiple choice or a short answer that can be checked, and none can be found fast with a web search. It was made by the Center for AI Safety and Scale AI, because top models had passed 90% on older tests like MMLU.

## Example

A lab posts its new model's HLE score next to last year's. Emma looks at the jump between the two, not at where the model ranks today.

## Why it matters

When the old tests filled up, people needed a new one with room at the top. HLE was built to be that test.

## Common mistake

Reading a low score as a weak model. HLE was made to be hard, so low scores are normal.

## Three principles

- **Expert questions.** Written by about 1,000 experts.
- **Checkable answers.** Multiple choice or short answer.
- **Built to stay hard.** Made when older tests filled up.

## Related terms

- [AI Benchmark](https://learn.benibix.com/term/ai/ai-benchmark)
- [Massive Multitask Language Understanding (MMLU)](https://learn.benibix.com/term/ai/mmlu)
- [Graduate-Level Google-Proof Q&A (GPQA)](https://learn.benibix.com/term/ai/gpqa)
- [Benchmark Saturation](https://learn.benibix.com/term/ai/benchmark-saturation)
- [Abstraction and Reasoning Corpus (ARC-AGI)](https://learn.benibix.com/term/ai/arc-agi)

![Scores over time for two tests. The old test's line climbs and flattens just under 100%. A new, harder test starts near the bottom with plenty of room above it.](https://learn.benibix.com/diagrams/ai5-benchmark-saturation.svg)

---

Source: https://learn.benibix.com/term/ai/humanitys-last-exam
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
