📏Graduate-Level Google-Proof Q&A (GPQA)
Also known as GPQA, GPQA Diamond, GPQA Benchmark
A test of 448 hard science questions. A web search does not easily answer them.
Think of it like
It is like a quiz so hard that looking things up does not help much.
Example
A model's release notes list its GPQA Diamond score. Jack reads it as a sign of deep science knowledge, not as proof it can run his lab.
Why it matters
Easy quizzes stopped telling top models apart. GPQA asks questions where only real experts do well.
Definition
Common mistake
Key takeaways
- 1Written by experts. PhDs wrote every question.
- 2Google-proof. Search does not give it away.
- 3Three sciences. Biology, physics and chemistry.