Browse benchmarks

142 benchmarks

FrontierMath
Math1h ago
https://epochai.org/frontiermath
GAIA
Agents1h ago
https://huggingface.co/gaia-benchmark
GDPval-AA
Knowledge Work32m ago
GDPval-AA v2
Knowledge Work32m ago
GLUE
NLP1h ago
https://gluebenchmark.com/
GPQA
Reasoning1h ago
https://github.com/idavidrein/gpqa
GPQA-Diamond
Reasoning1h ago
https://github.com/idavidrein/gpqa
GSM8K
Math1h ago
https://github.com/openai/grade-school-math
HELM
Safety1h ago
https://crfm.stanford.edu/helm/
HLEAutomationBench
Agents32m ago
HarmBench
Safety1h ago
https://github.com/centerforaisafety/HarmBench
HellaSwag
Reasoning1h ago
https://rowanzellers.com/hellaswag/
HotpotQA
NLP1h ago
https://hotpotqa.github.io/
HumanEval
Coding1h ago
https://github.com/openai/human-eval
Humanity's Last Exam
Reasoning1h ago
https://lastexam.ai/
IFEval
Conversational1h ago
https://github.com/google-research/google-research/tree/master/instruction_following_eval
InfiniteBench
Long Context1h ago
https://github.com/OpenBMB/InfiniteBench
LAMBADA
NLP1h ago
https://zenodo.org/records/2630551
LiveBench
Conversational1h ago
https://livebench.ai/
LiveCodeBench
Coding1h ago
https://livecodebench.github.io/
LongBench
Long Context1h ago
https://github.com/THUDM/LongBench
MATH
Math1h ago
https://github.com/hendrycks/math
MBPP
Coding1h ago
https://github.com/google-research/google-research/tree/master/mbpp
MCP-Atlas
Tool Use32m ago
MGSM
Math1h ago
https://github.com/google-research/url-nlp/tree/main/mgsm
MM-Vet
Multimodal1h ago
https://github.com/yuweihao/MM-Vet
MMBench
Multimodal1h ago
https://github.com/open-compass/MMBench
MME
Multimodal1h ago
https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models/tree/Evaluation
MMLU
Knowledge1h ago
https://github.com/hendrycks/test
MMLU-Pro
Knowledge1h ago
https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro
MMMLU
Knowledge32m ago
MMMU
Multimodal1h ago
https://mmmu-benchmark.github.io/
MRCR v2
Long Context32m ago
MT-Bench
Conversational1h ago
https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge
MathQA
Math1h ago
https://math-qa.github.io/
MathVista
Math1h ago
https://mathvista.github.io/
MuSR
Reasoning1h ago
https://github.com/Zayne-sprague/MuSR
MultiNLI
NLP1h ago
https://cims.nyu.edu/~sbowman/multinli/
MultiPL-E
Coding1h ago
https://nuprl.github.io/MultiPL-E/
Natural Questions
NLP1h ago
https://ai.google.com/research/NaturalQuestions
Needle in a Haystack
Long Context1h ago
https://github.com/gkamradt/LLMTest_NeedleInAHaystack
NumGLUE
Math1h ago
https://github.com/allenai/numglue
OSS-Fuzz
Security32m ago
https://google.github.io/oss-fuzz/
OSWorld
Agents1h ago
https://os-world.github.io/
OSWorld 2.0
Agents32m ago
OSWorld-Verified
Agents32m ago
OfficeQA Pro
Knowledge Work32m ago
OpenBookQA
Reasoning1h ago
https://allenai.org/data/open-book-qa
OpenRCA
Agents32m ago
PIQA
Reasoning1h ago
https://yonatanbisk.com/piqa/