Browse benchmarks

143 benchmarks

FrontierMath
Math3mo ago
https://epochai.org/frontiermath
GAIA
Agents3mo ago
https://huggingface.co/gaia-benchmark
GDPval-AA
Knowledge Work3mo ago
GDPval-AA v2
Knowledge Work3mo ago
GLUE
NLP3mo ago
https://gluebenchmark.com/
GPQA
Reasoning3mo ago
https://github.com/idavidrein/gpqa
GPQA-Diamond
Reasoning3mo ago
https://github.com/idavidrein/gpqa
GSM8K
Math3mo ago
https://github.com/openai/grade-school-math
HELM
Safety3mo ago
https://crfm.stanford.edu/helm/
HLEAutomationBench
Agents3mo ago
HarmBench
Safety3mo ago
https://github.com/centerforaisafety/HarmBench
HellaSwag
Reasoning3mo ago
https://rowanzellers.com/hellaswag/
HotpotQA
NLP3mo ago
https://hotpotqa.github.io/
HumanEval
Coding3mo ago
https://github.com/openai/human-eval
Humanity's Last Exam
Reasoning3mo ago
https://lastexam.ai/
IFEval
Conversational3mo ago
https://github.com/google-research/google-research/tree/master/instruction_following_eval
InfiniteBench
Long Context3mo ago
https://github.com/OpenBMB/InfiniteBench
LAMBADA
NLP3mo ago
https://zenodo.org/records/2630551
LiveBench
Conversational3mo ago
https://livebench.ai/
LiveCodeBench
Coding3mo ago
https://livecodebench.github.io/
LongBench
Long Context3mo ago
https://github.com/THUDM/LongBench
MATH
Math3mo ago
https://github.com/hendrycks/math
MBPP
Coding3mo ago
https://github.com/google-research/google-research/tree/master/mbpp
MCP-Atlas
Tool Use3mo ago
MGSM
Math3mo ago
https://github.com/google-research/url-nlp/tree/main/mgsm
MM-Vet
Multimodal3mo ago
https://github.com/yuweihao/MM-Vet
MMBench
Multimodal3mo ago
https://github.com/open-compass/MMBench
MME
Multimodal3mo ago
https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models/tree/Evaluation
MMLU
Knowledge3mo ago
https://github.com/hendrycks/test
MMLU-Pro
Knowledge3mo ago
https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro
MMMLU
Knowledge3mo ago
MMMU
Multimodal3mo ago
https://mmmu-benchmark.github.io/
MRCR v2
Long Context3mo ago
MT-Bench
Conversational3mo ago
https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge
MathQA
Math3mo ago
https://math-qa.github.io/
MathVista
Math3mo ago
https://mathvista.github.io/
MuSR
Reasoning3mo ago
https://github.com/Zayne-sprague/MuSR
MultiNLI
NLP3mo ago
https://cims.nyu.edu/~sbowman/multinli/
MultiPL-E
Coding3mo ago
https://nuprl.github.io/MultiPL-E/
Natural Questions
NLP3mo ago
https://ai.google.com/research/NaturalQuestions
Needle in a Haystack
Long Context3mo ago
https://github.com/gkamradt/LLMTest_NeedleInAHaystack
NumGLUE
Math3mo ago
https://github.com/allenai/numglue
OSS-Fuzz
Security3mo ago
https://google.github.io/oss-fuzz/
OSWorld
Agents3mo ago
https://os-world.github.io/
OSWorld 2.0
Agents3mo ago
OSWorld-Verified
Agents3mo ago
OfficeQA Pro
Knowledge Work3mo ago
OpenBookQA
Reasoning3mo ago
https://allenai.org/data/open-book-qa
OpenRCA
Agents3mo ago
PIQA
Reasoning3mo ago
https://yonatanbisk.com/piqa/