Browse benchmarks

143 benchmarks

FrontierMath
Math1mo ago
https://epochai.org/frontiermath
GAIA
Agents1mo ago
https://huggingface.co/gaia-benchmark
GDPval-AA
Knowledge Work1mo ago
GDPval-AA v2
Knowledge Work1mo ago
GLUE
NLP1mo ago
https://gluebenchmark.com/
GPQA
Reasoning1mo ago
https://github.com/idavidrein/gpqa
GPQA-Diamond
Reasoning1mo ago
https://github.com/idavidrein/gpqa
GSM8K
Math1mo ago
https://github.com/openai/grade-school-math
HELM
Safety1mo ago
https://crfm.stanford.edu/helm/
HLEAutomationBench
Agents1mo ago
HarmBench
Safety1mo ago
https://github.com/centerforaisafety/HarmBench
HellaSwag
Reasoning1mo ago
https://rowanzellers.com/hellaswag/
HotpotQA
NLP1mo ago
https://hotpotqa.github.io/
HumanEval
Coding1mo ago
https://github.com/openai/human-eval
Humanity's Last Exam
Reasoning1mo ago
https://lastexam.ai/
IFEval
Conversational1mo ago
https://github.com/google-research/google-research/tree/master/instruction_following_eval
InfiniteBench
Long Context1mo ago
https://github.com/OpenBMB/InfiniteBench
LAMBADA
NLP1mo ago
https://zenodo.org/records/2630551
LiveBench
Conversational1mo ago
https://livebench.ai/
LiveCodeBench
Coding1mo ago
https://livecodebench.github.io/
LongBench
Long Context1mo ago
https://github.com/THUDM/LongBench
MATH
Math1mo ago
https://github.com/hendrycks/math
MBPP
Coding1mo ago
https://github.com/google-research/google-research/tree/master/mbpp
MCP-Atlas
Tool Use1mo ago
MGSM
Math1mo ago
https://github.com/google-research/url-nlp/tree/main/mgsm
MM-Vet
Multimodal1mo ago
https://github.com/yuweihao/MM-Vet
MMBench
Multimodal1mo ago
https://github.com/open-compass/MMBench
MME
Multimodal1mo ago
https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models/tree/Evaluation
MMLU
Knowledge1mo ago
https://github.com/hendrycks/test
MMLU-Pro
Knowledge1mo ago
https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro
MMMLU
Knowledge1mo ago
MMMU
Multimodal1mo ago
https://mmmu-benchmark.github.io/
MRCR v2
Long Context1mo ago
MT-Bench
Conversational1mo ago
https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judge
MathQA
Math1mo ago
https://math-qa.github.io/
MathVista
Math1mo ago
https://mathvista.github.io/
MuSR
Reasoning1mo ago
https://github.com/Zayne-sprague/MuSR
MultiNLI
NLP1mo ago
https://cims.nyu.edu/~sbowman/multinli/
MultiPL-E
Coding1mo ago
https://nuprl.github.io/MultiPL-E/
Natural Questions
NLP1mo ago
https://ai.google.com/research/NaturalQuestions
Needle in a Haystack
Long Context1mo ago
https://github.com/gkamradt/LLMTest_NeedleInAHaystack
NumGLUE
Math1mo ago
https://github.com/allenai/numglue
OSS-Fuzz
Security1mo ago
https://google.github.io/oss-fuzz/
OSWorld
Agents1mo ago
https://os-world.github.io/
OSWorld 2.0
Agents1mo ago
OSWorld-Verified
Agents1mo ago
OfficeQA Pro
Knowledge Work1mo ago
OpenBookQA
Reasoning1mo ago
https://allenai.org/data/open-book-qa
OpenRCA
Agents1mo ago
PIQA
Reasoning1mo ago
https://yonatanbisk.com/piqa/