Browse benchmarks
AllAgentsCodingConversationalGeneralKnowledgeKnowledge WorkLegalLong ContextMathMultimodalNLPReasoningSafetySearchSecurityTool UseTranslationVision
143 benchmarks
FrontierMath
https://epochai.org/frontiermathMath3mo ago
GAIA
https://huggingface.co/gaia-benchmarkAgents3mo ago
GDPval-AA
Knowledge Work3mo ago
GDPval-AA v2
Knowledge Work3mo ago
GLUE
https://gluebenchmark.com/NLP3mo ago
GPQA
https://github.com/idavidrein/gpqaReasoning3mo ago
GPQA-Diamond
https://github.com/idavidrein/gpqaReasoning3mo ago
GSM8K
https://github.com/openai/grade-school-mathMath3mo ago
HELM
https://crfm.stanford.edu/helm/Safety3mo ago
HLEAutomationBench
Agents3mo ago
HarmBench
https://github.com/centerforaisafety/HarmBenchSafety3mo ago
HellaSwag
https://rowanzellers.com/hellaswag/Reasoning3mo ago
HotpotQA
https://hotpotqa.github.io/NLP3mo ago
HumanEval
https://github.com/openai/human-evalCoding3mo ago
Humanity's Last Exam
https://lastexam.ai/Reasoning3mo ago
IFEval
https://github.com/google-research/google-research/tree/master/instruction_following_evalConversational3mo ago
InfiniteBench
https://github.com/OpenBMB/InfiniteBenchLong Context3mo ago
LAMBADA
https://zenodo.org/records/2630551NLP3mo ago
LiveBench
https://livebench.ai/Conversational3mo ago
LiveCodeBench
https://livecodebench.github.io/Coding3mo ago
LongBench
https://github.com/THUDM/LongBenchLong Context3mo ago
MATH
https://github.com/hendrycks/mathMath3mo ago
MBPP
https://github.com/google-research/google-research/tree/master/mbppCoding3mo ago
MCP-Atlas
Tool Use3mo ago
MGSM
https://github.com/google-research/url-nlp/tree/main/mgsmMath3mo ago
MM-Vet
https://github.com/yuweihao/MM-VetMultimodal3mo ago
MMBench
https://github.com/open-compass/MMBenchMultimodal3mo ago
MME
https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models/tree/EvaluationMultimodal3mo ago
MMLU
https://github.com/hendrycks/testKnowledge3mo ago
MMLU-Pro
https://huggingface.co/datasets/TIGER-Lab/MMLU-ProKnowledge3mo ago
MMMLU
Knowledge3mo ago
MMMU
https://mmmu-benchmark.github.io/Multimodal3mo ago
MRCR v2
Long Context3mo ago
MT-Bench
https://github.com/lm-sys/FastChat/tree/main/fastchat/llm_judgeConversational3mo ago
MathQA
https://math-qa.github.io/Math3mo ago
MathVista
https://mathvista.github.io/Math3mo ago
MuSR
https://github.com/Zayne-sprague/MuSRReasoning3mo ago
MultiNLI
https://cims.nyu.edu/~sbowman/multinli/NLP3mo ago
MultiPL-E
https://nuprl.github.io/MultiPL-E/Coding3mo ago
Natural Questions
https://ai.google.com/research/NaturalQuestionsNLP3mo ago
Needle in a Haystack
https://github.com/gkamradt/LLMTest_NeedleInAHaystackLong Context3mo ago
NumGLUE
https://github.com/allenai/numglueMath3mo ago
OSS-Fuzz
https://google.github.io/oss-fuzz/Security3mo ago
OSWorld
https://os-world.github.io/Agents3mo ago
OSWorld 2.0
Agents3mo ago
OSWorld-Verified
Agents3mo ago
OfficeQA Pro
Knowledge Work3mo ago
OpenBookQA
https://allenai.org/data/open-book-qaReasoning3mo ago
OpenRCA
Agents3mo ago
PIQA
https://yonatanbisk.com/piqa/Reasoning3mo ago