Browse benchmarks
AllAgentsCodingConversationalGeneralKnowledgeKnowledge WorkLegalLong ContextMathMultimodalNLPReasoningSafetySearchSecurityTool UseTranslationVision
143 benchmarks
PubMedQA
https://pubmedqa.github.io/Knowledge3mo ago
QuALITY
https://github.com/nyu-mll/qualityNLP3mo ago
RACE
https://www.cs.cmu.edu/~glai1/data/race/NLP3mo ago
RACE-H
https://www.cs.cmu.edu/~glai1/data/race/NLP3mo ago
RULER
https://github.com/hsiehjackson/RULERLong Context3mo ago
Rakuten-SWE-Bench
Coding3mo ago
RealWorldQA
https://huggingface.co/datasets/xai-org/RealWorldQAMultimodal3mo ago
SCROLLS
https://www.scrolls-benchmark.com/Long Context3mo ago
SEED-Bench
https://github.com/AILab-CVC/SEED-BenchMultimodal3mo ago
SNLI
https://nlp.stanford.edu/projects/snli/NLP3mo ago
SQuAD
https://rajpurkar.github.io/SQuAD-explorer/NLP3mo ago
SQuAD 2.0
https://rajpurkar.github.io/SQuAD-explorer/NLP3mo ago
SVAMP
https://github.com/arkilpatel/SVAMPMath3mo ago
SWE-bench
https://www.swebench.com/Coding3mo ago
SWE-bench Multilingual
https://www.swebench.com/Coding3mo ago
SWE-bench Multimodal
Coding3mo ago
SWE-bench Pro
Coding3mo ago
SWE-bench Verified
https://www.swebench.com/Coding3mo ago
SimpleQA
https://openai.com/index/introducing-simpleqa/Knowledge3mo ago
SimpleSafetyTests
https://github.com/bertievidgen/SimpleSafetyTestsSafety3mo ago
Social IQa
https://maartensap.com/social-iqa/Reasoning3mo ago
SuperGLUE
https://super.gluebenchmark.com/NLP3mo ago
TAU-bench
Agents3mo ago
Terminal-Bench
Agents3mo ago
Terminal-Bench 2.0
Agents3mo ago
TheoremQA
https://github.com/wenhuchen/TheoremQAMath3mo ago
ToolBench
https://github.com/OpenBMB/ToolBenchAgents3mo ago
TriviaQA
https://nlp.cs.washington.edu/triviaqa/Knowledge3mo ago
TruthfulQA
https://github.com/sylinrl/TruthfulQASafety3mo ago
VQAv2
https://visualqa.org/Multimodal3mo ago
Vending-Bench
Agents3mo ago
Vending-Bench 2
Agents3mo ago
ViBench
Vision3mo ago
WMT
https://www2.statmt.org/wmt24/Translation3mo ago
WebArena
https://webarena.dev/Agents3mo ago
WildBench
https://github.com/allenai/WildBenchConversational3mo ago
WinoGrande
https://winogrande.allenai.org/Reasoning3mo ago
Winograd Schema Challenge
https://cs.nyu.edu/~davise/papers/WinogradSchemas/WS.htmlReasoning3mo ago
XNLI
https://github.com/facebookresearch/XNLITranslation3mo ago
XSTest
https://github.com/paul-rottger/exaggerated-safetySafety3mo ago
ZeroSCROLLS
https://www.zero.scrolls-benchmark.com/Long Context3mo ago
tau2-bench
Agents3mo ago
trades bench
3mo ago
← prev3 / 3