Browse benchmarks

143 benchmarks

PubMedQA
Knowledge3mo ago
https://pubmedqa.github.io/
QuALITY
NLP3mo ago
https://github.com/nyu-mll/quality
RACE
NLP3mo ago
https://www.cs.cmu.edu/~glai1/data/race/
RACE-H
NLP3mo ago
https://www.cs.cmu.edu/~glai1/data/race/
RULER
Long Context3mo ago
https://github.com/hsiehjackson/RULER
Rakuten-SWE-Bench
Coding3mo ago
RealWorldQA
Multimodal3mo ago
https://huggingface.co/datasets/xai-org/RealWorldQA
SCROLLS
Long Context3mo ago
https://www.scrolls-benchmark.com/
SEED-Bench
Multimodal3mo ago
https://github.com/AILab-CVC/SEED-Bench
SNLI
NLP3mo ago
https://nlp.stanford.edu/projects/snli/
SQuAD
NLP3mo ago
https://rajpurkar.github.io/SQuAD-explorer/
SQuAD 2.0
NLP3mo ago
https://rajpurkar.github.io/SQuAD-explorer/
SVAMP
Math3mo ago
https://github.com/arkilpatel/SVAMP
SWE-bench
Coding3mo ago
https://www.swebench.com/
SWE-bench Multilingual
Coding3mo ago
https://www.swebench.com/
SWE-bench Multimodal
Coding3mo ago
SWE-bench Pro
Coding3mo ago
SWE-bench Verified
Coding3mo ago
https://www.swebench.com/
SimpleQA
Knowledge3mo ago
https://openai.com/index/introducing-simpleqa/
SimpleSafetyTests
Safety3mo ago
https://github.com/bertievidgen/SimpleSafetyTests
Social IQa
Reasoning3mo ago
https://maartensap.com/social-iqa/
SuperGLUE
NLP3mo ago
https://super.gluebenchmark.com/
TAU-bench
Agents3mo ago
Terminal-Bench
Agents3mo ago
Terminal-Bench 2.0
Agents3mo ago
TheoremQA
Math3mo ago
https://github.com/wenhuchen/TheoremQA
ToolBench
Agents3mo ago
https://github.com/OpenBMB/ToolBench
TriviaQA
Knowledge3mo ago
https://nlp.cs.washington.edu/triviaqa/
TruthfulQA
Safety3mo ago
https://github.com/sylinrl/TruthfulQA
VQAv2
Multimodal3mo ago
https://visualqa.org/
Vending-Bench
Agents3mo ago
Vending-Bench 2
Agents3mo ago
ViBench
Vision3mo ago
WMT
Translation3mo ago
https://www2.statmt.org/wmt24/
WebArena
Agents3mo ago
https://webarena.dev/
WildBench
Conversational3mo ago
https://github.com/allenai/WildBench
WinoGrande
Reasoning3mo ago
https://winogrande.allenai.org/
Winograd Schema Challenge
Reasoning3mo ago
https://cs.nyu.edu/~davise/papers/WinogradSchemas/WS.html
XNLI
Translation3mo ago
https://github.com/facebookresearch/XNLI
XSTest
Safety3mo ago
https://github.com/paul-rottger/exaggerated-safety
ZeroSCROLLS
Long Context3mo ago
https://www.zero.scrolls-benchmark.com/
tau2-bench
Agents3mo ago
trades bench
3mo ago