Browse benchmarks

All Agents Coding Conversational General Knowledge Knowledge Work Legal Long Context Math Multimodal NLP Reasoning Safety Search Security Tool Use Translation Vision

143 benchmarks

Knowledge1mo ago

https://pubmedqa.github.io/

https://github.com/nyu-mll/quality

https://www.cs.cmu.edu/~glai1/data/race/

https://www.cs.cmu.edu/~glai1/data/race/

Long Context1mo ago

https://github.com/hsiehjackson/RULER

Rakuten-SWE-Bench

Multimodal1mo ago

https://huggingface.co/datasets/xai-org/RealWorldQA

Long Context1mo ago

https://www.scrolls-benchmark.com/

Multimodal1mo ago

https://github.com/AILab-CVC/SEED-Bench

https://nlp.stanford.edu/projects/snli/

https://rajpurkar.github.io/SQuAD-explorer/

https://rajpurkar.github.io/SQuAD-explorer/

https://github.com/arkilpatel/SVAMP

https://www.swebench.com/

SWE-bench Multilingual

https://www.swebench.com/

SWE-bench Multimodal

SWE-bench Verified

https://www.swebench.com/

Knowledge1mo ago

https://openai.com/index/introducing-simpleqa/

SimpleSafetyTests

https://github.com/bertievidgen/SimpleSafetyTests

Reasoning1mo ago

https://maartensap.com/social-iqa/

https://super.gluebenchmark.com/

Terminal-Bench 2.0

https://github.com/wenhuchen/TheoremQA

https://github.com/OpenBMB/ToolBench

Knowledge1mo ago

https://nlp.cs.washington.edu/triviaqa/

https://github.com/sylinrl/TruthfulQA

Multimodal1mo ago

https://visualqa.org/

Vending-Bench 2

Translation1mo ago

https://www2.statmt.org/wmt24/

https://webarena.dev/

Conversational1mo ago

https://github.com/allenai/WildBench

Reasoning1mo ago

https://winogrande.allenai.org/

Winograd Schema Challenge

Reasoning1mo ago

https://cs.nyu.edu/~davise/papers/WinogradSchemas/WS.html

Translation1mo ago

https://github.com/facebookresearch/XNLI

https://github.com/paul-rottger/exaggerated-safety

Long Context1mo ago

https://www.zero.scrolls-benchmark.com/