Browse benchmarks

All Agents Coding Conversational General Knowledge Knowledge Work Legal Long Context Math Multimodal NLP Reasoning Safety Search Security Tool Use Translation Vision

142 benchmarks

AA Coding Agent Index

Multimodal57m ago

https://allenai.org/data/diagrams

https://github.com/Babelscape/ALERT

https://github.com/facebookresearch/anli

https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/api-bank

https://github.com/hendrycks/apps

Knowledge57m ago

https://allenai.org/data/arc

Reasoning57m ago

https://arcprize.org/

Reasoning18m ago

https://arcprize.org/

Reasoning18m ago

https://arcprize.org/

https://github.com/THUDM/AgentBench

https://aider.chat/docs/leaderboards/

Conversational57m ago

https://github.com/tatsu-lab/alpaca_eval

Conversational57m ago

https://github.com/lm-sys/arena-hard-auto

AutomationBench

Reasoning57m ago

https://github.com/suzgunmirac/BIG-Bench-Hard

https://github.com/nyu-mll/BBQ

https://gorilla.cs.berkeley.edu/leaderboard.html

Reasoning57m ago

https://github.com/google/BIG-bench

https://bigcode-bench.github.io/

https://github.com/google-research-datasets/boolean-questions

BrowseComp-Plus

Knowledge57m ago

https://cevalbenchmark.com/

Reasoning57m ago

https://people.ict.usc.edu/~gordon/copa.html

Reasoning57m ago

https://wilburone.github.io/cosmos/

https://github.com/facebookresearch/cruxeval

Multimodal57m ago

https://github.com/vis-nlp/ChartQA

Conversational57m ago

https://lmarena.ai/

https://github.com/FudanSELab/ClassEval

https://stanfordnlp.github.io/coqa/

https://github.com/google-deepmind/code_contests

Reasoning57m ago

https://www.tau-nlp.sites.tau.ac.il/commonsenseqa

CursorBench 3.2

CyScenarioBench

Security18m ago

Security18m ago

https://allenai.org/data/drop

https://ds1000-code-gen.github.io/

https://decodingtrust.github.io/

Multimodal57m ago

https://www.docvqa.org/

https://github.com/evalplus/evalplus

FACTS Grounding

Knowledge57m ago

https://deepmind.google/discover/blog/facts-grounding-a-new-benchmark-for-evaluating-the-factuality-of-large-language-models/

Translation57m ago

https://github.com/facebookresearch/flores

FrontierCode 1.1