Browse benchmarks

All Agents Coding Conversational General Knowledge Knowledge Work Legal Long Context Math Multimodal NLP Reasoning Safety Search Security Tool Use Translation Vision

143 benchmarks

AA Coding Agent Index

Multimodal1mo ago

https://allenai.org/data/diagrams

https://github.com/Babelscape/ALERT

https://github.com/facebookresearch/anli

https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/api-bank

https://github.com/hendrycks/apps

Knowledge1mo ago

https://allenai.org/data/arc

Reasoning1mo ago

https://arcprize.org/

Reasoning1mo ago

https://arcprize.org/

Reasoning1mo ago

https://arcprize.org/

https://github.com/THUDM/AgentBench

https://aider.chat/docs/leaderboards/

Conversational1mo ago

https://github.com/tatsu-lab/alpaca_eval

Conversational1mo ago

https://github.com/lm-sys/arena-hard-auto

AutomationBench

Reasoning1mo ago

https://github.com/suzgunmirac/BIG-Bench-Hard

https://github.com/nyu-mll/BBQ

https://gorilla.cs.berkeley.edu/leaderboard.html

Reasoning1mo ago

https://github.com/google/BIG-bench

https://bigcode-bench.github.io/

https://github.com/google-research-datasets/boolean-questions

BrowseComp-Plus

Knowledge1mo ago

https://cevalbenchmark.com/

Reasoning1mo ago

https://people.ict.usc.edu/~gordon/copa.html

Reasoning1mo ago

https://wilburone.github.io/cosmos/

https://github.com/facebookresearch/cruxeval

Multimodal1mo ago

https://github.com/vis-nlp/ChartQA

Conversational1mo ago

https://lmarena.ai/

https://github.com/FudanSELab/ClassEval

https://stanfordnlp.github.io/coqa/

https://github.com/google-deepmind/code_contests

Reasoning1mo ago

https://www.tau-nlp.sites.tau.ac.il/commonsenseqa

CursorBench 3.2

CyScenarioBench

Security1mo ago

Security1mo ago

https://allenai.org/data/drop

https://ds1000-code-gen.github.io/

https://decodingtrust.github.io/

Multimodal1mo ago

https://www.docvqa.org/

https://github.com/evalplus/evalplus

FACTS Grounding

Knowledge1mo ago

https://deepmind.google/discover/blog/facts-grounding-a-new-benchmark-for-evaluating-the-factuality-of-large-language-models/

Translation1mo ago

https://github.com/facebookresearch/flores

FrontierCode 1.1