Browse benchmarks

All Agents Coding Conversational General Knowledge Knowledge Work Legal Long Context Math Multimodal NLP Reasoning Safety Search Security Tool Use Translation Vision

142 benchmarks

AA Coding Agent Index

Multimodal1h ago

https://allenai.org/data/diagrams

https://github.com/Babelscape/ALERT

https://github.com/facebookresearch/anli

https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/api-bank

https://github.com/hendrycks/apps

Knowledge1h ago

https://allenai.org/data/arc

Reasoning1h ago

https://arcprize.org/

Reasoning44m ago

https://arcprize.org/

Reasoning44m ago

https://arcprize.org/

https://github.com/THUDM/AgentBench

https://aider.chat/docs/leaderboards/

Conversational1h ago

https://github.com/tatsu-lab/alpaca_eval

Conversational1h ago

https://github.com/lm-sys/arena-hard-auto

AutomationBench

Reasoning1h ago

https://github.com/suzgunmirac/BIG-Bench-Hard

https://github.com/nyu-mll/BBQ

https://gorilla.cs.berkeley.edu/leaderboard.html

Reasoning1h ago

https://github.com/google/BIG-bench

https://bigcode-bench.github.io/

https://github.com/google-research-datasets/boolean-questions

BrowseComp-Plus

Knowledge1h ago

https://cevalbenchmark.com/

Reasoning1h ago

https://people.ict.usc.edu/~gordon/copa.html

Reasoning1h ago

https://wilburone.github.io/cosmos/

https://github.com/facebookresearch/cruxeval

Multimodal1h ago

https://github.com/vis-nlp/ChartQA

Conversational1h ago

https://lmarena.ai/

https://github.com/FudanSELab/ClassEval

https://stanfordnlp.github.io/coqa/

https://github.com/google-deepmind/code_contests

Reasoning1h ago

https://www.tau-nlp.sites.tau.ac.il/commonsenseqa

CursorBench 3.2

CyScenarioBench

Security44m ago

Security44m ago

https://allenai.org/data/drop

https://ds1000-code-gen.github.io/

https://decodingtrust.github.io/

Multimodal1h ago

https://www.docvqa.org/

https://github.com/evalplus/evalplus

FACTS Grounding

Knowledge1h ago

https://deepmind.google/discover/blog/facts-grounding-a-new-benchmark-for-evaluating-the-factuality-of-large-language-models/

Translation1h ago

https://github.com/facebookresearch/flores

FrontierCode 1.1