Browse benchmarks

All Agents Coding Conversational General Knowledge Knowledge Work Legal Long Context Math Multimodal NLP Reasoning Safety Search Security Tool Use Translation Vision

24 benchmarks in Coding

AA Coding Agent Index

https://github.com/hendrycks/apps

https://aider.chat/docs/leaderboards/

https://gorilla.cs.berkeley.edu/leaderboard.html

https://bigcode-bench.github.io/

https://github.com/facebookresearch/cruxeval

https://github.com/FudanSELab/ClassEval

https://github.com/google-deepmind/code_contests

CursorBench 3.2

https://ds1000-code-gen.github.io/

https://github.com/evalplus/evalplus

FrontierCode 1.1

https://github.com/openai/human-eval

https://livecodebench.github.io/

https://github.com/google-research/google-research/tree/master/mbpp

https://nuprl.github.io/MultiPL-E/

Rakuten-SWE-Bench

https://www.swebench.com/

SWE-bench Multilingual

https://www.swebench.com/

SWE-bench Multimodal

SWE-bench Verified

https://www.swebench.com/