🏆 HF Hub Benchmark Dashboard
Last updated: 2026-09-06T00:08:23 UTC · auto-refreshes every 6h
47 benchmarks
396 models
893 entries
41 active
6 empty
🧠 Knowledge · 3 benchmarks · 203 models
MMLU-Pro
50 entries↗ View on Hub
| Model | Score | In $/1M | Out $/1M | Context | TTFT | Throughput | License | Params | Providers | |
|---|---|---|---|---|---|---|---|---|---|---|
| 🥇 | MiniMaxAI/MiniMax-M2.1 | 88 | $0.30 | $1.20 | 204.8K | 1,391 ms | 70 t/s | other | 229B | novitafeatherless-ai |
| 🥈 | internlm/Intern-S2-Preview | 88 | — | — | — | — | — | apache-2.0 | 36B | — |
| 🥉 | Qwen/Qwen3.5-397B-A17B | 87.8 | $0.45 | $3.00 | 262.1K | 405 ms | 138 t/s | apache-2.0 | 403B | novitafeatherless-aiscaleway +2 |
| 4 | deepseek-ai/DeepSeek-V4-Pro | 87.5 | $1.30 | $2.60 | 1.0M | 515 ms | 93 t/s | mit | 1599B | novitabasetendeepinfra |
| 5 | moonshotai/Kimi-K2.5 | 87.1 | $0.45 | $2.25 | 262.1K | 813 ms | 35 t/s | other | 1027B | novitafeatherless-aideepinfra |
| 6 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 86.8 | $1.00 | $5.00 | 262.1K | 912 ms | 103 t/s | other | 561B | deepinfra |
| 7 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | 86.8 | $0.60 | $2.40 | 262.1K | 655 ms | 110 t/s | other | 303B | fireworks-ai |
| 8 | Qwen/Qwen3.5-122B-A10B | 86.7 | $0.29 | $2.40 | 262.1K | 815 ms | 106 t/s | apache-2.0 | 125B | novitadeepinfra |
| 9 | deepseek-ai/DeepSeek-V4-Flash | 86.4 | $0.09 | $0.18 | 1.0M | 552 ms | 94 t/s | mit | 291B | novitadeepinfra |
| 10 | Qwen/Qwen3.6-27B | 86.2 | $0.32 | $3.19 | 262.1K | 190 ms | 73 t/s | apache-2.0 | 28B | featherless-aiovhclouddeepinfra |
| 11 | upstage/Solar-Open2-250B | 86.2 | — | — | — | — | — | other | 250B | — |
| 12 | Qwen/Qwen3.5-27B | 86.1 | $0.26 | $2.40 | 262.1K | 384 ms | 73 t/s | apache-2.0 | 28B | novitafeatherless-aideepinfra |
| 13 | zai-org/GLM-5 | 86 | $0.60 | $2.08 | 202.8K | 787 ms | 60 t/s | mit | 754B | novitafeatherless-aizai-org +1 |
| 14 | Qwen/Qwen3.6-35B-A3B | 85.2 | $0.10 | $0.95 | 262.1K | 240 ms | 146 t/s | apache-2.0 | 36B | featherless-aiscalewaydeepinfra |
| 15 | deepseek-ai/DeepSeek-R1-0528 | 85 | $0.50 | $2.15 | 163.8K | 511 ms | 19 t/s | mit | 685B | novitafeatherless-aideepinfra |
| 16 | zai-org/GLM-4.5 | 84.6 | — | — | — | 1,405 ms | 53 t/s | mit | 358B | zai-org |
| 17 | stepfun-ai/Step-3.5-Flash | 84.4 | $0.10 | $0.30 | 262.1K | 438 ms | 112 t/s | apache-2.0 | 199B | featherless-aideepinfra |
| 18 | deepseek-ai/DeepSeek-R1 | 84 | $0.70 | $2.50 | 64K | 1,028 ms | 14 t/s | mit | 685B | novita |
| 19 | LGAI-EXAONE/K-EXAONE-236B-A23B | 83.8 | — | — | — | — | — | other | 237B | — |
| 20 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 21 | RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 22 | internlm/Intern-S1 | 83.5 | — | — | — | — | — | apache-2.0 | 241B | — |
| 23 | LGAI-EXAONE/EXAONE-4.5-33B | 83.3 | — | — | — | — | — | other | 34B | — |
| 24 | Qwen/Qwen3-235B-A22B-Instruct-2507 | 83 | $0.09 | $0.55 | 262.1K | 361 ms | 102 t/s | apache-2.0 | 235B | novitanscalescaleway +1 |
| 25 | ByteDance-Seed/Seed-OSS-36B-Instruct | 82.7 | — | — | — | — | — | apache-2.0 | 36B | — |
| 26 | meituan-longcat/LongCat-Flash-Chat | 82.7 | — | — | — | — | — | mit | 562B | — |
| 27 | MiniMaxAI/MiniMax-M2 | 82 | $0.30 | $1.20 | 204.8K | 1,271 ms | 66 t/s | other | 229B | novitafeatherless-ai |
| 28 | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 81.94 | — | — | 262.1K | 322 ms | 292 t/s | other | 32B | fireworks-ai |
| 29 | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 | 81.62 | — | — | — | — | — | other | 18B | — |
| 30 | skt/A.X-K1 | 81.5 | — | — | — | — | — | apache-2.0 | 519B | — |
| 31 | zai-org/GLM-4.5-Air | 81.4 | $0.13 | $0.85 | 131.1K | 568 ms | 74 t/s | mit | 110B | novitazai-org |
| 32 | deepseek-ai/DeepSeek-V3-0324 | 81.2 | $0.24 | $0.90 | 163.8K | 559 ms | 36 t/s | mit | 685B | featherless-aideepinfra |
| 33 | MiniMaxAI/MiniMax-M1-40k | 81.1 | — | — | — | — | — | apache-2.0 | 456B | — |
| 34 | jdopensource/JoyAI-LLM-Flash | 81.02 | — | — | — | — | — | — | 49B | — |
| 35 | moonshotai/Kimi-K2-Instruct | 81 | $0.57 | $2.30 | 131.1K | 1,507 ms | 45 t/s | other | 1026B | novitafeatherless-ai |
| 36 | Qwen/Qwen3-30B-A3B-Thinking-2507 | 80.9 | — | — | — | — | — | apache-2.0 | 31B | — |
| 37 | openai/gpt-oss-120b | 80.8 | $0.04 | $0.17 | 131.1K | 252 ms | 1105 t/s | apache-2.0 | 117B | groqnovitacerebras +8 |
| 38 | MiniMaxAI/MiniMax-M2.5 | 80.1 | $0.30 | $1.20 | 204.8K | 900 ms | 70 t/s | other | 229B | novitafeatherless-ai |
| 39 | baidu/ERNIE-4.5-300B-A47B-PT | 78.4 | — | — | — | — | — | apache-2.0 | 300B | — |
| 40 | meituan-longcat/LongCat-Flash-Lite | 78.29 | — | — | — | — | — | mit | 69B | — |
| 41 | MiniMaxAI/MiniMax-Text-01 | 75.7 | — | — | — | — | — | — | 456B | — |
| 42 | openai/gpt-oss-20b | 73.6 | $0.03 | $0.14 | 131.1K | 296 ms | 650 t/s | apache-2.0 | 21B | groqnovitanscale +4 |
| 43 | Qwen/Qwen2.5-72B | 71.59 | — | — | — | — | — | other | 73B | — |
| 44 | microsoft/phi-4 | 70.4 | $0.07 | $0.14 | 16.4K | 767 ms | 77 t/s | mit | 15B | featherless-aideepinfra |
| 45 | Qwen/Qwen3-4B-Instruct-2507 | 69.6 | $0.01 | $0.03 | 262.1K | 691 ms | 45 t/s | apache-2.0 | 4B | nscalefeatherless-ai |
| 46 | baidu/ERNIE-4.5-300B-A47B-Base-PT | 69.5 | — | — | — | — | — | apache-2.0 | 299B | — |
| 47 | Qwen/Qwen2.5-32B | 69.23 | — | — | — | — | — | apache-2.0 | 33B | — |
| 48 | XiaomiMiMo/MiMo-V2.5-Pro | 68.5 | $0.52 | $1.04 | 1.0M | 368 ms | 31 t/s | mit | 1023B | novitadeepinfra |
| 49 | Qwen/Qwen3-235B-A22B | 68.18 | $0.20 | $0.60 | 41.0K | 629 ms | 19 t/s | apache-2.0 | 235B | novitanscalefeatherless-ai |
| 50 | mistralai/Mistral-Large-Instruct-2411 | 67.94 | — | — | — | — | — | other | 123B | — |