🏆 HF Hub Benchmark Dashboard
Last updated: 2026-09-28T07:01:56 UTC · auto-refreshes every 6h
47 benchmarks
408 models
940 entries
43 active
4 empty
🧠 Knowledge · 3 benchmarks · 204 models
MMLU-Pro
50 entries↗ View on Hub
| Model | Score | In $/1M | Out $/1M | Context | TTFT | Throughput | License | Params | Providers | |
|---|---|---|---|---|---|---|---|---|---|---|
| 🥇 | FINAL-Bench/Darwin-180B-RSI | 88.12 | — | — | — | — | — | other | 180B | — |
| 🥈 | MiniMaxAI/MiniMax-M2.1 | 88 | $0.30 | $1.20 | 204.8K | 1,798 ms | 58 t/s | other | 229B | novitafeatherless-ai |
| 🥉 | internlm/Intern-S2-Preview | 88 | — | — | — | — | — | apache-2.0 | 36B | — |
| 4 | Qwen/Qwen3.5-397B-A17B | 87.8 | $0.45 | $3.00 | 262.1K | 223 ms | 143 t/s | apache-2.0 | 403B | novitafeatherless-aiscaleway +2 |
| 5 | deepseek-ai/DeepSeek-V4-Pro | 87.5 | $1.30 | $2.60 | 1.0M | 976 ms | 45 t/s | mit | 1599B | novitafeatherless-aideepinfra |
| 6 | moonshotai/Kimi-K2.5 | 87.1 | $0.45 | $2.25 | 262.1K | 519 ms | 44 t/s | other | 1027B | novitafeatherless-aideepinfra |
| 7 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 86.8 | $1.00 | $5.00 | 262.1K | 391 ms | 89 t/s | other | 561B | deepinfra |
| 8 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | 86.8 | $0.60 | $2.40 | 262.1K | 667 ms | 113 t/s | other | 303B | fireworks-ai |
| 9 | Qwen/Qwen3.5-122B-A10B | 86.7 | $0.29 | $2.40 | 262.1K | 255 ms | 111 t/s | apache-2.0 | 125B | novitadeepinfra |
| 10 | deepseek-ai/DeepSeek-V4-Flash | 86.4 | $0.09 | $0.18 | 1.0M | 403 ms | 98 t/s | mit | 291B | novitafeatherless-aideepinfra |
| 11 | Qwen/Qwen3.6-27B | 86.2 | $0.32 | $3.19 | 262.1K | 389 ms | 65 t/s | apache-2.0 | 28B | featherless-aiovhclouddeepinfra |
| 12 | upstage/Solar-Open2-250B | 86.2 | — | — | — | — | — | other | 250B | — |
| 13 | Qwen/Qwen3.5-27B | 86.1 | $0.26 | $2.40 | 262.1K | 226 ms | 73 t/s | apache-2.0 | 28B | novitafeatherless-aideepinfra |
| 14 | zai-org/GLM-5 | 86 | $0.60 | $2.08 | 202.8K | 437 ms | 111 t/s | mit | 754B | novitafeatherless-aizai-org +1 |
| 15 | Qwen/Qwen3.6-35B-A3B | 85.2 | $0.10 | $0.95 | 262.1K | 442 ms | 97 t/s | apache-2.0 | 36B | featherless-aiscalewaydeepinfra |
| 16 | deepseek-ai/DeepSeek-R1-0528 | 85 | $0.50 | $2.15 | 163.8K | 564 ms | 23 t/s | mit | 685B | novitafeatherless-aideepinfra |
| 17 | zai-org/GLM-4.5 | 84.6 | — | — | — | — | — | mit | 358B | — |
| 18 | stepfun-ai/Step-3.5-Flash | 84.4 | $0.10 | $0.30 | 262.1K | 203 ms | 142 t/s | apache-2.0 | 199B | featherless-aideepinfra |
| 19 | deepseek-ai/DeepSeek-R1 | 84 | $0.70 | $2.50 | 64K | 1,349 ms | 19 t/s | mit | 684B | novita |
| 20 | LGAI-EXAONE/K-EXAONE-236B-A23B | 83.8 | — | — | — | — | — | other | 237B | — |
| 21 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 22 | RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 23 | internlm/Intern-S1 | 83.5 | — | — | — | — | — | apache-2.0 | 241B | — |
| 24 | LGAI-EXAONE/EXAONE-4.5-33B | 83.3 | — | — | — | — | — | other | 34B | — |
| 25 | Qwen/Qwen3-235B-A22B-Instruct-2507 | 83 | $0.09 | $0.55 | 262.1K | 348 ms | 62 t/s | apache-2.0 | 235B | novitanscalescaleway +1 |
| 26 | ByteDance-Seed/Seed-OSS-36B-Instruct | 82.7 | — | — | — | — | — | apache-2.0 | 36B | — |
| 27 | meituan-longcat/LongCat-Flash-Chat | 82.7 | — | — | — | — | — | mit | 562B | — |
| 28 | MiniMaxAI/MiniMax-M2 | 82 | $0.30 | $1.20 | 204.8K | 1,645 ms | 60 t/s | other | 229B | novitafeatherless-ai |
| 29 | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 81.94 | — | — | 262.1K | 547 ms | 362 t/s | other | 32B | fireworks-ai |
| 30 | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 | 81.62 | — | — | — | — | — | other | 18B | — |
| 31 | skt/A.X-K1 | 81.5 | — | — | — | — | — | apache-2.0 | 519B | — |
| 32 | zai-org/GLM-4.5-Air | 81.4 | $0.13 | $0.85 | 131.1K | 596 ms | 85 t/s | mit | 110B | novitazai-org |
| 33 | deepseek-ai/DeepSeek-V3-0324 | 81.2 | $0.24 | $0.90 | 163.8K | 655 ms | 53 t/s | mit | 685B | featherless-aideepinfra |
| 34 | MiniMaxAI/MiniMax-M1-40k | 81.1 | — | — | — | — | — | apache-2.0 | 456B | — |
| 35 | jdopensource/JoyAI-LLM-Flash | 81.02 | — | — | — | — | — | — | 49B | — |
| 36 | moonshotai/Kimi-K2-Instruct | 81 | $0.57 | $2.30 | 131.1K | 1,254 ms | 43 t/s | other | 1026B | novitafeatherless-ai |
| 37 | Qwen/Qwen3-30B-A3B-Thinking-2507 | 80.9 | — | — | — | — | — | apache-2.0 | 31B | — |
| 38 | openai/gpt-oss-120b | 80.8 | $0.04 | $0.17 | 131.1K | 162 ms | 1227 t/s | apache-2.0 | 117B | groqnovitacerebras +8 |
| 39 | MiniMaxAI/MiniMax-M2.5 | 80.1 | $0.30 | $1.20 | 204.8K | 1,351 ms | 64 t/s | other | 229B | novitafeatherless-ai |
| 40 | baidu/ERNIE-4.5-300B-A47B-PT | 78.4 | — | — | — | — | — | apache-2.0 | 300B | — |
| 41 | meituan-longcat/LongCat-Flash-Lite | 78.29 | — | — | — | — | — | mit | 69B | — |
| 42 | MiniMaxAI/MiniMax-Text-01 | 75.7 | — | — | — | — | — | — | 456B | — |
| 43 | openai/gpt-oss-20b | 73.6 | $0.03 | $0.14 | 131.1K | 282 ms | 691 t/s | apache-2.0 | 21B | groqnovitanscale +3 |
| 44 | Qwen/Qwen2.5-72B | 71.59 | — | — | — | — | — | other | 73B | — |
| 45 | microsoft/phi-4 | 70.4 | $0.07 | $0.14 | 16.4K | 522 ms | 73 t/s | mit | 15B | featherless-aideepinfra |
| 46 | Qwen/Qwen3-4B-Instruct-2507 | 69.6 | $0.01 | $0.03 | 262.1K | 1,041 ms | 68 t/s | apache-2.0 | 4B | nscalefeatherless-ai |
| 47 | baidu/ERNIE-4.5-300B-A47B-Base-PT | 69.5 | — | — | — | — | — | apache-2.0 | 299B | — |
| 48 | Qwen/Qwen2.5-32B | 69.23 | — | — | — | — | — | apache-2.0 | 33B | — |
| 49 | XiaomiMiMo/MiMo-V2.5-Pro | 68.5 | $0.52 | $1.04 | 1.0M | 486 ms | 29 t/s | mit | 1023B | novitadeepinfra |
| 50 | Qwen/Qwen3-235B-A22B | 68.18 | $0.20 | $0.60 | 41.0K | 771 ms | 21 t/s | apache-2.0 | 235B | novitanscalefeatherless-ai |