Loading benchmark data…
EyesInAI·Loading live benchmark data
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
| Expand row | Test | Status | |||||||
|---|---|---|---|---|---|---|---|---|---|
| openrouter | glm-5.2 | 🔍Context Recall | pass | free | 826ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 🚀Throughput | ok | free | 953ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 💻Code Gen | ok | free | 649ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | { }JSON Output | pass | free | 828ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 🧮Reasoning | ok | free | 640ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | ⚡Ping | ok | free | 1220ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | 🔍Context Recall | pass | free | 1144ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | 🚀Throughput | ok | free | 1449ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | 💻Code Gen | ok | free | 1085ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | { }JSON Output | pass | free | 351ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | 🧮Reasoning | ok | free | 981ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | ⚡Ping | ok | free | 672ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 🔍Context Recall | pass | free | 2589ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 🚀Throughput | ok | free | 1224ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 💻Code Gen | ok | free | 3352ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | { }JSON Output | pass | free | 3145ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 🧮Reasoning | ok | free | 4885ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | ⚡Ping | ok | free | 2866ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-content-safety:free | 🚀Throughput | ok | free | 876ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-content-safety:free | ⚡Ping | ok | free | 434ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b | 🔍Context Recall | pass | free | 341ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b | 🚀Throughput | ok | free | 673ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b | 💻Code Gen | ok | free | 378ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b | { }JSON Output | pass | free | 379ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b | 🧮Reasoning | ok | free | 695ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b | ⚡Ping | ok | free | 767ms | — | 0.00 | 0.00 | |
| nvidia | sarvam-m | 🔍Context Recall | pass | free | 12553ms | — | 0.00 | 0.00 | |
| nvidia | sarvam-m | 🧮Reasoning | ok | free | 14917ms | — | 0.00 | 0.00 | |
| nvidia | sarvam-m | ⚡Ping | ok | free | 6960ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 🔍Context Recall | pass | free | 1445ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 🚀Throughput | ok | free | 11031ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 💻Code Gen | ok | free | 1262ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | { }JSON Output | pass | free | 1723ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 🧮Reasoning | ok | free | 2192ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | ⚡Ping | ok | free | 977ms | — | 0.00 | 0.00 | |
| nvidia | gliner-pii | 🔍Context Recall | pass | free | 531ms | — | 0.00 | 0.00 | |
| nvidia | gliner-pii | 🚀Throughput | ok | free | 474ms | — | 0.00 | 0.00 | |
| nvidia | gliner-pii | ⚡Ping | ok | free | 479ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | 🔍Context Recall | pass | free | 3041ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | 💻Code Gen | ok | free | 10567ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | { }JSON Output | pass | free | 2007ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | 🧮Reasoning | ok | free | 2131ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | ⚡Ping | ok | free | 802ms | — | 0.00 | 0.00 | |
| groq | compound | 🔍Context Recall | pass | free | 1617ms | — | 0.00 | 0.00 | |
| groq | compound | 💻Code Gen | ok | free | 3079ms | — | 0.00 | 0.00 | |
| groq | compound | { }JSON Output | pass | free | 1317ms | — | 0.00 | 0.00 | |
| groq | compound | 🧮Reasoning | ok | free | 2555ms | — | 0.00 | 0.00 | |
| groq | compound | ⚡Ping | ok | free | 618ms | — | 0.00 | 0.00 | |
| openrouter | hy3:free | 🔍Context Recall | pass | free | 1833ms | — | 0.00 | 0.00 | |
| openrouter | hy3:free | 🚀Throughput | ok | free | 1741ms | — | 0.00 | 0.00 | |
| openrouter | hy3:free | 💻Code Gen | ok | free | 1710ms | — | 0.00 | 0.00 | |
| openrouter | hy3:free | { }JSON Output | pass | free | 1648ms | — | 0.00 | 0.00 | |
| openrouter | hy3:free | 🧮Reasoning | ok | free | 1821ms | — | 0.00 | 0.00 | |
| openrouter | hy3:free | ⚡Ping | ok | free | 1748ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-122b-a10b | 🔍Context Recall | pass | free | 382ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-122b-a10b | 🚀Throughput | ok | free | 1331ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-122b-a10b | 💻Code Gen | ok | free | 767ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-122b-a10b | { }JSON Output | pass | free | 315ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-122b-a10b | 🧮Reasoning | ok | free | 387ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-122b-a10b | ⚡Ping | ok | free | 1035ms | — | 0.00 | 0.00 | |
| openrouter | laguna-xs-2.1:free | 🔍Context Recall | pass | free | 405ms | — | 0.00 | 0.00 | |
| openrouter | laguna-xs-2.1:free | 🚀Throughput | ok | free | 453ms | — | 0.00 | 0.00 | |
| openrouter | laguna-xs-2.1:free | 💻Code Gen | ok | free | 465ms | — | 0.00 | 0.00 | |
| openrouter | laguna-xs-2.1:free | { }JSON Output | pass | free | 539ms | — | 0.00 | 0.00 | |
| openrouter | laguna-xs-2.1:free | 🧮Reasoning | ok | free | 416ms | — | 0.00 | 0.00 | |
| openrouter | laguna-xs-2.1:free | ⚡Ping | ok | free | 375ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 🔍Context Recall | pass | free | 534ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 🚀Throughput | ok | free | 406ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 💻Code Gen | ok | free | 458ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | { }JSON Output | pass | free | 389ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | ⚡Ping | ok | free | 345ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-nano-12b-v2-vl | 🔍Context Recall | pass | free | 3152ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-nano-12b-v2-vl | 💻Code Gen | ok | free | 2738ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-nano-12b-v2-vl | 🧮Reasoning | ok | free | 2330ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-nano-12b-v2-vl | ⚡Ping | ok | free | 542ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1.5 | { }JSON Output | pass | free | 15109ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1.5 | ⚡Ping | ok | free | 16602ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e4b-it | 🔍Context Recall | pass | free | 3823ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e4b-it | 💻Code Gen | ok | free | 8534ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e4b-it | { }JSON Output | pass | free | 3123ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e4b-it | 🧮Reasoning | ok | free | 4402ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e4b-it | ⚡Ping | ok | free | 819ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 🔍Context Recall | pass | free | 531ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 🚀Throughput | ok | free | 312ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 💻Code Gen | ok | free | 915ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | { }JSON Output | pass | free | 754ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 🧮Reasoning | ok | free | 463ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | ⚡Ping | ok | free | 335ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-nano-12b-v2-vl:free | 🚀Throughput | ok | free | 1256ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-nano-12b-v2-vl:free | 🧮Reasoning | ok | free | 907ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b:free | 🔍Context Recall | pass | free | 344ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b:free | 🚀Throughput | ok | free | 457ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b:free | 💻Code Gen | ok | free | 345ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b:free | { }JSON Output | pass | free | 380ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b:free | 🧮Reasoning | ok | free | 342ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-30b-a3b:free | ⚡Ping | ok | free | 344ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-mini-4b-instruct | 🔍Context Recall | pass | free | 820ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-mini-4b-instruct | 🚀Throughput | ok | free | 8693ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-mini-4b-instruct | 💻Code Gen | ok | free | 1881ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-mini-4b-instruct | 🧮Reasoning | ok | free | 1822ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-mini-4b-instruct | ⚡Ping | ok | free | 477ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1 | 🔍Context Recall | pass | free | 3562ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1 | 💻Code Gen | ok | free | 5112ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1 | { }JSON Output | pass | free | 1485ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1 | 🧮Reasoning | ok | free | 18273ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e2b-it | 🔍Context Recall | pass | free | 3030ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e2b-it | 💻Code Gen | ok | free | 6864ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e2b-it | { }JSON Output | pass | free | 2678ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e2b-it | 🧮Reasoning | ok | free | 3383ms | — | 0.00 | 0.00 | |
| nvidia | gemma-3n-e2b-it | ⚡Ping | ok | free | 777ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | 🔧Tool Use | pass | free | 2673ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | 🔍Context Recall | pass | free | 6827ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | 🧮Reasoning | ok | free | 9055ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | ⚡Ping | ok | free | 2127ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🔍Context Recall | pass | free | 514ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🚀Throughput | ok | free | 508ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 💻Code Gen | ok | free | 433ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | { }JSON Output | pass | free | 442ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🧮Reasoning | ok | free | 470ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | ⚡Ping | ok | free | 440ms | — | 0.00 | 0.00 | |
| openrouter | llama-3.3-nemotron-super-49b-v1.5 | 🔍Context Recall | pass | free | 415ms | — | 0.00 | 0.00 | |
| openrouter | llama-3.3-nemotron-super-49b-v1.5 | 🚀Throughput | ok | free | 408ms | — | 0.00 | 0.00 | |
| openrouter | llama-3.3-nemotron-super-49b-v1.5 | 💻Code Gen | ok | free | 364ms | — | 0.00 | 0.00 | |
| openrouter | llama-3.3-nemotron-super-49b-v1.5 | { }JSON Output | pass | free | 367ms | — | 0.00 | 0.00 | |
| openrouter | llama-3.3-nemotron-super-49b-v1.5 | 🧮Reasoning | ok | free | 379ms | — | 0.00 | 0.00 | |
| openrouter | llama-3.3-nemotron-super-49b-v1.5 | ⚡Ping | ok | free | 1523ms | — | 0.00 | 0.00 | |
| openrouter | gemma-4-26b-a4b-it:free | 🔍Context Recall | pass | free | 1733ms | — | 0.00 | 0.00 | |
| openrouter | gemma-4-26b-a4b-it:free | 🚀Throughput | ok | free | 1652ms | — | 0.00 | 0.00 | |
| openrouter | gemma-4-26b-a4b-it:free | 💻Code Gen | ok | free | 2262ms | — | 0.00 | 0.00 | |
| openrouter | gemma-4-26b-a4b-it:free | { }JSON Output | pass | free | 971ms | — | 0.00 | 0.00 | |
| openrouter | gemma-4-26b-a4b-it:free | 🧮Reasoning | ok | free | 570ms | — | 0.00 | 0.00 | |
| openrouter | gemma-4-26b-a4b-it:free | ⚡Ping | ok | free | 563ms | — | 0.00 | 0.00 | |
| nvidia | step-3.5-flash | 🔍Context Recall | pass | free | 2770ms | — | 0.00 | 0.00 | |
| nvidia | step-3.5-flash | 🚀Throughput | ok | free | 7195ms | — | 0.00 | 0.00 | |
| nvidia | step-3.5-flash | 💻Code Gen | ok | free | 2132ms | — | 0.00 | 0.00 | |
| nvidia | step-3.5-flash | { }JSON Output | pass | free | 4948ms | — | 0.00 | 0.00 | |
| nvidia | step-3.5-flash | 🧮Reasoning | ok | free | 18751ms | — | 0.00 | 0.00 | |
| nvidia | step-3.5-flash | ⚡Ping | ok | free | 3809ms | — | 0.00 | 0.00 | |
| nvidia | ising-calibration-1-35b-a3b | 🔍Context Recall | pass | free | 6667ms | — | 0.00 | 0.00 | |
| nvidia | ising-calibration-1-35b-a3b | 💻Code Gen | ok | free | 8562ms | — | 0.00 | 0.00 | |
| nvidia | ising-calibration-1-35b-a3b | 🧮Reasoning | ok | free | 13533ms | — | 0.00 | 0.00 | |
| nvidia | ising-calibration-1-35b-a3b | ⚡Ping | ok | free | 3193ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.2-3b-instruct | 🔍Context Recall | pass | free | 907ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.2-3b-instruct | 💻Code Gen | ok | free | 2303ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.2-3b-instruct | { }JSON Output | pass | free | 9174ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.2-3b-instruct | 🧮Reasoning | ok | free | 804ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.2-3b-instruct | ⚡Ping | ok | free | 3407ms | — | 0.00 | 0.00 | |
| nvidia | diffusiongemma-26b-a4b-it | 🔍Context Recall | pass | free | 1199ms | — | 0.00 | 0.00 | |
| nvidia | diffusiongemma-26b-a4b-it | 🚀Throughput | ok | free | 2469ms | — | 0.00 | 0.00 | |
| nvidia | diffusiongemma-26b-a4b-it | 💻Code Gen | ok | free | 706ms | — | 0.00 | 0.00 | |
| nvidia | diffusiongemma-26b-a4b-it | { }JSON Output | pass | free | 882ms | — | 0.00 | 0.00 | |
| nvidia | diffusiongemma-26b-a4b-it | 🧮Reasoning | ok | free | 601ms | — | 0.00 | 0.00 | |
| nvidia | diffusiongemma-26b-a4b-it | ⚡Ping | ok | free | 833ms | — | 0.00 | 0.00 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | ⚡Ping | ok | <$0.01 | 5944ms | — | 0.02 | 0.03 | |
| openrouter | nova-micro-v1 | ⚡Ping | ok | <$0.01 | 617ms | — | 0.04 | 0.14 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🧮Reasoning | ok | <$0.01 | 2358ms | — | 0.02 | 0.03 | |
| openrouter | nex-n2-mini | ⚡Ping | ok | <$0.01 | 877ms | — | 0.03 | 0.10 | |
| deepinfra | gemma-3-4b-it | ⚡Ping | ok | <$0.01 | 1035ms | — | 0.05 | 0.10 | |
| deepinfra | phi-4 | ⚡Ping | ok | <$0.01 | 788ms | — | 0.07 | 0.14 | |
| openrouter | qwen3-coder-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 824ms | — | 0.07 | 0.27 | |
| deepinfra | DeepSeek-V4-Flash | ⚡Ping | ok | <$0.01 | 1148ms | — | 0.09 | 0.18 | |
| openrouter | qwen-2.5-7b-instruct | ⚡Ping | ok | <$0.01 | 632ms | — | 0.04 | 0.10 | |
| together | gemma-3n-E4B-it | ⚡Ping | ok | <$0.01 | 869ms | — | 0.06 | 0.12 | |
| openai | gpt-4.1-nano | ⚡Ping | ok | <$0.01 | 501ms | — | 0.10 | 0.40 | |
| openrouter | qwen3-235b-a22b-2507 | ⚡Ping | ok | <$0.01 | 396ms | — | 0.09 | 0.55 | |
| openrouter | mistral-small-3.2-24b-instruct | ⚡Ping | ok | <$0.01 | 670ms | — | 0.10 | 0.30 | |
| openrouter | gemma-4-26b-a4b-it | ⚡Ping | ok | <$0.01 | 403ms | — | 0.07 | 0.34 | |
| deepinfra | gemma-4-26B-A4B-it | ⚡Ping | ok | <$0.01 | 919ms | — | 0.07 | 0.34 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | { }JSON Output | pass | <$0.01 | 6320ms | — | 0.02 | 0.03 | |
| openrouter | command-r-08-2024 | ⚡Ping | ok | <$0.01 | 1122ms | — | 0.15 | 0.60 | |
| openrouter | llama-4-scout | ⚡Ping | ok | <$0.01 | 354ms | — | 0.10 | 0.30 | |
| openrouter | llama-3.1-8b-instruct | ⚡Ping | ok | <$0.01 | 358ms | — | 0.05 | 0.08 | |
| openrouter | qwen3-vl-32b-instruct | ⚡Ping | ok | <$0.01 | 410ms | — | 0.10 | 0.42 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | ⚡Ping | ok | <$0.01 | 877ms | — | 0.09 | 0.55 | |
| openrouter | ministral-14b-2512 | ⚡Ping | ok | <$0.01 | 1010ms | — | 0.20 | 0.20 | |
| openai | gpt-4o-mini | ⚡Ping | ok | <$0.01 | 698ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | ⚡Ping | ok | <$0.01 | 972ms | — | 0.15 | 0.60 | |
| together | qwen-2-1.5b-instruct | ⚡Ping | ok | <$0.01 | 730ms | — | 0.10 | 0.10 | |
| openrouter | mythomax-l2-13b | ⚡Ping | ok | <$0.01 | 738ms | — | 0.06 | 0.06 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🔧Tool Use | pass | <$0.01 | 4637ms | — | 0.02 | 0.03 | |
| openrouter | qwen3-vl-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 387ms | — | 0.13 | 0.52 | |
| openrouter | deepseek-chat | ⚡Ping | ok | <$0.01 | 893ms | — | 0.20 | 0.80 | |
| openrouter | llama-3.1-8b-instruct | 🧮Reasoning | ok | <$0.01 | 989ms | — | 0.05 | 0.08 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 💻Code Gen | ok | <$0.01 | 4378ms | — | 0.02 | 0.03 | |
| openrouter | ling-2.6-1t | ⚡Ping | ok | <$0.01 | 1768ms | — | 0.07 | 0.63 | |
| openrouter | hunyuan-a13b-instruct | ⚡Ping | ok | <$0.01 | 1912ms | — | 0.14 | 0.57 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | ⚡Ping | ok | <$0.01 | 795ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | ⚡Ping | ok | <$0.01 | 2816ms | — | 0.09 | 1.10 | |
| openrouter | nex-n2-mini | { }JSON Output | pass | <$0.01 | 1543ms | — | 0.03 | 0.10 | |
| openrouter | ernie-4.5-vl-424b-a47b | ⚡Ping | ok | <$0.01 | 1578ms | — | 0.42 | 1.25 | |
| openrouter | mistral-small-2603 | ⚡Ping | ok | <$0.01 | 656ms | — | 0.15 | 0.60 | |
| openrouter | qwen-2.5-7b-instruct | { }JSON Output | pass | <$0.01 | 521ms | — | 0.04 | 0.10 | |
| openrouter | deepseek-chat-v3.1 | ⚡Ping | ok | <$0.01 | 2233ms | — | 0.25 | 0.95 | |
| openrouter | qwen-plus | ⚡Ping | ok | <$0.01 | 533ms | — | 0.26 | 0.78 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | ⚡Ping | ok | <$0.01 | 2235ms | — | 0.20 | 0.88 | |
| openrouter | codestral-2508 | ⚡Ping | ok | <$0.01 | 424ms | — | 0.30 | 0.90 | |
| together | Llama-3.3-70B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 599ms | — | 0.10 | 0.32 | |
| deepinfra | DeepSeek-V3.1-Terminus | ⚡Ping | ok | <$0.01 | 975ms | — | 0.27 | 0.95 | |
| openrouter | mythomax-l2-13b | 🧮Reasoning | ok | <$0.01 | 634ms | — | 0.06 | 0.06 | |
| openrouter | deepseek-v3.1-terminus | ⚡Ping | ok | <$0.01 | 1738ms | — | 0.27 | 1.00 | |
| deepinfra | DeepSeek-V3 | ⚡Ping | ok | <$0.01 | 2520ms | — | 0.32 | 0.89 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🔍Context Recall | pass | <$0.01 | 4818ms | — | 0.02 | 0.03 | |
| openrouter | llama-3.1-8b-instruct | { }JSON Output | pass | <$0.01 | 441ms | — | 0.05 | 0.08 | |
| openrouter | deepseek-v3.2 | ⚡Ping | ok | <$0.01 | 1295ms | — | 0.27 | 0.40 | |
| openrouter | mistral-saba | ⚡Ping | ok | <$0.01 | 665ms | — | 0.20 | 0.60 | |
| together | qwen-2-1.5b-instruct | 🧮Reasoning | ok | <$0.01 | 548ms | — | 0.10 | 0.10 | |
| openrouter | deepseek-v4-flash | ⚡Ping | ok | <$0.01 | 1857ms | — | 0.10 | 0.20 | |
| openrouter | nova-micro-v1 | 🧮Reasoning | ok | <$0.01 | 649ms | — | 0.04 | 0.14 | |
| deepinfra | gemma-3-4b-it | { }JSON Output | pass | <$0.01 | 2966ms | — | 0.05 | 0.10 | |
| groq | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 560ms | — | 0.03 | 0.14 | |
| openrouter | qwen3-coder | ⚡Ping | ok | <$0.01 | 467ms | — | 0.30 | 1.00 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | ⚡Ping | ok | <$0.01 | 1610ms | — | 0.05 | 0.20 | |
| openrouter | kat-coder-pro-v2 | ⚡Ping | ok | <$0.01 | 539ms | — | 0.30 | 1.20 | |
| openrouter | nova-micro-v1 | { }JSON Output | pass | <$0.01 | 1153ms | — | 0.04 | 0.14 | |
| openrouter | qwen3-vl-235b-a22b-instruct | ⚡Ping | ok | <$0.01 | 330ms | — | 0.21 | 1.90 | |
| openrouter | qwen-2.5-7b-instruct | 🧮Reasoning | ok | <$0.01 | 633ms | — | 0.04 | 0.10 | |
| openai | gpt-4.1-mini-2025-04-14 | ⚡Ping | ok | <$0.01 | 754ms | — | 0.40 | 1.60 | |
| deepinfra | gemma-3-4b-it | 🧮Reasoning | ok | <$0.01 | 3781ms | — | 0.05 | 0.10 | |
| together | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 1684ms | — | 0.03 | 0.14 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 1001ms | — | 0.40 | 0.40 | |
| openrouter | unslopnemo-12b | ⚡Ping | ok | <$0.01 | 736ms | — | 0.40 | 0.40 | |
| openai | gpt-3.5-turbo | ⚡Ping | ok | <$0.01 | 1958ms | — | 0.50 | 1.50 | |
| openrouter | mythomax-l2-13b | { }JSON Output | pass | <$0.01 | 1053ms | — | 0.06 | 0.06 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | ⚡Ping | ok | <$0.01 | 824ms | — | 0.05 | 0.08 | |
| together | gemma-3n-E4B-it | 🧮Reasoning | ok | <$0.01 | 1278ms | — | 0.06 | 0.12 | |
| openrouter | llama-3.1-70b-instruct | ⚡Ping | ok | <$0.01 | 446ms | — | 0.40 | 0.40 | |
| deepinfra | phi-4 | { }JSON Output | pass | <$0.01 | 1226ms | — | 0.07 | 0.14 | |
| openrouter | mistral-large-2512 | ⚡Ping | ok | <$0.01 | 741ms | — | 0.50 | 1.50 | |
| together | gemma-3n-E4B-it | { }JSON Output | pass | <$0.01 | 2611ms | — | 0.06 | 0.12 | |
| openrouter | deepseek-v4-flash | { }JSON Output | pass | <$0.01 | 2006ms | — | 0.10 | 0.20 | |
| deepinfra | DeepSeek-V4-Flash | 🧮Reasoning | ok | $0.010 | 2482ms | — | 0.09 | 0.18 | |
| together | LFM2.5-8B-A1B | ⚡Ping | ok | $0.011 | 2506ms | — | 0.03 | 0.12 | |
| openrouter | rocinante-12b | ⚡Ping | ok | $0.011 | 392ms | — | 0.25 | 0.50 | |
| openrouter | llama-3.1-8b-instruct | 💻Code Gen | ok | $0.011 | 566ms | — | 0.05 | 0.08 | |
| groq | gpt-oss-20b | 🔧Tool Use | pass | $0.011 | 282ms | — | 0.03 | 0.14 | |
| deepinfra | DeepSeek-V4-Flash | { }JSON Output | pass | $0.012 | 1379ms | — | 0.09 | 0.18 | |
| openrouter | qwen-2.5-7b-instruct | 🔍Context Recall | pass | $0.012 | 639ms | — | 0.04 | 0.10 | |
| openrouter | nex-n2-mini | 🔍Context Recall | pass | $0.012 | 1052ms | — | 0.03 | 0.10 | |
| deepinfra | phi-4 | 🧮Reasoning | ok | $0.012 | 1670ms | — | 0.07 | 0.14 | |
| openrouter | nex-n2-mini | 🧮Reasoning | ok | $0.013 | 1034ms | — | 0.03 | 0.10 | |
| deepinfra | gemma-4-26B-A4B-it | 🔧Tool Use | pass | $0.013 | 1106ms | — | 0.07 | 0.34 | |
| deepinfra | MythoMax-L2-13b | ⚡Ping | ok | $0.013 | 1009ms | — | 0.40 | 0.40 | |
| openrouter | qwen3-coder-plus | ⚡Ping | ok | $0.013 | 1264ms | — | 0.65 | 3.25 | |
| openrouter | gemma-2-27b-it | ⚡Ping | ok | $0.013 | 624ms | — | 0.65 | 0.65 | |
| deepinfra | gpt-oss-20b | ⚡Ping | ok | $0.013 | 1443ms | — | 0.03 | 0.14 | |
| openrouter | llama-3.1-8b-instruct | 🔍Context Recall | pass | $0.013 | 467ms | — | 0.05 | 0.08 | |
| deepinfra | gpt-oss-20b | 🔧Tool Use | pass | $0.013 | 1229ms | — | 0.03 | 0.14 | |
| groq | gpt-oss-120b | ⚡Ping | ok | $0.013 | 353ms | — | 0.04 | 0.17 | |
| openrouter | qwen-2.5-7b-instruct | 💻Code Gen | ok | $0.013 | 641ms | — | 0.04 | 0.10 | |
| openai | gpt-4.1-nano | 🔧Tool Use | pass | $0.013 | 746ms | — | 0.10 | 0.40 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | { }JSON Output | pass | $0.014 | 1819ms | — | 0.05 | 0.08 | |
| openrouter | kimi-k2 | ⚡Ping | ok | $0.014 | 1177ms | — | 0.57 | 2.30 | |
| openrouter | gpt-oss-20b | ⚡Ping | ok | $0.014 | 9844ms | — | 0.03 | 0.14 | |
| openrouter | qwen3-coder-30b-a3b-instruct | { }JSON Output | pass | $0.014 | 1129ms | — | 0.07 | 0.27 | |
| openrouter | llama-4-scout | 🧮Reasoning | ok | $0.014 | 230ms | — | 0.10 | 0.30 | |
| deepinfra | gemma-3-4b-it | 🔍Context Recall | pass | $0.015 | 2416ms | — | 0.05 | 0.10 | |
| openrouter | llama-4-scout | { }JSON Output | pass | $0.015 | 414ms | — | 0.10 | 0.30 | |
| deepinfra | gemma-4-26B-A4B-it | { }JSON Output | pass | $0.015 | 1592ms | — | 0.07 | 0.34 | |
| groq | gpt-oss-120b | 🔧Tool Use | pass | $0.015 | 343ms | — | 0.04 | 0.17 | |
| deepinfra | gemma-3-4b-it | 💻Code Gen | ok | $0.015 | 6316ms | — | 0.05 | 0.10 | |
| openrouter | qwen3-vl-32b-instruct | { }JSON Output | pass | $0.015 | 355ms | — | 0.10 | 0.42 | |
| together | qwen-2-1.5b-instruct | 💻Code Gen | ok | $0.015 | 1690ms | — | 0.10 | 0.10 | |
| openrouter | qwen3-max-thinking | ⚡Ping | ok | $0.016 | 1001ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | ⚡Ping | ok | $0.016 | 1982ms | — | 0.78 | 3.90 | |
| openrouter | l3.1-euryale-70b | ⚡Ping | ok | $0.016 | 755ms | — | 0.85 | 0.85 | |
| openrouter | ministral-14b-2512 | 🧮Reasoning | ok | $0.016 | 477ms | — | 0.20 | 0.20 | |
| deepinfra | phi-4 | 💻Code Gen | ok | $0.017 | 2021ms | — | 0.07 | 0.14 | |
| openai | gpt-4.1-nano | 🧮Reasoning | ok | $0.017 | 1068ms | — | 0.10 | 0.40 | |
| openrouter | gemma-4-26b-a4b-it | { }JSON Output | pass | $0.017 | 687ms | — | 0.07 | 0.34 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🧮Reasoning | ok | $0.017 | 1559ms | — | 0.07 | 0.27 | |
| deepinfra | phi-4 | 🔍Context Recall | pass | $0.017 | 1564ms | — | 0.07 | 0.14 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | { }JSON Output | pass | $0.017 | 1995ms | — | 0.09 | 0.55 | |
| openai | gpt-4.1-nano | { }JSON Output | pass | $0.018 | 623ms | — | 0.10 | 0.40 | |
| openrouter | seed-1.6-flash | ⚡Ping | ok | $0.018 | 534ms | — | 0.07 | 0.30 | |
| deepinfra | gemma-4-26B-A4B-it | 🧮Reasoning | ok | $0.018 | 2239ms | — | 0.07 | 0.34 | |
| openrouter | mistral-small-3.2-24b-instruct | { }JSON Output | pass | $0.018 | 737ms | — | 0.10 | 0.30 | |
| together | Llama-3.3-70B-Instruct-Turbo | { }JSON Output | pass | $0.018 | 940ms | — | 0.10 | 0.32 | |
| groq | gpt-oss-20b | 🔍Context Recall | pass | $0.018 | 305ms | — | 0.03 | 0.14 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 💻Code Gen | ok | $0.018 | 3487ms | — | 0.05 | 0.08 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 🧮Reasoning | ok | $0.018 | 4233ms | — | 0.05 | 0.08 | |
| together | gemma-3n-E4B-it | 💻Code Gen | ok | $0.019 | 2687ms | — | 0.06 | 0.12 | |
| gemini | gemini-2.5-pro | ⚡Ping | ok | $0.019 | 2990ms | — | 1.25 | 10.00 | |
| openrouter | hermes-3-llama-3.1-405b | ⚡Ping | ok | $0.019 | 438ms | — | 1.00 | 1.00 | |
| groq | gpt-oss-120b | 🏷️Classificationreal | pass | $0.019 | 658ms | — | 0.04 | 0.17 | |
| openrouter | nova-micro-v1 | 💻Code Gen | ok | $0.019 | 855ms | — | 0.04 | 0.14 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | ⚡Ping | ok | $0.019 | 926ms | — | 0.60 | 2.40 | |
| openrouter | gemma-4-26b-a4b-it | 🧮Reasoning | ok | $0.019 | 693ms | — | 0.07 | 0.34 | |
| openrouter | ministral-14b-2512 | { }JSON Output | pass | $0.020 | 446ms | — | 0.20 | 0.20 | |
| openrouter | gemma-4-26b-a4b-it | 🔍Context Recall | pass | $0.020 | 449ms | — | 0.07 | 0.34 | |
| deepinfra | gemma-4-26B-A4B-it | 🔍Context Recall | pass | $0.020 | 1171ms | — | 0.07 | 0.34 | |
| together | gemma-3n-E4B-it | 🔍Context Recall | pass | $0.020 | 2311ms | — | 0.06 | 0.12 | |
| deepinfra | DeepSeek-V4-Flash | 🔍Context Recall | pass | $0.020 | 1087ms | — | 0.09 | 0.18 | |
| openrouter | mythomax-l2-13b | 🔍Context Recall | pass | $0.020 | 854ms | — | 0.06 | 0.06 | |
| openai | gpt-4o-mini | 🔧Tool Use | pass | $0.020 | 964ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | 🔧Tool Use | pass | $0.020 | 955ms | — | 0.15 | 0.60 | |
| groq | gpt-oss-20b | 🏷️Classificationreal | pass | $0.020 | 448ms | — | 0.03 | 0.14 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 🔍Context Recall | pass | $0.021 | 1370ms | — | 0.05 | 0.08 | |
| groq | gpt-oss-120b | 🧮Reasoning | ok | $0.021 | 450ms | — | 0.04 | 0.17 | |
| openrouter | relace-search | ⚡Ping | ok | $0.021 | 2116ms | — | 1.00 | 3.00 | |
| openrouter | ring-2.6-1t | ⚡Ping | ok | $0.021 | 1566ms | — | 0.07 | 0.63 | |
| openrouter | qwen3-235b-a22b-2507 | { }JSON Output | pass | $0.022 | 601ms | — | 0.09 | 0.55 | |
| openrouter | sonar-reasoning-pro | ⚡Ping | ok | $0.022 | 2986ms | — | 2.00 | 8.00 | |
| deepinfra | gpt-oss-20b | { }JSON Output | pass | $0.022 | 1967ms | — | 0.03 | 0.14 | |
| openrouter | qwen2.5-vl-72b-instruct | ⚡Ping | ok | $0.023 | 2953ms | — | 0.80 | 1.00 | |
| openrouter | qwen3-vl-30b-a3b-instruct | { }JSON Output | pass | $0.023 | 1783ms | — | 0.13 | 0.52 | |
| deepinfra | DeepSeek-V4-Flash | 💻Code Gen | ok | $0.023 | 2714ms | — | 0.09 | 0.18 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🚀Throughput | ok | $0.023 | 12592ms | — | 0.02 | 0.03 | |
| groq | gpt-oss-20b | 🧮Reasoning | ok | $0.024 | 381ms | — | 0.03 | 0.14 | |
| groq | gpt-oss-20b | { }JSON Output | pass | $0.024 | 376ms | — | 0.03 | 0.14 | |
| openai | gpt-4.1-nano | 🔍Context Recall | pass | $0.024 | 644ms | — | 0.10 | 0.40 | |
| deepinfra | Qwen3-Max-Thinking | ⚡Ping | ok | $0.024 | 2313ms | — | 1.20 | 6.00 | |
| openrouter | mistral-small-3.2-24b-instruct | 🧮Reasoning | ok | $0.024 | 656ms | — | 0.10 | 0.30 | |
| groq | gpt-oss-120b | 🔍Context Recall | pass | $0.026 | 423ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🔍Context Recall | pass | $0.026 | 1098ms | — | 0.07 | 0.27 | |
| openrouter | qwen-2.5-coder-32b-instruct | ⚡Ping | ok | $0.026 | 1187ms | — | 0.66 | 1.00 | |
| openrouter | nova-2-lite-v1 | ⚡Ping | ok | $0.026 | 1004ms | — | 0.30 | 2.50 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 🧮Reasoning | ok | $0.026 | 1636ms | — | 0.40 | 0.40 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🧮Reasoning | ok | $0.026 | 355ms | — | 0.13 | 0.52 | |
| openrouter | qwen3-vl-32b-instruct | 🧮Reasoning | ok | $0.026 | 399ms | — | 0.10 | 0.42 | |
| groq | llama-3.3-70b-versatile | ⚡Ping | ok | $0.026 | 239ms | — | 0.59 | 0.79 | |
| openrouter | qwen3.5-9b | ⚡Ping | ok | $0.026 | 367ms | — | 0.10 | 0.15 | |
| openrouter | gpt-oss-20b | { }JSON Output | pass | $0.026 | 1388ms | — | 0.03 | 0.14 | |
| together | gpt-oss-20b | 🔍Context Recall | pass | $0.027 | 1809ms | — | 0.03 | 0.14 | |
| openrouter | ling-2.6-1t | 🔍Context Recall | pass | $0.027 | 1616ms | — | 0.07 | 0.63 | |
| openrouter | unslopnemo-12b | 🧮Reasoning | ok | $0.027 | 765ms | — | 0.40 | 0.40 | |
| groq | gpt-oss-120b | { }JSON Output | pass | $0.027 | 518ms | — | 0.04 | 0.17 | |
| openrouter | deepseek-v3.2 | { }JSON Output | pass | $0.027 | 616ms | — | 0.27 | 0.40 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | { }JSON Output | pass | $0.027 | 1489ms | — | 0.15 | 0.60 | |
| openai | gpt-3.5-turbo | 🧮Reasoning | ok | $0.027 | 1860ms | — | 0.50 | 1.50 | |
| openrouter | llama-3.1-70b-instruct | 🧮Reasoning | ok | $0.027 | 396ms | — | 0.40 | 0.40 | |
| openrouter | nex-n2-mini | 💻Code Gen | ok | $0.027 | 1009ms | — | 0.03 | 0.10 | |
| openrouter | wizardlm-2-8x22b | ⚡Ping | ok | $0.027 | 777ms | — | 0.62 | 0.62 | |
| openrouter | deepseek-v4-flash | 🔍Context Recall | pass | $0.028 | 1067ms | — | 0.10 | 0.20 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 🔧Tool Use | pass | $0.029 | 1973ms | — | 0.09 | 0.55 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 🧮Reasoning | ok | $0.029 | 3798ms | — | 0.09 | 0.55 | |
| openai | gpt-4o-mini-2024-07-18 | { }JSON Output | pass | $0.029 | 1224ms | — | 0.15 | 0.60 | |
| fireworks | gpt-oss-120b | ⚡Ping | ok | $0.029 | 974ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | { }JSON Output | pass | $0.030 | 1041ms | — | 0.15 | 0.60 | |
| openrouter | mistral-small-2603 | { }JSON Output | pass | $0.030 | 479ms | — | 0.15 | 0.60 | |
| together | Llama-3.3-70B-Instruct-Turbo | 🔧Tool Use | pass | $0.030 | 1246ms | — | 0.10 | 0.32 | |
| together | gpt-oss-20b | { }JSON Output | pass | $0.030 | 2054ms | — | 0.03 | 0.14 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🧮Reasoning | ok | $0.030 | 1812ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | 🧮Reasoning | ok | $0.030 | 1493ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-14B | ⚡Ping | ok | $0.031 | 2779ms | — | 0.12 | 0.24 | |
| openrouter | ling-2.6-1t | { }JSON Output | pass | $0.031 | 1401ms | — | 0.07 | 0.63 | |
| openai | gpt-4o-mini | 🧮Reasoning | ok | $0.032 | 1272ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-v3.2 | 🧮Reasoning | ok | $0.032 | 871ms | — | 0.27 | 0.40 | |
| openrouter | hunyuan-a13b-instruct | { }JSON Output | pass | $0.032 | 1404ms | — | 0.14 | 0.57 | |
| openrouter | mistral-saba | { }JSON Output | pass | $0.032 | 666ms | — | 0.20 | 0.60 | |
| openrouter | deepseek-v4-flash | 🚀Throughput | ok | $0.032 | 1127ms | — | 0.10 | 0.20 | |
| openrouter | mistral-small-3.2-24b-instruct | 🔍Context Recall | pass | $0.032 | 747ms | — | 0.10 | 0.30 | |
| openrouter | command-r-08-2024 | { }JSON Output | pass | $0.032 | 917ms | — | 0.15 | 0.60 | |
| groq | gpt-oss-20b | 💻Code Gen | ok | $0.034 | 439ms | — | 0.03 | 0.14 | |
| openrouter | step-3.5-flash | ⚡Ping | ok | $0.034 | 1889ms | — | 0.10 | 0.30 | |
| together | gpt-oss-20b | 🔧Tool Use | pass | $0.034 | 2072ms | — | 0.03 | 0.14 | |
| openrouter | qwen3-235b-a22b-2507 | 🧮Reasoning | ok | $0.034 | 1052ms | — | 0.09 | 0.55 | |
| openrouter | ling-2.6-1t | 🧮Reasoning | ok | $0.034 | 1196ms | — | 0.07 | 0.63 | |
| openrouter | mythomax-l2-13b | 🚀Throughput | ok | $0.034 | 1620ms | — | 0.06 | 0.06 | |
| openrouter | command-r-08-2024 | 🧮Reasoning | ok | $0.035 | 783ms | — | 0.15 | 0.60 | |
| openrouter | gpt-oss-20b | 🧮Reasoning | ok | $0.035 | 962ms | — | 0.03 | 0.14 | |
| openrouter | llama-4-scout | 🔍Context Recall | pass | $0.035 | 467ms | — | 0.10 | 0.30 | |
| groq | gpt-oss-20b | code_refactor_preserve | pass | $0.035 | 578ms | — | 0.03 | 0.14 | |
| openrouter | mistral-small-2603 | 🧮Reasoning | ok | $0.035 | 539ms | — | 0.15 | 0.60 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | { }JSON Output | pass | $0.036 | 1544ms | — | 0.40 | 0.40 | |
| openrouter | nova-micro-v1 | 🔍Context Recall | pass | $0.036 | 624ms | — | 0.04 | 0.14 | |
| openrouter | hunyuan-a13b-instruct | 🔍Context Recall | pass | $0.036 | 1474ms | — | 0.14 | 0.57 | |
| openai | gpt-4.1 | ⚡Ping | ok | $0.036 | 936ms | — | 2.00 | 8.00 | |
| openrouter | sonar-pro-search | ⚡Ping | ok | $0.036 | 1087ms | — | 3.00 | 15.00 | |
| openrouter | deepseek-chat-v3.1 | { }JSON Output | pass | $0.036 | 1953ms | — | 0.25 | 0.95 | |
| together | Llama-3.3-70B-Instruct-Turbo | 🔍Context Recall | pass | $0.036 | 2777ms | — | 0.10 | 0.32 | |
| openrouter | llama-3.1-70b-instruct | { }JSON Output | pass | $0.037 | 361ms | — | 0.40 | 0.40 | |
| openrouter | gpt-oss-safeguard-20b | ⚡Ping | ok | $0.037 | 504ms | — | 0.07 | 0.30 | |
| openrouter | command-r-plus-08-2024 | ⚡Ping | ok | $0.037 | 874ms | — | 2.50 | 10.00 | |
| openrouter | qwen3-235b-a22b-2507 | 🔍Context Recall | pass | $0.038 | 854ms | — | 0.09 | 0.55 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 🔍Context Recall | pass | $0.038 | 3004ms | — | 0.09 | 0.55 | |
| openrouter | mistral-large | ⚡Ping | ok | $0.038 | 540ms | — | 2.00 | 6.00 | |
| openrouter | mistral-small-3.2-24b-instruct | 💻Code Gen | ok | $0.038 | 644ms | — | 0.10 | 0.30 | |
| openrouter | qwen-plus | { }JSON Output | pass | $0.038 | 332ms | — | 0.26 | 0.78 | |
| groq | gpt-oss-120b | code_refactor_preserve | pass | $0.038 | 644ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-vl-32b-instruct | 🔍Context Recall | pass | $0.039 | 419ms | — | 0.10 | 0.42 | |
| openrouter | codestral-2508 | { }JSON Output | pass | $0.039 | 417ms | — | 0.30 | 0.90 | |
| openrouter | unslopnemo-12b | { }JSON Output | pass | $0.039 | 1314ms | — | 0.40 | 0.40 | |
| deepinfra | gpt-oss-20b | 🧮Reasoning | ok | $0.039 | 3470ms | — | 0.03 | 0.14 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | { }JSON Output | pass | $0.039 | 2051ms | — | 0.20 | 0.88 | |
| deepinfra | DeepSeek-V4-Flash | 🔧Tool Use | pass | $0.040 | 2218ms | — | 0.09 | 0.18 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🔧Tool Use | pass | $0.040 | 1280ms | — | 0.09 | 1.10 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🔧Tool Use | pass | $0.041 | 1331ms | — | 0.15 | 0.60 | |
| openrouter | rocinante-12b | { }JSON Output | pass | $0.041 | 476ms | — | 0.25 | 0.50 | |
| openrouter | mercury-2 | ⚡Ping | ok | $0.041 | 419ms | — | 0.25 | 0.75 | |
| together | LFM2.5-8B-A1B | 🔍Context Recall | pass | $0.041 | 1109ms | — | 0.03 | 0.12 | |
| openrouter | mistral-small-2603 | 🔍Context Recall | pass | $0.041 | 568ms | — | 0.15 | 0.60 | |
| deepinfra | MythoMax-L2-13b | { }JSON Output | pass | $0.042 | 2074ms | — | 0.40 | 0.40 | |
| together | LFM2.5-8B-A1B | 🧮Reasoning | ok | $0.042 | 1711ms | — | 0.03 | 0.12 | |
| openrouter | gpt-oss-20b | 💻Code Gen | ok | $0.042 | 464ms | — | 0.03 | 0.14 | |
| deepinfra | Qwen3.5-9B | ⚡Ping | ok | $0.043 | 5020ms | — | 0.10 | 0.15 | |
| deepinfra | gpt-oss-20b | 💻Code Gen | ok | $0.043 | 2463ms | — | 0.03 | 0.14 | |
| openrouter | kat-coder-pro-v2 | { }JSON Output | pass | $0.043 | 1055ms | — | 0.30 | 1.20 | |
| openrouter | llama-3.1-8b-instruct | 🚀Throughput | ok | $0.043 | 351ms | — | 0.05 | 0.08 | |
| openrouter | deepseek-chat | { }JSON Output | pass | $0.043 | 717ms | — | 0.20 | 0.80 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | { }JSON Output | pass | $0.043 | 4486ms | — | 0.05 | 0.20 | |
| openrouter | hunyuan-a13b-instruct | 🧮Reasoning | ok | $0.045 | 1462ms | — | 0.14 | 0.57 | |
| openrouter | glm-4.5 | ⚡Ping | ok | $0.045 | 1839ms | — | 0.60 | 2.20 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🔍Context Recall | pass | $0.045 | 710ms | — | 0.13 | 0.52 | |
| openai | gpt-4o-2024-05-13 | ⚡Ping | ok | $0.045 | 735ms | — | 2.50 | 10.00 | |
| openrouter | deepseek-v3.1-terminus | { }JSON Output | pass | $0.045 | 1836ms | — | 0.27 | 1.00 | |
| deepinfra | DeepSeek-V3 | { }JSON Output | pass | $0.046 | 2135ms | — | 0.32 | 0.89 | |
| openai | gpt-4.1-nano | 💻Code Gen | ok | $0.046 | 966ms | — | 0.10 | 0.40 | |
| deepinfra | DeepSeek-V3.1-Terminus | { }JSON Output | pass | $0.046 | 1113ms | — | 0.27 | 0.95 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | { }JSON Output | pass | $0.046 | 1640ms | — | 0.09 | 1.10 | |
| openrouter | cogito-v2.1-671b | ⚡Ping | ok | $0.046 | 652ms | — | 1.25 | 1.25 | |
| openrouter | ministral-14b-2512 | 💻Code Gen | ok | $0.046 | 1475ms | — | 0.20 | 0.20 | |
| deepinfra | DeepSeek-V3 | 🧮Reasoning | ok | $0.047 | 2607ms | — | 0.32 | 0.89 | |
| openrouter | laguna-m.1 | ⚡Ping | ok | $0.047 | 458ms | — | 0.20 | 0.40 | |
| groq | gpt-oss-20b | 📋Instruction Followreal | pass | $0.047 | 630ms | — | 0.03 | 0.14 | |
| groq | gpt-oss-120b | 💻Code Gen | ok | $0.047 | 762ms | — | 0.04 | 0.17 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🔍Context Recall | pass | $0.047 | 4811ms | — | 0.05 | 0.20 | |
| groq | gpt-oss-120b | code_fix_bug | pass | $0.047 | 729ms | — | 0.04 | 0.17 | |
| openai | gpt-4o-mini | 🔍Context Recall | pass | $0.048 | 1001ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | 🔍Context Recall | pass | $0.048 | 1244ms | — | 0.15 | 0.60 | |
| together | qwen-2-1.5b-instruct | 🚀Throughput | ok | $0.048 | 3010ms | — | 0.10 | 0.10 | |
| openrouter | mistral-medium-3-5 | ⚡Ping | ok | $0.048 | 556ms | — | 1.50 | 7.50 | |
| openrouter | deepseek-v4-flash | 🧮Reasoning | ok | $0.048 | 3188ms | — | 0.10 | 0.20 | |
| together | gpt-oss-20b | 🧮Reasoning | ok | $0.048 | 2955ms | — | 0.03 | 0.14 | |
| openrouter | deepseek-v4-flash | 💻Code Gen | ok | $0.048 | 2144ms | — | 0.10 | 0.20 | |
| deepinfra | MiMo-V2.5 | ⚡Ping | ok | $0.048 | 944ms | — | 0.40 | 2.00 | |
| openrouter | l3.1-euryale-70b | 🧮Reasoning | ok | $0.048 | 422ms | — | 0.85 | 0.85 | |
| openrouter | deepseek-chat-v3.1 | 🧮Reasoning | ok | $0.049 | 3182ms | — | 0.25 | 0.95 | |
| openrouter | command-r-08-2024 | 🔍Context Recall | pass | $0.049 | 787ms | — | 0.15 | 0.60 | |
| openrouter | ministral-14b-2512 | 🔍Context Recall | pass | $0.049 | 542ms | — | 0.20 | 0.20 | |
| groq | gpt-oss-120b | code_to_spec | pass | $0.049 | 769ms | — | 0.04 | 0.17 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🔍Context Recall | pass | $0.049 | 1544ms | — | 0.15 | 0.60 | |
| openrouter | gemma-4-26b-a4b-it | 💻Code Gen | ok | $0.049 | 789ms | — | 0.07 | 0.34 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 💻Code Gen | ok | $0.050 | 1052ms | — | 0.07 | 0.27 | |
| deepinfra | gemma-4-26B-A4B-it | 💻Code Gen | ok | $0.050 | 3190ms | — | 0.07 | 0.34 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 💻Code Gen | ok | $0.050 | 4891ms | — | 0.05 | 0.20 | |
| openrouter | qwen3-vl-32b-instruct | 💻Code Gen | ok | $0.050 | 328ms | — | 0.10 | 0.42 | |
| openrouter | nex-n2-mini | 🚀Throughput | ok | $0.051 | 334ms | — | 0.03 | 0.10 | |
| groq | gpt-oss-20b | 🧠Multi-Step Logic | pass | $0.051 | 675ms | — | 0.03 | 0.14 | |
| deepinfra | GLM-4.7-Flash | 🔧Tool Use | pass | $0.052 | 33694ms | — | 0.06 | 0.40 | |
| groq | gpt-oss-120b | code_algo | pass | $0.052 | 809ms | — | 0.04 | 0.17 | |
| deepinfra | gpt-oss-20b | 🔍Context Recall | pass | $0.052 | 3070ms | — | 0.03 | 0.14 | |
| deepinfra | Qwen3.5-9B | 🔧Tool Use | pass | $0.052 | 4453ms | — | 0.10 | 0.15 | |
| openrouter | qwen-2.5-7b-instruct | 🚀Throughput | ok | $0.052 | 955ms | — | 0.04 | 0.10 | |
| openrouter | mistral-saba | 🔍Context Recall | pass | $0.052 | 2048ms | — | 0.20 | 0.60 | |
| openrouter | gemma-2-27b-it | 🧮Reasoning | ok | $0.053 | 639ms | — | 0.65 | 0.65 | |
| openrouter | qwen3-coder | { }JSON Output | pass | $0.053 | 1188ms | — | 0.30 | 1.00 | |
| together | gpt-oss-20b | 💻Code Gen | ok | $0.053 | 3820ms | — | 0.03 | 0.14 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🧮Reasoning | ok | $0.053 | 3348ms | — | 0.20 | 0.88 | |
| openai | gpt-4.1-mini-2025-04-14 | { }JSON Output | pass | $0.055 | 851ms | — | 0.40 | 1.60 | |
| openai | gpt-4o | ⚡Ping | ok | $0.055 | 1112ms | — | 2.50 | 10.00 | |
| openrouter | ring-2.6-1t | 🔍Context Recall | pass | $0.055 | 1126ms | — | 0.07 | 0.63 | |
| fireworks | gpt-oss-120b | 🔧Tool Use | pass | $0.055 | 1224ms | — | 0.15 | 0.60 | |
| openrouter | reka-flash-3 | ⚡Ping | ok | $0.056 | 10119ms | — | 0.10 | 0.20 | |
| openrouter | mistral-saba | 🧮Reasoning | ok | $0.056 | 479ms | — | 0.20 | 0.60 | |
| openrouter | glm-4.6v | ⚡Ping | ok | $0.056 | 721ms | — | 0.30 | 0.90 | |
| openrouter | ernie-4.5-vl-424b-a47b | { }JSON Output | pass | $0.056 | 1545ms | — | 0.42 | 1.25 | |
| groq | gpt-oss-20b | 📄Data Extractionreal | pass | $0.057 | 717ms | — | 0.03 | 0.14 | |
| openrouter | deepseek-v3.2 | 🔍Context Recall | pass | $0.057 | 1331ms | — | 0.27 | 0.40 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🔍Context Recall | pass | $0.057 | 1287ms | — | 0.09 | 1.10 | |
| openrouter | deepseek-v3.1-terminus | 🧮Reasoning | ok | $0.057 | 1082ms | — | 0.27 | 1.00 | |
| cerebras | gpt-oss-120b | ⚡Ping | ok | $0.058 | 463ms | — | 0.14 | 0.95 | |
| openrouter | qwen3-coder | 🧮Reasoning | ok | $0.058 | 1372ms | — | 0.30 | 1.00 | |
| openrouter | unslopnemo-12b | 💻Code Gen | ok | $0.058 | 833ms | — | 0.40 | 0.40 | |
| openrouter | qwen3-8b | ⚡Ping | ok | $0.058 | 719ms | — | 0.12 | 0.46 | |
| openrouter | rocinante-12b | 💻Code Gen | ok | $0.059 | 520ms | — | 0.25 | 0.50 | |
| openrouter | deepseek-chat | 🧮Reasoning | ok | $0.060 | 878ms | — | 0.20 | 0.80 | |
| groq | gpt-oss-20b | code_algo | pass | $0.060 | 832ms | — | 0.03 | 0.14 | |
| openai | gpt-4.1-mini-2025-04-14 | 🧮Reasoning | ok | $0.060 | 901ms | — | 0.40 | 1.60 | |
| groq | gpt-oss-120b | 📝Summarizationreal | pass | $0.060 | 1094ms | — | 0.04 | 0.17 | |
| openrouter | deepseek-chat-v3.1 | 🔍Context Recall | pass | $0.060 | 2409ms | — | 0.25 | 0.95 | |
| openai | gpt-3.5-turbo | 🔧Tool Use | pass | $0.060 | 2039ms | — | 0.50 | 1.50 | |
| openrouter | command-r-08-2024 | 💻Code Gen | ok | $0.061 | 775ms | — | 0.15 | 0.60 | |
| groq | llama-3.3-70b-versatile | 🧮Reasoning | ok | $0.061 | 407ms | — | 0.59 | 0.79 | |
| groq | gpt-oss-20b | code_to_spec | pass | $0.062 | 794ms | — | 0.03 | 0.14 | |
| openrouter | minimax-m2-her | ⚡Ping | ok | $0.062 | 1690ms | — | 0.30 | 1.20 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔧Tool Use | pass | $0.062 | 879ms | — | 0.40 | 1.60 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 💻Code Gen | ok | $0.062 | 318ms | — | 0.13 | 0.52 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🔧Tool Use | pass | $0.062 | 2111ms | — | 0.20 | 0.88 | |
| deepinfra | DeepSeek-V3.1-Terminus | 🧮Reasoning | ok | $0.062 | 1335ms | — | 0.27 | 0.95 | |
| openrouter | qwen-plus | 🔍Context Recall | pass | $0.062 | 340ms | — | 0.26 | 0.78 | |
| groq | gpt-oss-120b | 📄Data Extractionreal | pass | $0.065 | 1197ms | — | 0.04 | 0.17 | |
| groq | gpt-oss-120b | 🧠Multi-Step Logic | pass | $0.065 | 1135ms | — | 0.04 | 0.17 | |
| deepinfra | Qwen3-14B | 🔧Tool Use | pass | $0.066 | 3491ms | — | 0.12 | 0.24 | |
| openrouter | gpt-oss-20b | 🔍Context Recall | pass | $0.067 | 1306ms | — | 0.03 | 0.14 | |
| openrouter | qwen-plus | 🧮Reasoning | ok | $0.067 | 370ms | — | 0.26 | 0.78 | |
| openrouter | wizardlm-2-8x22b | 🧮Reasoning | ok | $0.068 | 899ms | — | 0.62 | 0.62 | |
| together | MiniMax-M2.7 | ⚡Ping | ok | $0.068 | 1574ms | — | 0.25 | 1.00 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🔧Tool Use | pass | $0.068 | 3760ms | — | 0.05 | 0.20 | |
| together | Llama-3.3-70B-Instruct-Turbo | 💻Code Gen | ok | $0.069 | 8201ms | — | 0.10 | 0.32 | |
| openrouter | mistral-large-2512 | 🧮Reasoning | ok | $0.069 | 998ms | — | 0.50 | 1.50 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 🚀Throughput | ok | $0.070 | 15871ms | — | 0.05 | 0.08 | |
| deepinfra | DeepSeek-V3.1-Terminus | 🔍Context Recall | pass | $0.070 | 1080ms | — | 0.27 | 0.95 | |
| openrouter | gemma-2-27b-it | { }JSON Output | pass | $0.070 | 619ms | — | 0.65 | 0.65 | |
| openai | gpt-4o-mini-2024-07-18 | 💻Code Gen | ok | $0.070 | 2163ms | — | 0.15 | 0.60 | |
| openrouter | nova-micro-v1 | 🚀Throughput | ok | $0.071 | 606ms | — | 0.04 | 0.14 | |
| openrouter | kat-coder-pro-v2 | 🧮Reasoning | ok | $0.071 | 1387ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-chat | 🔍Context Recall | pass | $0.071 | 1059ms | — | 0.20 | 0.80 | |
| deepinfra | Seed-1.8 | ⚡Ping | ok | $0.072 | 3011ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-vl-235b-a22b-instruct | { }JSON Output | pass | $0.072 | 297ms | — | 0.21 | 1.90 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 💻Code Gen | ok | $0.072 | 3304ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🔍Context Recall | pass | $0.072 | 7728ms | — | 0.20 | 0.88 | |
| openrouter | seed-1.6-flash | 🔍Context Recall | pass | $0.072 | 343ms | — | 0.07 | 0.30 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🧮Reasoning | ok | $0.073 | 7318ms | — | 0.05 | 0.20 | |
| openrouter | seed-1.6-flash | 🧮Reasoning | ok | $0.073 | 301ms | — | 0.07 | 0.30 | |
| openrouter | llama-3.1-70b-instruct | 💻Code Gen | ok | $0.074 | 390ms | — | 0.40 | 0.40 | |
| deepinfra | Qwen3-30B-A3B | ⚡Ping | ok | $0.074 | 1918ms | — | 0.12 | 0.50 | |
| groq | llama-3.3-70b-versatile | { }JSON Output | pass | $0.074 | 282ms | — | 0.59 | 0.79 | |
| openrouter | rocinante-12b | 🔍Context Recall | pass | $0.074 | 481ms | — | 0.25 | 0.50 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | ⚡Ping | ok | $0.075 | 2460ms | — | 0.23 | 2.30 | |
| openai | gpt-4o-mini | 💻Code Gen | ok | $0.075 | 1825ms | — | 0.15 | 0.60 | |
| fireworks | gpt-oss-120b | 🔍Context Recall | pass | $0.075 | 1264ms | — | 0.15 | 0.60 | |
| openrouter | l3.1-euryale-70b | { }JSON Output | pass | $0.076 | 350ms | — | 0.85 | 0.85 | |
| openrouter | mistral-saba | 💻Code Gen | ok | $0.076 | 470ms | — | 0.20 | 0.60 | |
| openrouter | mistral-small-2603 | 💻Code Gen | ok | $0.076 | 582ms | — | 0.15 | 0.60 | |
| openrouter | wizardlm-2-8x22b | { }JSON Output | pass | $0.076 | 1164ms | — | 0.62 | 0.62 | |
| groq | gpt-oss-20b | ✅Format Compliancereal | pass | $0.076 | 746ms | — | 0.03 | 0.14 | |
| openrouter | qwen2.5-vl-72b-instruct | 🧮Reasoning | ok | $0.077 | 446ms | — | 0.80 | 1.00 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 💻Code Gen | ok | $0.077 | 5457ms | — | 0.40 | 0.40 | |
| openrouter | qwen2.5-vl-72b-instruct | { }JSON Output | pass | $0.078 | 1617ms | — | 0.80 | 1.00 | |
| fireworks | gpt-oss-120b | 🧮Reasoning | ok | $0.078 | 784ms | — | 0.15 | 0.60 | |
| openrouter | ling-2.6-1t | 💻Code Gen | ok | $0.079 | 1371ms | — | 0.07 | 0.63 | |
| openrouter | qwen3.5-9b | 🚀Throughput | ok | $0.079 | 684ms | — | 0.10 | 0.15 | |
| openrouter | deepseek-v3.2 | 💻Code Gen | ok | $0.079 | 1915ms | — | 0.27 | 0.40 | |
| openrouter | minimax-m2-her | 🧮Reasoning | ok | $0.080 | 1706ms | — | 0.30 | 1.20 | |
| groq | gpt-oss-20b | 📝Summarizationreal | pass | $0.080 | 887ms | — | 0.03 | 0.14 | |
| openrouter | hermes-3-llama-3.1-405b | { }JSON Output | pass | $0.080 | 423ms | — | 1.00 | 1.00 | |
| deepinfra | MiniMax-M2.7 | ⚡Ping | ok | $0.080 | 2448ms | — | 0.25 | 1.00 | |
| together | MiniMax-M3 | ⚡Ping | ok | $0.081 | 3029ms | — | 0.30 | 1.20 | |
| openai | gpt-3.5-turbo | { }JSON Output | pass | $0.081 | 1071ms | — | 0.50 | 1.50 | |
| openrouter | seed-1.6-flash | { }JSON Output | pass | $0.082 | 270ms | — | 0.07 | 0.30 | |
| openrouter | kimi-k2 | { }JSON Output | pass | $0.082 | 999ms | — | 0.57 | 2.30 | |
| openrouter | kat-coder-pro-v2 | 🔍Context Recall | pass | $0.084 | 1088ms | — | 0.30 | 1.20 | |
| openrouter | aion-2.0 | ⚡Ping | ok | $0.085 | 1241ms | — | 0.80 | 1.60 | |
| openrouter | deepseek-v3.1-terminus | 🔍Context Recall | pass | $0.086 | 3639ms | — | 0.27 | 1.00 | |
| openrouter | ernie-4.5-vl-424b-a47b | 🧮Reasoning | ok | $0.087 | 1404ms | — | 0.42 | 1.25 | |
| openrouter | kimi-k2 | 🧮Reasoning | ok | $0.087 | 1449ms | — | 0.57 | 2.30 | |
| openrouter | minimax-m2-her | 🚀Throughput | ok | $0.088 | 1859ms | — | 0.30 | 1.20 | |
| openrouter | mercury-2 | 🧮Reasoning | ok | $0.088 | 466ms | — | 0.25 | 0.75 | |
| deepinfra | Qwen3-14B | 🧮Reasoning | ok | $0.089 | 6553ms | — | 0.12 | 0.24 | |
| openrouter | qwen3.5-9b | 🔍Context Recall | pass | $0.090 | 1359ms | — | 0.10 | 0.15 | |
| openrouter | mistral-large-2512 | { }JSON Output | pass | $0.090 | 588ms | — | 0.50 | 1.50 | |
| openrouter | ring-2.6-1t | { }JSON Output | pass | $0.091 | 1122ms | — | 0.07 | 0.63 | |
| together | LFM2.5-8B-A1B | 🚀Throughput | ok | $0.092 | 2484ms | — | 0.03 | 0.12 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🧮Reasoning | ok | $0.092 | 3242ms | — | 0.09 | 1.10 | |
| deepinfra | MiniMax-M3 | ⚡Ping | ok | $0.092 | 1108ms | — | 0.30 | 1.20 | |
| deepinfra | DeepSeek-V3 | 🔍Context Recall | pass | $0.093 | 1954ms | — | 0.32 | 0.89 | |
| openrouter | qwen3-235b-a22b-2507 | 💻Code Gen | ok | $0.093 | 886ms | — | 0.09 | 0.55 | |
| openrouter | unslopnemo-12b | 🔍Context Recall | pass | $0.093 | 876ms | — | 0.40 | 0.40 | |
| together | gemma-3n-E4B-it | 🚀Throughput | ok | $0.093 | 12973ms | — | 0.06 | 0.12 | |
| openrouter | cogito-v2.1-671b | 🧮Reasoning | ok | $0.094 | 411ms | — | 1.25 | 1.25 | |
| openrouter | laguna-m.1 | { }JSON Output | pass | $0.094 | 464ms | — | 0.20 | 0.40 | |
| deepinfra | Qwen3-30B-A3B | 🔧Tool Use | pass | $0.094 | 1841ms | — | 0.12 | 0.50 | |
| groq | gpt-oss-120b | ✅Format Compliancereal | pass | $0.095 | 1821ms | — | 0.04 | 0.17 | |
| deepinfra | Qwen3-14B | 🔍Context Recall | pass | $0.096 | 4986ms | — | 0.12 | 0.24 | |
| deepinfra | Nemotron-Content-Safety-3.5 | ⚡Ping | ok | $0.096 | 759ms | — | 0.20 | 0.20 | |
| openrouter | codestral-2508 | 🔍Context Recall | pass | $0.096 | 472ms | — | 0.30 | 0.90 | |
| openrouter | codestral-2508 | 🧮Reasoning | ok | $0.096 | 448ms | — | 0.30 | 0.90 | |
| openrouter | llama-3.1-70b-instruct | 🔍Context Recall | pass | $0.096 | 381ms | — | 0.40 | 0.40 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 💻Code Gen | ok | $0.096 | 8759ms | — | 0.09 | 0.55 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 🔍Context Recall | pass | $0.096 | 1968ms | — | 0.40 | 0.40 | |
| openrouter | deepseek-chat | 💻Code Gen | ok | $0.098 | 1231ms | — | 0.20 | 0.80 | |
| openrouter | minimax-m2.7 | ⚡Ping | ok | $0.098 | 974ms | — | 0.25 | 1.00 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 💻Code Gen | ok | $0.099 | 3050ms | — | 0.20 | 0.88 | |
| openrouter | hunyuan-a13b-instruct | 💻Code Gen | ok | $0.099 | 1326ms | — | 0.14 | 0.57 | |
| deepinfra | Nemotron-Content-Safety-3.5 | 🚀Throughput | ok | $0.100 | 796ms | — | 0.20 | 0.20 | |
| openrouter | minimax-m2-her | { }JSON Output | pass | $0.100 | 1706ms | — | 0.30 | 1.20 | |
| openrouter | qwen3-coder | 🔍Context Recall | pass | $0.102 | 742ms | — | 0.30 | 1.00 | |
| openrouter | reka-flash-3 | 🚀Throughput | ok | $0.104 | 1118ms | — | 0.10 | 0.20 | |
| cerebras | gpt-oss-120b | 🧮Reasoning | ok | $0.104 | 668ms | — | 0.14 | 0.95 | |
| openrouter | ernie-4.5-vl-424b-a47b | 🔍Context Recall | pass | $0.104 | 1600ms | — | 0.42 | 1.25 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🧮Reasoning | ok | $0.104 | 551ms | — | 0.60 | 2.40 | |
| openrouter | qwen-plus | 💻Code Gen | ok | $0.105 | 323ms | — | 0.26 | 0.78 | |
| deepinfra | DeepSeek-V3.1-Terminus | 💻Code Gen | ok | $0.105 | 3626ms | — | 0.27 | 0.95 | |
| openrouter | ministral-14b-2512 | 🚀Throughput | ok | $0.107 | 688ms | — | 0.20 | 0.20 | |
| groq | gpt-oss-20b | code_fix_bug | pass | $0.107 | 1212ms | — | 0.03 | 0.14 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 🔧Tool Use | pass | $0.107 | 1344ms | — | 0.40 | 0.40 | |
| deepinfra | DeepSeek-V3 | 💻Code Gen | ok | $0.108 | 5614ms | — | 0.32 | 0.89 | |
| openrouter | hermes-3-llama-3.1-405b | 🧮Reasoning | ok | $0.108 | 351ms | — | 1.00 | 1.00 | |
| openrouter | codestral-2508 | 💻Code Gen | ok | $0.108 | 496ms | — | 0.30 | 0.90 | |
| deepinfra | gpt-oss-20b | 🚀Throughput | ok | $0.108 | 6722ms | — | 0.03 | 0.14 | |
| deepinfra | phi-4 | 🚀Throughput | ok | $0.108 | 9401ms | — | 0.07 | 0.14 | |
| together | gpt-oss-20b | 🚀Throughput | ok | $0.109 | 6505ms | — | 0.03 | 0.14 | |
| groq | gpt-oss-20b | 🚀Throughput | ok | $0.109 | 1059ms | — | 0.03 | 0.14 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🔍Context Recall | pass | $0.109 | 683ms | — | 0.21 | 1.90 | |
| deepinfra | GLM-4.7-Flash | ⚡Ping | ok | $0.110 | 7416ms | — | 0.06 | 0.40 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🧮Reasoning | ok | $0.110 | 343ms | — | 0.21 | 1.90 | |
| together | MiniMax-M3 | 🧮Reasoning | ok | $0.110 | 2759ms | — | 0.30 | 1.20 | |
| openrouter | gemma-2-27b-it | 💻Code Gen | ok | $0.111 | 590ms | — | 0.65 | 0.65 | |
| openrouter | kimi-k2-thinking | ⚡Ping | ok | $0.112 | 984ms | — | 0.60 | 2.50 | |
| groq | gpt-oss-120b | 📋Instruction Followreal | pass | $0.112 | 1560ms | — | 0.04 | 0.17 | |
| openrouter | qwen2.5-vl-72b-instruct | 💻Code Gen | ok | $0.113 | 730ms | — | 0.80 | 1.00 | |
| openrouter | trinity-large-thinking | 🧮Reasoning | ok | $0.113 | 1048ms | — | 0.25 | 0.80 | |
| together | MiniMax-M2.7 | 🔧Tool Use | pass | $0.113 | 725ms | — | 0.25 | 1.00 | |
| openai | gpt-3.5-turbo | 🔍Context Recall | pass | $0.113 | 1093ms | — | 0.50 | 1.50 | |
| openrouter | glm-5v-turbo | ⚡Ping | ok | $0.114 | 1217ms | — | 1.20 | 4.00 | |
| deepinfra | MiMo-V2.5 | { }JSON Output | pass | $0.114 | 1248ms | — | 0.40 | 2.00 | |
| deepinfra | MiniMax-M2.7 | 🔧Tool Use | pass | $0.117 | 2001ms | — | 0.25 | 1.00 | |
| fireworks | gpt-oss-120b | { }JSON Output | pass | $0.117 | 1519ms | — | 0.15 | 0.60 | |
| deepinfra | MiniMax-M2.7-Turbo | ⚡Ping | ok | $0.117 | 1934ms | — | 0.38 | 1.70 | |
| deepinfra | Qwen3.5-9B | 🚀Throughput | ok | $0.117 | 16923ms | — | 0.10 | 0.15 | |
| deepinfra | Qwen3.5-9B | 🔍Context Recall | pass | $0.120 | 17237ms | — | 0.10 | 0.15 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 💻Code Gen | ok | $0.120 | 2596ms | — | 0.09 | 1.10 | |
| openrouter | mercury-2 | { }JSON Output | pass | $0.120 | 511ms | — | 0.25 | 0.75 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔍Context Recall | pass | $0.124 | 1423ms | — | 0.40 | 1.60 | |
| openrouter | step-3.5-flash | { }JSON Output | pass | $0.125 | 1895ms | — | 0.10 | 0.30 | |
| deepinfra | MythoMax-L2-13b | 🔍Context Recall | pass | $0.125 | 1495ms | — | 0.40 | 0.40 | |
| groq | gpt-oss-20b | 🪡Long-Context Needle | pass | $0.126 | 584ms | — | 0.03 | 0.14 | |
| openrouter | wizardlm-2-8x22b | 💻Code Gen | ok | $0.126 | 895ms | — | 0.62 | 0.62 | |
| openrouter | step-3.7-flash | ⚡Ping | ok | $0.127 | 794ms | — | 0.20 | 1.15 | |
| openrouter | nova-premier-v1 | ⚡Ping | ok | $0.128 | 1617ms | — | 2.50 | 12.50 | |
| openrouter | skyfall-36b-v2 | ⚡Ping | ok | $0.128 | 565ms | — | 0.55 | 0.80 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | { }JSON Output | pass | $0.129 | 589ms | — | 0.60 | 2.40 | |
| openrouter | hermes-3-llama-3.1-70b | 🧮Reasoning | ok | $0.131 | 423ms | — | 0.70 | 0.70 | |
| openrouter | nova-2-lite-v1 | { }JSON Output | pass | $0.131 | 672ms | — | 0.30 | 2.50 | |
| groq | gpt-oss-120b | 🚀Throughput | ok | $0.132 | 1828ms | — | 0.04 | 0.17 | |
| openrouter | qwen3.5-9b | { }JSON Output | pass | $0.133 | 1486ms | — | 0.10 | 0.15 | |
| openrouter | glm-4.5v | ⚡Ping | ok | $0.134 | 1757ms | — | 0.60 | 1.80 | |
| openrouter | qwen3.5-9b | 🧮Reasoning | ok | $0.134 | 598ms | — | 0.10 | 0.15 | |
| deepinfra | Qwen3.5-9B | { }JSON Output | pass | $0.135 | 14160ms | — | 0.10 | 0.15 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🚀Throughput | ok | $0.138 | 1079ms | — | 0.07 | 0.27 | |
| deepinfra | MiniMax-M3 | 🧮Reasoning | ok | $0.139 | 1722ms | — | 0.30 | 1.20 | |
| deepinfra | DeepSeek-V4-Flash | 🚀Throughput | ok | $0.139 | 20394ms | — | 0.09 | 0.18 | |
| deepinfra | DeepSeek-V3 | 🔧Tool Use | pass | $0.140 | 1865ms | — | 0.32 | 0.89 | |
| openrouter | qwen3-8b | { }JSON Output | pass | $0.142 | 697ms | — | 0.12 | 0.46 | |
| openrouter | cogito-v2.1-671b | { }JSON Output | pass | $0.142 | 396ms | — | 1.25 | 1.25 | |
| openrouter | kimi-k2.6 | ⚡Ping | ok | $0.144 | 1614ms | — | 0.68 | 3.42 | |
| openrouter | qwen3.5-35b-a3b | ⚡Ping | ok | $0.144 | 1153ms | — | 0.14 | 1.00 | |
| openrouter | hermes-3-llama-3.1-405b | 💻Code Gen | ok | $0.145 | 371ms | — | 1.00 | 1.00 | |
| deepinfra | Qwen3-30B-A3B | 🔍Context Recall | pass | $0.146 | 2573ms | — | 0.12 | 0.50 | |
| openrouter | trinity-large-thinking | { }JSON Output | pass | $0.149 | 1078ms | — | 0.25 | 0.80 | |
| openrouter | qwen-2.5-coder-32b-instruct | 💻Code Gen | ok | $0.149 | 798ms | — | 0.66 | 1.00 | |
| openrouter | skyfall-36b-v2 | 🧮Reasoning | ok | $0.150 | 644ms | — | 0.55 | 0.80 | |
| openrouter | nova-2-lite-v1 | 🧮Reasoning | ok | $0.151 | 936ms | — | 0.30 | 2.50 | |
| groq | gpt-oss-120b | 🪡Long-Context Needle | pass | $0.152 | 936ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-coder-plus | { }JSON Output | pass | $0.153 | 729ms | — | 0.65 | 3.25 | |
| together | MiniMax-M3 | { }JSON Output | pass | $0.153 | 2371ms | — | 0.30 | 1.20 | |
| openrouter | mistral-small-3.2-24b-instruct | 🚀Throughput | ok | $0.153 | 351ms | — | 0.10 | 0.30 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🚀Throughput | ok | $0.153 | 11697ms | — | 0.05 | 0.20 | |
| openrouter | llama-4-scout | 🚀Throughput | ok | $0.154 | 408ms | — | 0.10 | 0.30 | |
| openrouter | step-3.5-flash | 🚀Throughput | ok | $0.154 | 1446ms | — | 0.10 | 0.30 | |
| openrouter | hermes-3-llama-3.1-70b | 🔍Context Recall | pass | $0.155 | 340ms | — | 0.70 | 0.70 | |
| openrouter | trinity-large-thinking | ⚡Ping | ok | $0.156 | 1180ms | — | 0.25 | 0.80 | |
| openrouter | wizardlm-2-8x22b | 🔍Context Recall | pass | $0.157 | 1052ms | — | 0.62 | 0.62 | |
| openrouter | gpt-oss-safeguard-20b | 🚀Throughput | ok | $0.158 | 293ms | — | 0.07 | 0.30 | |
| deepinfra | Kimi-K2.6 | ⚡Ping | ok | $0.158 | 1485ms | — | 0.75 | 3.50 | |
| openrouter | qwen3-max-thinking | { }JSON Output | pass | $0.160 | 891ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | { }JSON Output | pass | $0.160 | 1187ms | — | 0.78 | 3.90 | |
| deepinfra | GLM-4.7-Flash | 🔍Context Recall | pass | $0.160 | 40357ms | — | 0.06 | 0.40 | |
| groq | llama-3.3-70b-versatile | 🔧Tool Use | pass | $0.161 | 311ms | — | 0.59 | 0.79 | |
| openrouter | mistral-large-2512 | 🔍Context Recall | pass | $0.161 | 731ms | — | 0.50 | 1.50 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | ⚡Ping | ok | $0.161 | 268ms | — | 0.13 | 1.56 | |
| openrouter | mercury-2 | 🔍Context Recall | pass | $0.161 | 545ms | — | 0.25 | 0.75 | |
| openai | gpt-3.5-turbo | 💻Code Gen | ok | $0.163 | 1215ms | — | 0.50 | 1.50 | |
| openrouter | skyfall-36b-v2 | { }JSON Output | pass | $0.163 | 594ms | — | 0.55 | 0.80 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔍Context Recall | pass | $0.166 | 545ms | — | 0.60 | 2.40 | |
| fireworks | kimi-k2p6 | ⚡Ping | ok | $0.166 | 1237ms | — | 0.95 | 4.00 | |
| openrouter | qwen3-8b | 🔍Context Recall | pass | $0.166 | 527ms | — | 0.12 | 0.46 | |
| groq | llama-3.3-70b-versatile | 🔍Context Recall | pass | $0.166 | 376ms | — | 0.59 | 0.79 | |
| fireworks | gpt-oss-120b | 💻Code Gen | ok | $0.168 | 1631ms | — | 0.15 | 0.60 | |
| openrouter | relace-search | { }JSON Output | pass | $0.168 | 2273ms | — | 1.00 | 3.00 | |
| openai | gpt-4-turbo-2024-04-09 | ⚡Ping | ok | $0.170 | 1205ms | — | 10.00 | 30.00 | |
| anthropic | claude-opus-4-6 | ⚡Ping | ok | $0.170 | 1975ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | ⚡Ping | ok | $0.170 | 2137ms | — | 5.00 | 25.00 | |
| openrouter | palmyra-x5 | ⚡Ping | ok | $0.170 | 588ms | — | 0.60 | 6.00 | |
| openrouter | step-3.7-flash | 🔍Context Recall | pass | $0.172 | 369ms | — | 0.20 | 1.15 | |
| openrouter | gemma-4-26b-a4b-it | 🚀Throughput | ok | $0.173 | 752ms | — | 0.07 | 0.34 | |
| openrouter | ring-2.6-1t | 🧮Reasoning | ok | $0.174 | 1281ms | — | 0.07 | 0.63 | |
| deepinfra | GLM-4.7-Flash | { }JSON Output | pass | $0.175 | 34049ms | — | 0.06 | 0.40 | |
| openrouter | gemma-2-27b-it | 🔍Context Recall | pass | $0.175 | 778ms | — | 0.65 | 0.65 | |
| openrouter | laguna-m.1 | 🔍Context Recall | pass | $0.175 | 887ms | — | 0.20 | 0.40 | |
| deepinfra | Qwen3.6-35B-A3B | ⚡Ping | ok | $0.175 | 4498ms | — | 0.15 | 0.95 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🧮Reasoning | ok | $0.176 | 1724ms | — | 0.60 | 2.40 | |
| openrouter | step-3.5-flash | 🔍Context Recall | pass | $0.176 | 1507ms | — | 0.10 | 0.30 | |
| openrouter | qwen3-coder-plus | 🧮Reasoning | ok | $0.177 | 588ms | — | 0.65 | 3.25 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🔍Context Recall | pass | $0.177 | 352ms | — | 0.66 | 1.00 | |
| openrouter | ernie-4.5-vl-424b-a47b | 💻Code Gen | ok | $0.178 | 1486ms | — | 0.42 | 1.25 | |
| deepinfra | MiMo-V2.5 | 🔍Context Recall | pass | $0.180 | 1907ms | — | 0.40 | 2.00 | |
| deepinfra | Qwen3-30B-A3B | 🧮Reasoning | ok | $0.182 | 4329ms | — | 0.12 | 0.50 | |
| deepinfra | MiniMax-M3 | { }JSON Output | pass | $0.182 | 1676ms | — | 0.30 | 1.20 | |
| deepinfra | MiniMax-M2.7-Turbo | 🔧Tool Use | pass | $0.185 | 1660ms | — | 0.38 | 1.70 | |
| openrouter | mistral-large-2512 | 💻Code Gen | ok | $0.186 | 651ms | — | 0.50 | 1.50 | |
| deepinfra | Qwen3-14B | 🚀Throughput | ok | $0.186 | 11921ms | — | 0.12 | 0.24 | |
| openrouter | kat-coder-pro-v2.5 | ⚡Ping | ok | $0.187 | 527ms | — | 0.74 | 2.96 | |
| openrouter | minimax-m2.7 | 🧮Reasoning | ok | $0.187 | 1430ms | — | 0.25 | 1.00 | |
| anthropic | claude-opus-4-8 | ⚡Ping | ok | $0.190 | 1256ms | — | 5.00 | 25.00 | |
| openai | gpt-4.1-mini-2025-04-14 | 💻Code Gen | ok | $0.190 | 1717ms | — | 0.40 | 1.60 | |
| openrouter | nova-2-lite-v1 | 🔍Context Recall | pass | $0.191 | 664ms | — | 0.30 | 2.50 | |
| groq | llama-3.3-70b-versatile | 💻Code Gen | ok | $0.192 | 714ms | — | 0.59 | 0.79 | |
| deepinfra | MiniMax-M3 | 🔧Tool Use | pass | $0.193 | 1282ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2-her | 🔍Context Recall | pass | $0.193 | 1676ms | — | 0.30 | 1.20 | |
| openrouter | glm-5 | ⚡Ping | ok | $0.194 | 718ms | — | 0.95 | 3.15 | |
| openrouter | qwen3-coder | 💻Code Gen | ok | $0.194 | 688ms | — | 0.30 | 1.00 | |
| openrouter | deepseek-v3.1-terminus | 💻Code Gen | ok | $0.196 | 1475ms | — | 0.27 | 1.00 | |
| deepinfra | GLM-4.7 | ⚡Ping | ok | $0.197 | 5487ms | — | 0.40 | 1.75 | |
| openrouter | aion-3.0 | ⚡Ping | ok | $0.198 | 913ms | — | 3.00 | 6.00 | |
| openrouter | l3.1-euryale-70b | 🔍Context Recall | pass | $0.201 | 608ms | — | 0.85 | 0.85 | |
| openrouter | hermes-3-llama-3.1-70b | ⚡Ping | ok | $0.201 | 434ms | — | 0.70 | 0.70 | |
| openrouter | qwen2.5-vl-72b-instruct | 🔍Context Recall | pass | $0.201 | 617ms | — | 0.80 | 1.00 | |
| openrouter | relace-search | 🧮Reasoning | ok | $0.204 | 2521ms | — | 1.00 | 3.00 | |
| openrouter | qwen3.6-35b-a3b | ⚡Ping | ok | $0.205 | 532ms | — | 0.14 | 1.00 | |
| openrouter | qwen3.6-flash | ⚡Ping | ok | $0.206 | 481ms | — | 0.19 | 1.13 | |
| openrouter | qwen3-max | 🔍Context Recall | pass | $0.206 | 1352ms | — | 0.78 | 3.90 | |
| openrouter | seed-2.0-lite | ⚡Ping | ok | $0.208 | 588ms | — | 0.25 | 2.00 | |
| openrouter | laguna-m.1 | 🚀Throughput | ok | $0.209 | 617ms | — | 0.20 | 0.40 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 💻Code Gen | ok | $0.210 | 761ms | — | 0.21 | 1.90 | |
| openrouter | kat-coder-pro-v2 | 💻Code Gen | ok | $0.210 | 507ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-v3.2 | 🚀Throughput | ok | $0.211 | 1005ms | — | 0.27 | 0.40 | |
| openrouter | qwen3-vl-32b-instruct | 🚀Throughput | ok | $0.212 | 339ms | — | 0.10 | 0.42 | |
| openrouter | qwen3-max-thinking | 🧮Reasoning | ok | $0.213 | 1048ms | — | 0.78 | 3.90 | |
| deepinfra | Qwen3.5-9B | 💻Code Gen | ok | $0.213 | 57566ms | — | 0.10 | 0.15 | |
| openrouter | kimi-k2 | 🔍Context Recall | pass | $0.213 | 1014ms | — | 0.57 | 2.30 | |
| openrouter | unslopnemo-12b | 🚀Throughput | ok | $0.214 | 777ms | — | 0.40 | 0.40 | |
| openrouter | cogito-v2.1-671b | 💻Code Gen | ok | $0.215 | 786ms | — | 1.25 | 1.25 | |
| openrouter | llama-3.1-70b-instruct | 🚀Throughput | ok | $0.216 | 419ms | — | 0.40 | 0.40 | |
| openrouter | qwen3-235b-a22b | ⚡Ping | ok | $0.216 | 426ms | — | 0.46 | 1.82 | |
| together | MiniMax-M3 | 🔧Tool Use | pass | $0.218 | 1501ms | — | 0.30 | 1.20 | |
| openrouter | hermes-3-llama-3.1-405b | 🔍Context Recall | pass | $0.222 | 364ms | — | 1.00 | 1.00 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | ⚡Ping | ok | $0.223 | 2796ms | — | 0.60 | 2.40 | |
| openrouter | minimax-m2.7 | 🔍Context Recall | pass | $0.223 | 1805ms | — | 0.25 | 1.00 | |
| openrouter | glm-4.6v | { }JSON Output | pass | $0.225 | 663ms | — | 0.30 | 0.90 | |
| openrouter | ring-2.6-1t | 💻Code Gen | ok | $0.225 | 1476ms | — | 0.07 | 0.63 | |
| nvidia | nemotron-3-ultra-550b-a55b | ⚡Ping | ok | $0.233 | 15814ms | — | 0.60 | 3.60 | |
| openrouter | skyfall-36b-v2 | 💻Code Gen | ok | $0.236 | 510ms | — | 0.55 | 0.80 | |
| openrouter | skyfall-36b-v2 | 🔍Context Recall | pass | $0.238 | 495ms | — | 0.55 | 0.80 | |
| deepinfra | Qwen3-Max-Thinking | { }JSON Output | pass | $0.246 | 2987ms | — | 1.20 | 6.00 | |
| openrouter | deepseek-chat-v3.1 | 💻Code Gen | ok | $0.246 | 1443ms | — | 0.25 | 0.95 | |
| openrouter | kimi-k2 | 💻Code Gen | ok | $0.247 | 1190ms | — | 0.57 | 2.30 | |
| deepinfra | Qwen3.6-35B-A3B | 🔧Tool Use | pass | $0.248 | 4716ms | — | 0.15 | 0.95 | |
| openrouter | qwen3-coder-plus | 🔍Context Recall | pass | $0.256 | 1128ms | — | 0.65 | 3.25 | |
| nvidia | nemotron-3-ultra-550b-a55b | 🧮Reasoning | ok | $0.259 | 1231ms | — | 0.60 | 3.60 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔧Tool Use | pass | $0.259 | 559ms | — | 0.60 | 2.40 | |
| deepinfra | gemma-4-26B-A4B-it | 🚀Throughput | ok | $0.260 | 18391ms | — | 0.07 | 0.34 | |
| deepinfra | MiniMax-M2.7 | { }JSON Output | pass | $0.261 | 4815ms | — | 0.25 | 1.00 | |
| openrouter | rocinante-12b | 🚀Throughput | ok | $0.263 | 648ms | — | 0.25 | 0.50 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🚀Throughput | ok | $0.265 | 417ms | — | 0.13 | 0.52 | |
| anthropic | claude-opus-4-7 | ⚡Ping | ok | $0.265 | 2981ms | — | 5.00 | 25.00 | |
| deepinfra | MiMo-V2.5 | 🧮Reasoning | ok | $0.266 | 2443ms | — | 0.40 | 2.00 | |
| openrouter | glm-4.6v | 🧮Reasoning | ok | $0.266 | 1642ms | — | 0.30 | 0.90 | |
| together | MiniMax-M3 | 🔍Context Recall | pass | $0.267 | 2643ms | — | 0.30 | 1.20 | |
| gemini | gemini-2.5-pro | 🔧Tool Use | pass | $0.269 | 2920ms | — | 1.25 | 10.00 | |
| openrouter | minimax-m2.7 | { }JSON Output | pass | $0.269 | 1481ms | — | 0.25 | 1.00 | |
| openai | gpt-4.1 | 🔧Tool Use | pass | $0.270 | 712ms | — | 2.00 | 8.00 | |
| sambanova | MiniMax-M2.7 | ⚡Ping | ok | $0.274 | 2175ms | — | 0.60 | 2.40 | |
| deepinfra | MiMo-V2.5 | 🔧Tool Use | pass | $0.278 | 2182ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-235b-a22b-2507 | 🚀Throughput | ok | $0.278 | 752ms | — | 0.09 | 0.55 | |
| openrouter | cogito-v2.1-671b | 🔍Context Recall | pass | $0.287 | 371ms | — | 1.25 | 1.25 | |
| openrouter | hunyuan-a13b-instruct | 🚀Throughput | ok | $0.289 | 1341ms | — | 0.14 | 0.57 | |
| openai | gpt-4.1 | { }JSON Output | pass | $0.290 | 743ms | — | 2.00 | 8.00 | |
| openrouter | seed-2.0-lite | { }JSON Output | pass | $0.291 | 407ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-max-thinking | 🔍Context Recall | pass | $0.292 | 1134ms | — | 0.78 | 3.90 | |
| openai | gpt-4.1 | 🧮Reasoning | ok | $0.292 | 911ms | — | 2.00 | 8.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🧮Reasoning | ok | $0.295 | 595ms | — | 0.15 | 1.50 | |
| openrouter | qwen3.5-plus-20260420 | ⚡Ping | ok | $0.297 | 648ms | — | 0.30 | 1.80 | |
| sambanova | MiniMax-M2.7 | 🔧Tool Use | pass | $0.297 | 911ms | — | 0.60 | 2.40 | |
| openrouter | mercury-2 | 💻Code Gen | ok | $0.301 | 383ms | — | 0.25 | 0.75 | |
| openrouter | aion-2.0 | { }JSON Output | pass | $0.302 | 724ms | — | 0.80 | 1.60 | |
| together | MiniMax-M2.7 | { }JSON Output | pass | $0.303 | 2791ms | — | 0.25 | 1.00 | |
| deepinfra | GLM-4.7-Flash | 🚀Throughput | ok | $0.304 | 16636ms | — | 0.06 | 0.40 | |
| openrouter | command-r-08-2024 | 🚀Throughput | ok | $0.304 | 751ms | — | 0.15 | 0.60 | |
| openrouter | step-3.5-flash | 💻Code Gen | ok | $0.305 | 1349ms | — | 0.10 | 0.30 | |
| openai | gpt-4.1-nano | 🚀Throughput | ok | $0.306 | 3748ms | — | 0.10 | 0.40 | |
| openrouter | mistral-small-2603 | 🚀Throughput | ok | $0.307 | 564ms | — | 0.15 | 0.60 | |
| openrouter | mistral-saba | 🚀Throughput | ok | $0.309 | 466ms | — | 0.20 | 0.60 | |
| openrouter | relace-search | 🔍Context Recall | pass | $0.309 | 1512ms | — | 1.00 | 3.00 | |
| deepinfra | GLM-5.2 | 🔧Tool Use | pass | $0.310 | 1491ms | — | 0.93 | 3.00 | |
| openrouter | laguna-m.1 | 🧮Reasoning | ok | $0.310 | 674ms | — | 0.20 | 0.40 | |
| deepinfra | GLM-4.7 | 🔧Tool Use | pass | $0.310 | 3615ms | — | 0.40 | 1.75 | |
| openrouter | qwen3.7-plus | ⚡Ping | ok | $0.311 | 910ms | — | 0.32 | 1.28 | |
| deepinfra | MiMo-V2.5-Pro | ⚡Ping | ok | $0.312 | 12602ms | — | 1.00 | 3.00 | |
| fireworks | glm-5p2 | 🔧Tool Use | pass | $0.313 | 1624ms | — | 0.95 | 3.00 | |
| deepinfra | MiniMax-M3 | 🔍Context Recall | pass | $0.314 | 2378ms | — | 0.30 | 1.20 | |
| openrouter | qwen3.5-35b-a3b | 💻Code Gen | ok | $0.314 | 602ms | — | 0.14 | 1.00 | |
| openrouter | step-3.7-flash | { }JSON Output | pass | $0.314 | 967ms | — | 0.20 | 1.15 | |
| deepinfra | MythoMax-L2-13b | 🚀Throughput | ok | $0.314 | 14182ms | — | 0.40 | 0.40 | |
| openrouter | ling-2.6-1t | 🚀Throughput | ok | $0.316 | 1216ms | — | 0.07 | 0.63 | |
| openrouter | ring-2.6-1t | 🚀Throughput | ok | $0.316 | 1036ms | — | 0.07 | 0.63 | |
| together | Kimi-K2.6 | ⚡Ping | ok | $0.323 | 1203ms | — | 0.75 | 3.50 | |
| together | Kimi-K2.6 | 🔧Tool Use | pass | $0.324 | 867ms | — | 0.75 | 3.50 | |
| deepinfra | Qwen3-Max-Thinking | 🧮Reasoning | ok | $0.328 | 5012ms | — | 1.20 | 6.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🧮Reasoning | ok | $0.329 | 621ms | — | 0.13 | 1.56 | |
| openrouter | minimax-m1 | ⚡Ping | ok | $0.337 | 1035ms | — | 0.55 | 2.20 | |
| openai | gpt-4o-2024-05-13 | 🔧Tool Use | pass | $0.338 | 705ms | — | 2.50 | 10.00 | |
| openai | gpt-4o | 🔧Tool Use | pass | $0.338 | 1433ms | — | 2.50 | 10.00 | |
| openrouter | qwen3-max | 🧮Reasoning | ok | $0.338 | 1599ms | — | 0.78 | 3.90 | |
| openrouter | mistral-large | 🧮Reasoning | ok | $0.338 | 626ms | — | 2.00 | 6.00 | |
| openrouter | nova-2-lite-v1 | 💻Code Gen | ok | $0.338 | 676ms | — | 0.30 | 2.50 | |
| openrouter | mistral-medium-3-5 | { }JSON Output | pass | $0.344 | 504ms | — | 1.50 | 7.50 | |
| openrouter | trinity-large-thinking | 💻Code Gen | ok | $0.346 | 1654ms | — | 0.25 | 0.80 | |
| deepinfra | DeepSeek-R1-0528 | ⚡Ping | ok | $0.349 | 9987ms | — | 0.50 | 2.15 | |
| together | MiniMax-M3 | 💻Code Gen | ok | $0.349 | 6009ms | — | 0.30 | 1.20 | |
| openrouter | wizardlm-2-8x22b | 🚀Throughput | ok | $0.350 | 1156ms | — | 0.62 | 0.62 | |
| openrouter | gemma-2-27b-it | 🚀Throughput | ok | $0.350 | 1303ms | — | 0.65 | 0.65 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | { }JSON Output | pass | $0.351 | 645ms | — | 0.15 | 1.50 | |
| openrouter | glm-5.1 | ⚡Ping | ok | $0.352 | 427ms | — | 0.97 | 3.04 | |
| openrouter | qwen3-coder-plus | 💻Code Gen | ok | $0.355 | 693ms | — | 0.65 | 3.25 | |
| deepinfra | GLM-5.2 | ⚡Ping | ok | $0.357 | 3079ms | — | 0.93 | 3.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | ⚡Ping | ok | $0.358 | 382ms | — | 0.15 | 1.50 | |
| deepinfra | GLM-4.7-Flash | 💻Code Gen | ok | $0.358 | 19281ms | — | 0.06 | 0.40 | |
| openrouter | mistral-large | { }JSON Output | pass | $0.360 | 585ms | — | 2.00 | 6.00 | |
| deepinfra | GLM-4.6 | 🔧Tool Use | pass | $0.361 | 7761ms | — | 0.50 | 2.00 | |
| deepinfra | Seed-1.8 | 🔍Context Recall | pass | $0.364 | 7125ms | — | 0.25 | 2.00 | |
| deepinfra | GLM-4.7-Flash | 🧮Reasoning | ok | $0.364 | 27318ms | — | 0.06 | 0.40 | |
| openrouter | kat-coder-pro-v2.5 | 🧮Reasoning | ok | $0.366 | 515ms | — | 0.74 | 2.96 | |
| openrouter | qwen3-8b | 🧮Reasoning | ok | $0.368 | 571ms | — | 0.12 | 0.46 | |
| deepinfra | Seed-1.8 | 🧮Reasoning | ok | $0.370 | 5966ms | — | 0.25 | 2.00 | |
| openai | gpt-4o | { }JSON Output | pass | $0.372 | 914ms | — | 2.50 | 10.00 | |
| openrouter | hermes-3-llama-3.1-70b | 🚀Throughput | ok | $0.377 | 834ms | — | 0.70 | 0.70 | |
| openrouter | seed-1.6-flash | 💻Code Gen | ok | $0.379 | 1300ms | — | 0.07 | 0.30 | |
| deepinfra | MiMo-V2.5 | 💻Code Gen | ok | $0.379 | 2881ms | — | 0.40 | 2.00 | |
| openrouter | sonar-reasoning-pro | 🧮Reasoning | ok | $0.382 | 5043ms | — | 2.00 | 8.00 | |
| openrouter | deepseek-r1 | ⚡Ping | ok | $0.382 | 755ms | — | 0.70 | 2.50 | |
| deepinfra | Qwen3-30B-A3B | 🚀Throughput | ok | $0.383 | 6644ms | — | 0.12 | 0.50 | |
| openrouter | glm-4.6 | { }JSON Output | pass | $0.384 | 1399ms | — | 0.50 | 2.00 | |
| openrouter | qwen3.5-9b | 💻Code Gen | ok | $0.396 | 469ms | — | 0.10 | 0.15 | |
| openrouter | seed-2.0-lite | 🔍Context Recall | pass | $0.398 | 911ms | — | 0.25 | 2.00 | |
| openrouter | qwen-plus | 🚀Throughput | ok | $0.400 | 358ms | — | 0.26 | 0.78 | |
| together | MiniMax-M2.7 | 🔍Context Recall | pass | $0.400 | 3525ms | — | 0.25 | 1.00 | |
| deepinfra | MiniMax-M2.7 | 💻Code Gen | ok | $0.403 | 7875ms | — | 0.25 | 1.00 | |
| openrouter | deepseek-chat | 🚀Throughput | ok | $0.407 | 472ms | — | 0.20 | 0.80 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 💻Code Gen | ok | $0.409 | 853ms | — | 0.60 | 2.40 | |
| openrouter | trinity-large-thinking | 🚀Throughput | ok | $0.410 | 1201ms | — | 0.25 | 0.80 | |
| deepinfra | MiniMax-M2.7 | 🔍Context Recall | pass | $0.410 | 8772ms | — | 0.25 | 1.00 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | { }JSON Output | pass | $0.412 | 4386ms | — | 0.23 | 2.30 | |
| deepinfra | Qwen3.5-397B-A17B | 🔧Tool Use | pass | $0.422 | 3833ms | — | 0.45 | 3.00 | |
| openrouter | qwen3-max | 💻Code Gen | ok | $0.426 | 1278ms | — | 0.78 | 3.90 | |
| deepinfra | MiniMax-M3 | 💻Code Gen | ok | $0.431 | 3746ms | — | 0.30 | 1.20 | |
| openrouter | mistral-medium-3-5 | 🔍Context Recall | pass | $0.432 | 497ms | — | 1.50 | 7.50 | |
| openrouter | palmyra-x5 | { }JSON Output | pass | $0.437 | 599ms | — | 0.60 | 6.00 | |
| deepinfra | GLM-4.7 | { }JSON Output | pass | $0.439 | 7292ms | — | 0.40 | 1.75 | |
| gemini | gemini-2.5-pro | 🧮Reasoning | ok | $0.441 | 9979ms | — | 1.25 | 10.00 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔧Tool Use | pass | $0.443 | 2007ms | — | 0.60 | 2.40 | |
| openrouter | qwen3.6-flash | { }JSON Output | pass | $0.444 | 465ms | — | 0.19 | 1.13 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 🧮Reasoning | ok | $0.444 | 266ms | — | 0.13 | 1.56 | |
| openrouter | mercury-2 | 🚀Throughput | ok | $0.448 | 395ms | — | 0.25 | 0.75 | |
| deepinfra | Qwen3-Max-Thinking | 🔍Context Recall | pass | $0.449 | 2923ms | — | 1.20 | 6.00 | |
| deepinfra | Seed-1.8 | { }JSON Output | pass | $0.449 | 6512ms | — | 0.25 | 2.00 | |
| openrouter | glm-4.5v | 🧮Reasoning | ok | $0.458 | 1058ms | — | 0.60 | 1.80 | |
| openrouter | l3.1-euryale-70b | 🚀Throughput | ok | $0.459 | 819ms | — | 0.85 | 0.85 | |
| openai | gpt-4o-mini | 🚀Throughput | ok | $0.459 | 8982ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | 🚀Throughput | ok | $0.459 | 12311ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🚀Throughput | ok | $0.459 | 19327ms | — | 0.15 | 0.60 | |
| openrouter | codestral-2508 | 🚀Throughput | ok | $0.460 | 781ms | — | 0.30 | 0.90 | |
| openrouter | glm-4.6v | 🚀Throughput | ok | $0.461 | 771ms | — | 0.30 | 0.90 | |
| openrouter | deepseek-r1 | { }JSON Output | pass | $0.462 | 748ms | — | 0.70 | 2.50 | |
| openrouter | glm-4.5v | { }JSON Output | pass | $0.466 | 1743ms | — | 0.60 | 1.80 | |
| fireworks | gpt-oss-120b | 🚀Throughput | ok | $0.469 | 4864ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-235b-a22b | { }JSON Output | pass | $0.470 | 470ms | — | 0.46 | 1.82 | |
| deepinfra | Kimi-K2.6 | 🔧Tool Use | pass | $0.472 | 2921ms | — | 0.75 | 3.50 | |
| openrouter | glm-4.6v | 💻Code Gen | ok | $0.472 | 1847ms | — | 0.30 | 0.90 | |
| openrouter | qwen3.6-flash | 🔍Context Recall | pass | $0.475 | 456ms | — | 0.19 | 1.13 | |
| openrouter | palmyra-x5 | 🔍Context Recall | pass | $0.476 | 632ms | — | 0.60 | 6.00 | |
| openrouter | gpt-oss-20b | 🚀Throughput | ok | $0.477 | 1306ms | — | 0.03 | 0.14 | |
| openrouter | kimi-k2.6 | { }JSON Output | pass | $0.477 | 1003ms | — | 0.68 | 3.42 | |
| openrouter | deepseek-chat-v3.1 | 🚀Throughput | ok | $0.483 | 2609ms | — | 0.25 | 0.95 | |
| openrouter | qwen3-vl-30b-a3b-thinking | ⚡Ping | ok | $0.484 | 393ms | — | 0.13 | 1.56 | |
| fireworks | kimi-k2p6 | 🔧Tool Use | pass | $0.485 | 1608ms | — | 0.95 | 4.00 | |
| openrouter | mistral-medium-3-5 | 🧮Reasoning | ok | $0.487 | 464ms | — | 1.50 | 7.50 | |
| openrouter | minimax-m2.7 | 💻Code Gen | ok | $0.491 | 2064ms | — | 0.25 | 1.00 | |
| openai | gpt-4o-2024-05-13 | { }JSON Output | pass | $0.492 | 725ms | — | 2.50 | 10.00 | |
| openrouter | command-r-plus-08-2024 | { }JSON Output | pass | $0.497 | 801ms | — | 2.50 | 10.00 | |
| deepinfra | MiniMax-M2.7-Turbo | 🧮Reasoning | ok | $0.499 | 2470ms | — | 0.38 | 1.70 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | { }JSON Output | pass | $0.500 | 2593ms | — | 0.60 | 2.40 | |
| deepinfra | MiMo-V2.5-Pro | 🧮Reasoning | ok | $0.501 | 12463ms | — | 1.00 | 3.00 | |
| deepinfra | GLM-4.6 | { }JSON Output | pass | $0.501 | 14187ms | — | 0.50 | 2.00 | |
| cerebras | zai-glm-4.7 | ⚡Ping | ok | $0.503 | 991ms | — | 2.25 | 2.75 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔍Context Recall | pass | $0.504 | 4743ms | — | 0.60 | 2.40 | |
| openrouter | qwen3.6-35b-a3b | 🚀Throughput | ok | $0.506 | 750ms | — | 0.14 | 1.00 | |
| openrouter | qwen3.5-35b-a3b | 🚀Throughput | ok | $0.506 | 471ms | — | 0.14 | 1.00 | |
| openrouter | deepseek-v3.1-terminus | 🚀Throughput | ok | $0.509 | 1691ms | — | 0.27 | 1.00 | |
| openrouter | sonar-pro-search | { }JSON Output | pass | $0.510 | 932ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-8b | 💻Code Gen | ok | $0.511 | 596ms | — | 0.12 | 0.46 | |
| openrouter | qwen3-coder | 🚀Throughput | ok | $0.511 | 412ms | — | 0.30 | 1.00 | |
| openrouter | skyfall-36b-v2 | 🚀Throughput | ok | $0.514 | 539ms | — | 0.55 | 0.80 | |
| openrouter | minimax-m2.7 | 🚀Throughput | ok | $0.518 | 1009ms | — | 0.25 | 1.00 | |
| deepinfra | MiniMax-M2.7-Turbo | { }JSON Output | pass | $0.522 | 2202ms | — | 0.38 | 1.70 | |
| openrouter | aion-2.0 | 🔍Context Recall | pass | $0.530 | 1027ms | — | 0.80 | 1.60 | |
| openrouter | command-r-plus-08-2024 | 🧮Reasoning | ok | $0.532 | 805ms | — | 2.50 | 10.00 | |
| openrouter | laguna-m.1 | 💻Code Gen | ok | $0.534 | 498ms | — | 0.20 | 0.40 | |
| gemini | gemini-2.5-pro | { }JSON Output | pass | $0.535 | 5189ms | — | 1.25 | 10.00 | |
| openrouter | glm-4.6 | ⚡Ping | ok | $0.538 | 642ms | — | 0.50 | 2.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🔍Context Recall | pass | $0.539 | 3938ms | — | 0.15 | 1.50 | |
| openrouter | qwen2.5-vl-72b-instruct | 🚀Throughput | ok | $0.539 | 445ms | — | 0.80 | 1.00 | |
| openrouter | hermes-3-llama-3.1-405b | 🚀Throughput | ok | $0.540 | 369ms | — | 1.00 | 1.00 | |
| together | MiniMax-M2.7 | 🧮Reasoning | ok | $0.540 | 5444ms | — | 0.25 | 1.00 | |
| deepinfra | GLM-4.6 | ⚡Ping | ok | $0.550 | 6968ms | — | 0.50 | 2.00 | |
| deepinfra | Qwen3-Max-Thinking | 🔧Tool Use | pass | $0.552 | 2943ms | — | 1.20 | 6.00 | |
| openrouter | grok-4.3 | ⚡Ping | ok | $0.555 | 492ms | — | 1.25 | 2.50 | |
| openrouter | relace-search | 💻Code Gen | ok | $0.560 | 1550ms | — | 1.00 | 3.00 | |
| openrouter | kat-coder-pro-v2.5 | 🔍Context Recall | pass | $0.570 | 778ms | — | 0.74 | 2.96 | |
| together | MiniMax-M2.7 | 💻Code Gen | ok | $0.573 | 5535ms | — | 0.25 | 1.00 | |
| openrouter | aion-2.0 | 🧮Reasoning | ok | $0.576 | 672ms | — | 0.80 | 1.60 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | 🔧Tool Use | pass | $0.578 | 5564ms | — | 0.23 | 2.30 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | 🔍Context Recall | pass | $0.583 | 5991ms | — | 0.23 | 2.30 | |
| openrouter | step-3.7-flash | 🚀Throughput | ok | $0.583 | 1313ms | — | 0.20 | 1.15 | |
| openrouter | qwen3-235b-a22b | 🔍Context Recall | pass | $0.584 | 1049ms | — | 0.46 | 1.82 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | { }JSON Output | pass | $0.587 | 343ms | — | 0.13 | 1.56 | |
| openrouter | glm-5v-turbo | { }JSON Output | pass | $0.590 | 1871ms | — | 1.20 | 4.00 | |
| openai | gpt-4.1 | 🔍Context Recall | pass | $0.604 | 1060ms | — | 2.00 | 8.00 | |
| openai | gpt-4o | 🧮Reasoning | ok | $0.605 | 1220ms | — | 2.50 | 10.00 | |
| openrouter | ernie-4.5-vl-424b-a47b | 🚀Throughput | ok | $0.605 | 1651ms | — | 0.42 | 1.25 | |
| openrouter | palmyra-x5 | 🧮Reasoning | ok | $0.607 | 616ms | — | 0.60 | 6.00 | |
| openrouter | nova-premier-v1 | 🧮Reasoning | ok | $0.610 | 1506ms | — | 2.50 | 12.50 | |
| openrouter | kat-coder-pro-v2 | 🚀Throughput | ok | $0.611 | 1131ms | — | 0.30 | 1.20 | |
| openrouter | nova-premier-v1 | { }JSON Output | pass | $0.620 | 1424ms | — | 2.50 | 12.50 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 🔍Context Recall | pass | $0.621 | 319ms | — | 0.13 | 1.56 | |
| groq | llama-3.3-70b-versatile | 🚀Throughput | ok | $0.636 | 2669ms | — | 0.59 | 0.79 | |
| openrouter | kimi-k2-thinking | { }JSON Output | pass | $0.642 | 2482ms | — | 0.60 | 2.50 | |
| deepinfra | GLM-4.7 | 🔍Context Recall | pass | $0.648 | 9216ms | — | 0.40 | 1.75 | |
| openrouter | qwen3-8b | 🚀Throughput | ok | $0.661 | 725ms | — | 0.12 | 0.46 | |
| openrouter | mistral-large | 🔍Context Recall | pass | $0.662 | 599ms | — | 2.00 | 6.00 | |
| sambanova | MiniMax-M2.7 | { }JSON Output | pass | $0.668 | 1356ms | — | 0.60 | 2.40 | |
| openrouter | step-3.5-flash | 🧮Reasoning | ok | $0.673 | 1812ms | — | 0.10 | 0.30 | |
| sambanova | MiniMax-M2.7 | 🔍Context Recall | pass | $0.674 | 1395ms | — | 0.60 | 2.40 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🔍Context Recall | pass | $0.679 | 338ms | — | 0.13 | 1.56 | |
| deepinfra | MiMo-V2.5-Pro | 🔧Tool Use | pass | $0.684 | 1472ms | — | 1.00 | 3.00 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | 🧮Reasoning | ok | $0.686 | 6849ms | — | 0.23 | 2.30 | |
| deepinfra | MiniMax-M2.7-Turbo | 🔍Context Recall | pass | $0.687 | 2386ms | — | 0.38 | 1.70 | |
| openrouter | step-3.7-flash | 🧮Reasoning | ok | $0.695 | 805ms | — | 0.20 | 1.15 | |
| openrouter | cogito-v2.1-671b | 🚀Throughput | ok | $0.698 | 436ms | — | 1.25 | 1.25 | |
| gemini | gemini-2.5-pro | 🔍Context Recall | pass | $0.701 | 5027ms | — | 1.25 | 10.00 | |
| openrouter | kat-coder-pro-v2.5 | { }JSON Output | pass | $0.703 | 615ms | — | 0.74 | 2.96 | |
| nvidia | nemotron-3-ultra-550b-a55b | 🔍Context Recall | pass | $0.707 | 1764ms | — | 0.60 | 3.60 | |
| nvidia | nemotron-3-ultra-550b-a55b | 💻Code Gen | ok | $0.710 | 1861ms | — | 0.60 | 3.60 | |
| openrouter | qwen3-235b-a22b | 🧮Reasoning | ok | $0.710 | 419ms | — | 0.46 | 1.82 | |
| openrouter | qwen3.5-35b-a3b | { }JSON Output | pass | $0.717 | 769ms | — | 0.14 | 1.00 | |
| deepinfra | Qwen3.5-397B-A17B | ⚡Ping | ok | $0.722 | 7718ms | — | 0.45 | 3.00 | |
| deepinfra | Qwen3.6-35B-A3B | 🚀Throughput | ok | $0.724 | 15715ms | — | 0.15 | 0.95 | |
| deepinfra | DeepSeek-V3.1-Terminus | 🚀Throughput | ok | $0.727 | 7554ms | — | 0.27 | 0.95 | |
| cerebras | gpt-oss-120b | 🚀Throughput | ok | $0.732 | 1198ms | — | 0.14 | 0.95 | |
| openrouter | aion-2.0 | 💻Code Gen | ok | $0.740 | 1229ms | — | 0.80 | 1.60 | |
| deepinfra | Seed-1.8 | 🔧Tool Use | pass | $0.740 | 8014ms | — | 0.25 | 2.00 | |
| openrouter | qwen3.6-35b-a3b | 🔍Context Recall | pass | $0.741 | 1123ms | — | 0.14 | 1.00 | |
| deepinfra | GLM-5.2 | { }JSON Output | pass | $0.745 | 5312ms | — | 0.93 | 3.00 | |
| fireworks | glm-5p2 | ⚡Ping | ok | $0.747 | 4364ms | — | 0.95 | 3.00 | |
| openrouter | mistral-large | 💻Code Gen | ok | $0.750 | 630ms | — | 2.00 | 6.00 | |
| openai | gpt-4o-2024-05-13 | 🔍Context Recall | pass | $0.755 | 662ms | — | 2.50 | 10.00 | |
| openrouter | mistral-large-2512 | 🚀Throughput | ok | $0.767 | 857ms | — | 0.50 | 1.50 | |
| openrouter | seed-1.6-flash | 🚀Throughput | ok | $0.768 | 374ms | — | 0.07 | 0.30 | |
| deepinfra | Qwen3.6-35B-A3B | { }JSON Output | pass | $0.769 | 17880ms | — | 0.15 | 0.95 | |
| openrouter | qwen3-max-thinking | 💻Code Gen | ok | $0.773 | 976ms | — | 0.78 | 3.90 | |
| together | MiniMax-M2.7 | 🚀Throughput | ok | $0.773 | 6521ms | — | 0.25 | 1.00 | |
| deepinfra | MiniMax-M2.7 | 🚀Throughput | ok | $0.773 | 19152ms | — | 0.25 | 1.00 | |
| together | Kimi-K2.6 | 🔍Context Recall | pass | $0.780 | 1232ms | — | 0.75 | 3.50 | |
| openrouter | sonar-pro-search | 🧮Reasoning | ok | $0.789 | 932ms | — | 3.00 | 15.00 | |
| nvidia | nemotron-3-ultra-550b-a55b | { }JSON Output | pass | $0.794 | 3198ms | — | 0.60 | 3.60 | |
| openai | gpt-4o | 🔍Context Recall | pass | $0.795 | 1186ms | — | 2.50 | 10.00 | |
| deepinfra | Qwen3.6-27B | 🔧Tool Use | pass | $0.804 | 8713ms | — | 0.32 | 3.20 | |
| openrouter | qwen3.5-35b-a3b | 🔍Context Recall | pass | $0.808 | 806ms | — | 0.14 | 1.00 | |
| deepinfra | Qwen3.6-27B | ⚡Ping | ok | $0.812 | 7287ms | — | 0.32 | 3.20 | |
| openrouter | command-r-plus-08-2024 | 🔍Context Recall | pass | $0.815 | 855ms | — | 2.50 | 10.00 | |
| fireworks | kimi-k2p6 | { }JSON Output | pass | $0.815 | 3156ms | — | 0.95 | 4.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | { }JSON Output | pass | $0.819 | 617ms | — | 0.13 | 1.56 | |
| openai | gpt-3.5-turbo | 🚀Throughput | ok | $0.820 | 4286ms | — | 0.50 | 1.50 | |
| deepinfra | Kimi-K2.6 | { }JSON Output | pass | $0.821 | 3864ms | — | 0.75 | 3.50 | |
| openrouter | glm-4.6v | 🔍Context Recall | pass | $0.837 | 728ms | — | 0.30 | 0.90 | |
| openrouter | qwen3.7-plus | 🔍Context Recall | pass | $0.844 | 1102ms | — | 0.32 | 1.28 | |
| together | Kimi-K2.6 | { }JSON Output | pass | $0.845 | 1351ms | — | 0.75 | 3.50 | |
| openrouter | qwen3.5-plus-20260420 | 🔍Context Recall | pass | $0.847 | 659ms | — | 0.30 | 1.80 | |
| openrouter | qwen3.6-35b-a3b | { }JSON Output | pass | $0.852 | 1034ms | — | 0.14 | 1.00 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 💻Code Gen | ok | $0.867 | 3730ms | — | 0.60 | 2.40 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 💻Code Gen | ok | $0.875 | 881ms | — | 0.15 | 1.50 | |
| openrouter | palmyra-x5 | 💻Code Gen | ok | $0.876 | 672ms | — | 0.60 | 6.00 | |
| sambanova | MiniMax-M2.7 | 🧮Reasoning | ok | $0.891 | 1605ms | — | 0.60 | 2.40 | |
| openrouter | glm-4.6 | 🔍Context Recall | pass | $0.892 | 1069ms | — | 0.50 | 2.00 | |
| openrouter | glm-4.5v | 💻Code Gen | ok | $0.895 | 1045ms | — | 0.60 | 1.80 | |
| openrouter | glm-4.5 | 🔍Context Recall | pass | $0.905 | 5855ms | — | 0.60 | 2.20 | |
| deepinfra | MiMo-V2.5-Pro | 🔍Context Recall | pass | $0.915 | 3603ms | — | 1.00 | 3.00 | |
| openrouter | qwen3.7-plus | { }JSON Output | pass | $0.918 | 1024ms | — | 0.32 | 1.28 | |
| openrouter | glm-4.5v | 🚀Throughput | ok | $0.922 | 1998ms | — | 0.60 | 1.80 | |
| deepinfra | Qwen3.6-35B-A3B | 🧮Reasoning | ok | $0.923 | 19910ms | — | 0.15 | 0.95 | |
| openrouter | sonar-reasoning-pro | 💻Code Gen | ok | $0.954 | 5056ms | — | 2.00 | 8.00 | |
| together | MiniMax-M3 | 🚀Throughput | ok | $0.954 | 14588ms | — | 0.30 | 1.20 | |
| openrouter | mistral-medium-3-5 | 💻Code Gen | ok | $0.957 | 549ms | — | 1.50 | 7.50 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🚀Throughput | ok | $0.958 | 359ms | — | 0.21 | 1.90 | |
| openai | gpt-4.1 | 💻Code Gen | ok | $0.960 | 1619ms | — | 2.00 | 8.00 | |
| openrouter | kimi-k2-thinking | 🔍Context Recall | pass | $0.965 | 1281ms | — | 0.60 | 2.50 | |
| deepinfra | MiniMax-M3 | 🚀Throughput | ok | $0.969 | 8544ms | — | 0.30 | 1.20 | |
| deepinfra | GLM-5.2 | 💻Code Gen | ok | $0.987 | 14159ms | — | 0.93 | 3.00 | |
| openrouter | aion-3.0 | { }JSON Output | pass | $1.01 | 762ms | — | 3.00 | 6.00 | |
| openrouter | glm-4.6 | 🚀Throughput | ok | $1.02 | 1071ms | — | 0.50 | 2.00 | |
| deepinfra | GLM-5.2 | 🔍Context Recall | pass | $1.04 | 7517ms | — | 0.93 | 3.00 | |
| openrouter | qwen3.6-max-preview | ⚡Ping | ok | $1.05 | 1176ms | — | 1.04 | 6.24 | |
| openrouter | glm-5.1 | { }JSON Output | pass | $1.06 | 983ms | — | 0.97 | 3.04 | |
| anthropic | claude-opus-4-6 | { }JSON Output | pass | $1.07 | 3440ms | — | 5.00 | 25.00 | |
| openrouter | nova-premier-v1 | 🔍Context Recall | pass | $1.07 | 777ms | — | 2.50 | 12.50 | |
| anthropic | claude-opus-4-7 | 🧮Reasoning | ok | $1.07 | 2116ms | — | 5.00 | 25.00 | |
| openrouter | kat-coder-pro-v2.5 | 💻Code Gen | ok | $1.08 | 664ms | — | 0.74 | 2.96 | |
| anthropic | claude-opus-4-5-20251101 | { }JSON Output | pass | $1.09 | 1705ms | — | 5.00 | 25.00 | |
| openrouter | minimax-m1 | 🧮Reasoning | ok | $1.10 | 1446ms | — | 0.55 | 2.20 | |
| deepinfra | MiniMax-M2.7-Turbo | 💻Code Gen | ok | $1.12 | 3094ms | — | 0.38 | 1.70 | |
| openrouter | sonar-pro-search | 🔍Context Recall | pass | $1.12 | 1120ms | — | 3.00 | 15.00 | |
| deepinfra | Qwen3-Max-Thinking | 💻Code Gen | ok | $1.14 | 5354ms | — | 1.20 | 6.00 | |
| openrouter | grok-4.3 | { }JSON Output | pass | $1.14 | 951ms | — | 1.25 | 2.50 | |
| openai | gpt-4o-2024-05-13 | 🧮Reasoning | ok | $1.15 | 1296ms | — | 2.50 | 10.00 | |
| anthropic | claude-opus-4-8 | { }JSON Output | pass | $1.16 | 1583ms | — | 5.00 | 25.00 | |
| openrouter | kimi-k2 | 🚀Throughput | ok | $1.17 | 1014ms | — | 0.57 | 2.30 | |
| openrouter | glm-5.1 | 🧮Reasoning | ok | $1.17 | 430ms | — | 0.97 | 3.04 | |
| sambanova | MiniMax-M2.7 | 💻Code Gen | ok | $1.18 | 2117ms | — | 0.60 | 2.40 | |
| deepinfra | MiMo-V2.5-Pro | 💻Code Gen | ok | $1.18 | 8201ms | — | 1.00 | 3.00 | |
| openrouter | seed-2.0-lite | 🧮Reasoning | ok | $1.18 | 479ms | — | 0.25 | 2.00 | |
| openrouter | grok-build-0.1 | { }JSON Output | pass | $1.18 | 652ms | — | 1.00 | 2.00 | |
| fireworks | glm-5p2 | 🔍Context Recall | pass | $1.19 | 3832ms | — | 0.95 | 3.00 | |
| openrouter | qwen3.6-flash | 🧮Reasoning | ok | $1.21 | 435ms | — | 0.19 | 1.13 | |
| openai | gpt-4.1-mini-2025-04-14 | 🚀Throughput | ok | $1.22 | 9632ms | — | 0.40 | 1.60 | |
| openrouter | glm-5.1 | 💻Code Gen | ok | $1.24 | 10183ms | — | 0.97 | 3.04 | |
| openrouter | grok-4.3 | 🔍Context Recall | pass | $1.25 | 1164ms | — | 1.25 | 2.50 | |
| openrouter | glm-4.5 | 🧮Reasoning | ok | $1.26 | 9374ms | — | 0.60 | 2.20 | |
| openrouter | glm-5.1 | 🔍Context Recall | pass | $1.27 | 2206ms | — | 0.97 | 3.04 | |
| openrouter | kimi-k2-thinking | 🚀Throughput | ok | $1.27 | 832ms | — | 0.60 | 2.50 | |
| openrouter | nova-2-lite-v1 | 🚀Throughput | ok | $1.27 | 837ms | — | 0.30 | 2.50 | |
| openrouter | deepseek-r1 | 🚀Throughput | ok | $1.27 | 1324ms | — | 0.70 | 2.50 | |
| openrouter | glm-4.6 | 💻Code Gen | ok | $1.28 | 1127ms | — | 0.50 | 2.00 | |
| anthropic | claude-opus-4-6 | 🧮Reasoning | ok | $1.28 | 2395ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | 🧮Reasoning | ok | $1.28 | 1735ms | — | 5.00 | 25.00 | |
| openrouter | glm-4.5v | 🔍Context Recall | pass | $1.30 | 1006ms | — | 0.60 | 1.80 | |
| anthropic | claude-opus-4-8 | 🧮Reasoning | ok | $1.30 | 1671ms | — | 5.00 | 25.00 | |
| deepinfra | Kimi-K2.6 | 🔍Context Recall | pass | $1.30 | 5224ms | — | 0.75 | 3.50 | |
| anthropic | claude-opus-4-7 | { }JSON Output | pass | $1.31 | 2092ms | — | 5.00 | 25.00 | |
| deepinfra | MiniMax-M2.7-Turbo | 🚀Throughput | ok | $1.31 | 3250ms | — | 0.38 | 1.70 | |
| deepinfra | GLM-5.2 | 🧮Reasoning | ok | $1.32 | 9081ms | — | 0.93 | 3.00 | |
| deepinfra | GLM-4.7 | 🧮Reasoning | ok | $1.34 | 36360ms | — | 0.40 | 1.75 | |
| fireworks | glm-5p2 | { }JSON Output | pass | $1.34 | 4683ms | — | 0.95 | 3.00 | |
| deepinfra | GLM-4.7 | 🚀Throughput | ok | $1.34 | 19686ms | — | 0.40 | 1.75 | |
| openrouter | glm-4.5 | { }JSON Output | pass | $1.34 | 8406ms | — | 0.60 | 2.20 | |
| openai | gpt-4-turbo-2024-04-09 | 🔧Tool Use | pass | $1.36 | 3255ms | — | 10.00 | 30.00 | |
| openrouter | minimax-m1 | 🚀Throughput | ok | $1.36 | 1904ms | — | 0.55 | 2.20 | |
| openrouter | glm-5 | { }JSON Output | pass | $1.37 | 774ms | — | 0.95 | 3.15 | |
| openrouter | kimi-k2.6 | 🔍Context Recall | pass | $1.38 | 1371ms | — | 0.68 | 3.42 | |
| deepinfra | Qwen3.6-35B-A3B | 💻Code Gen | ok | $1.40 | 29585ms | — | 0.15 | 0.95 | |
| openrouter | qwen3.6-35b-a3b | 🧮Reasoning | ok | $1.40 | 310ms | — | 0.14 | 1.00 | |
| openrouter | aion-3.0 | 🧮Reasoning | ok | $1.41 | 771ms | — | 3.00 | 6.00 | |
| openrouter | grok-build-0.1 | 💻Code Gen | ok | $1.42 | 586ms | — | 1.00 | 2.00 | |
| openrouter | grok-build-0.1 | ⚡Ping | ok | $1.42 | 623ms | — | 1.00 | 2.00 | |
| fireworks | kimi-k2p6 | 🔍Context Recall | pass | $1.46 | 3093ms | — | 0.95 | 4.00 | |
| cerebras | zai-glm-4.7 | 💻Code Gen | ok | $1.46 | 9756ms | — | 2.25 | 2.75 | |
| openrouter | deepseek-r1 | 🔍Context Recall | pass | $1.48 | 1218ms | — | 0.70 | 2.50 | |
| deepinfra | DeepSeek-R1-0528 | 🔍Context Recall | pass | $1.49 | 24795ms | — | 0.50 | 2.15 | |
| openrouter | grok-4.3 | 🧮Reasoning | ok | $1.50 | 686ms | — | 1.25 | 2.50 | |
| deepinfra | Qwen3.5-397B-A17B | 🔍Context Recall | pass | $1.50 | 14887ms | — | 0.45 | 3.00 | |
| openrouter | kat-coder-pro-v2.5 | 🚀Throughput | ok | $1.51 | 525ms | — | 0.74 | 2.96 | |
| deepinfra | MiMo-V2.5 | 🚀Throughput | ok | $1.53 | 15262ms | — | 0.40 | 2.00 | |
| openrouter | relace-search | 🚀Throughput | ok | $1.54 | 2590ms | — | 1.00 | 3.00 | |
| openrouter | qwen3.6-35b-a3b | 💻Code Gen | ok | $1.54 | 604ms | — | 0.14 | 1.00 | |
| openrouter | glm-5v-turbo | 🧮Reasoning | ok | $1.57 | 1980ms | — | 1.20 | 4.00 | |
| openrouter | grok-4.3 | 💻Code Gen | ok | $1.57 | 978ms | — | 1.25 | 2.50 | |
| openrouter | kimi-k2-thinking | 🧮Reasoning | ok | $1.58 | 618ms | — | 0.60 | 2.50 | |
| openai | gpt-4-turbo-2024-04-09 | { }JSON Output | pass | $1.59 | 2274ms | — | 10.00 | 30.00 | |
| deepinfra | MiniMax-M2.7 | 🧮Reasoning | ok | $1.60 | 26663ms | — | 0.25 | 1.00 | |
| openai | gpt-4o | 💻Code Gen | ok | $1.60 | 2602ms | — | 2.50 | 10.00 | |
| openrouter | glm-5 | 🚀Throughput | ok | $1.61 | 2941ms | — | 0.95 | 3.15 | |
| openrouter | qwen3.5-plus-20260420 | 🧮Reasoning | ok | $1.61 | 735ms | — | 0.30 | 1.80 | |
| openrouter | aion-2.0 | 🚀Throughput | ok | $1.63 | 1065ms | — | 0.80 | 1.60 | |
| deepinfra | GLM-4.7 | 💻Code Gen | ok | $1.63 | 34535ms | — | 0.40 | 1.75 | |
| openai | gpt-4o-2024-05-13 | 💻Code Gen | ok | $1.64 | 1052ms | — | 2.50 | 10.00 | |
| deepinfra | DeepSeek-R1-0528 | 🚀Throughput | ok | $1.64 | 32050ms | — | 0.50 | 2.15 | |
| openrouter | qwen3-coder-plus | 🚀Throughput | ok | $1.65 | 718ms | — | 0.65 | 3.25 | |
| openrouter | glm-5 | 💻Code Gen | ok | $1.67 | 1283ms | — | 0.95 | 3.15 | |
| openrouter | glm-5 | 🔍Context Recall | pass | $1.69 | 1037ms | — | 0.95 | 3.15 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🚀Throughput | ok | $1.71 | 406ms | — | 0.15 | 1.50 | |
| openrouter | grok-build-0.1 | 🔍Context Recall | pass | $1.77 | 598ms | — | 1.00 | 2.00 | |
| openrouter | seed-2.0-lite | 💻Code Gen | ok | $1.77 | 1303ms | — | 0.25 | 2.00 | |
| cerebras | zai-glm-4.7 | { }JSON Output | pass | $1.79 | 1289ms | — | 2.25 | 2.75 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🚀Throughput | ok | $1.84 | 9190ms | — | 0.60 | 2.40 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🚀Throughput | ok | $1.84 | 3036ms | — | 0.60 | 2.40 | |
| sambanova | MiniMax-M2.7 | 🚀Throughput | ok | $1.86 | 2491ms | — | 0.60 | 2.40 | |
| deepinfra | Qwen3.6-27B | 🔍Context Recall | pass | $1.86 | 15321ms | — | 0.32 | 3.20 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🚀Throughput | ok | $1.90 | 1455ms | — | 0.13 | 1.56 | |
| openrouter | nova-premier-v1 | 💻Code Gen | ok | $1.91 | 699ms | — | 2.50 | 12.50 | |
| cerebras | zai-glm-4.7 | 🔍Context Recall | pass | $1.91 | 1068ms | — | 2.25 | 2.75 | |
| openrouter | kimi-k2-thinking | 💻Code Gen | ok | $1.91 | 958ms | — | 0.60 | 2.50 | |
| openrouter | sonar-pro-search | 💻Code Gen | ok | $1.91 | 1014ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-max-thinking | 🚀Throughput | ok | $1.98 | 854ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | 🚀Throughput | ok | $1.98 | 1170ms | — | 0.78 | 3.90 | |
| openrouter | qwen3.5-35b-a3b | 🧮Reasoning | ok | $2.03 | 1501ms | — | 0.14 | 1.00 | |
| openrouter | qwen3.5-plus-20260420 | { }JSON Output | pass | $2.03 | 1101ms | — | 0.30 | 1.80 | |
| openrouter | glm-5v-turbo | 🚀Throughput | ok | $2.04 | 1761ms | — | 1.20 | 4.00 | |
| openrouter | glm-5v-turbo | 🔍Context Recall | pass | $2.07 | 2191ms | — | 1.20 | 4.00 | |
| deepinfra | Qwen3.5-397B-A17B | { }JSON Output | pass | $2.10 | 20246ms | — | 0.45 | 3.00 | |
| openrouter | aion-3.0 | 🔍Context Recall | pass | $2.11 | 2509ms | — | 3.00 | 6.00 | |
| openrouter | qwen3.7-plus | 💻Code Gen | ok | $2.14 | 713ms | — | 0.32 | 1.28 | |
| fireworks | glm-5p2 | 🧮Reasoning | ok | $2.16 | 7827ms | — | 0.95 | 3.00 | |
| cerebras | zai-glm-4.7 | 🚀Throughput | ok | $2.16 | 4330ms | — | 2.25 | 2.75 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 🚀Throughput | ok | $2.21 | 1232ms | — | 0.13 | 1.56 | |
| deepinfra | DeepSeek-R1-0528 | 🧮Reasoning | ok | $2.21 | 41335ms | — | 0.50 | 2.15 | |
| openrouter | qwen3.6-flash | 🚀Throughput | ok | $2.23 | 484ms | — | 0.19 | 1.13 | |
| openrouter | qwen3.5-plus-20260420 | 💻Code Gen | ok | $2.23 | 712ms | — | 0.30 | 1.80 | |
| openrouter | deepseek-r1 | 🧮Reasoning | ok | $2.23 | 1170ms | — | 0.70 | 2.50 | |
| openrouter | qwen3.7-plus | 🧮Reasoning | ok | $2.28 | 1282ms | — | 0.32 | 1.28 | |
| anthropic | claude-opus-4-6 | 🔍Context Recall | pass | $2.29 | 2739ms | — | 5.00 | 25.00 | |
| deepinfra | GLM-5.2 | 🚀Throughput | ok | $2.31 | 46851ms | — | 0.93 | 3.00 | |
| fireworks | glm-5p2 | 🚀Throughput | ok | $2.31 | 11918ms | — | 0.95 | 3.00 | |
| openrouter | aion-3.0 | 💻Code Gen | ok | $2.35 | 1083ms | — | 3.00 | 6.00 | |
| openrouter | qwen3.6-max-preview | 🔍Context Recall | pass | $2.44 | 944ms | — | 1.04 | 6.24 | |
| fireworks | kimi-k2p6 | 💻Code Gen | ok | $2.44 | 6127ms | — | 0.95 | 4.00 | |
| openrouter | glm-4.5 | 💻Code Gen | ok | $2.49 | 9341ms | — | 0.60 | 2.20 | |
| gemini | gemini-2.5-pro | 💻Code Gen | ok | $2.51 | 13423ms | — | 1.25 | 10.00 | |
| deepinfra | MiMo-V2.5-Pro | 🚀Throughput | ok | $2.55 | 19851ms | — | 1.00 | 3.00 | |
| openai | gpt-4-turbo-2024-04-09 | 🧮Reasoning | ok | $2.55 | 3321ms | — | 10.00 | 30.00 | |
| openrouter | grok-4.3 | 🚀Throughput | ok | $2.61 | 809ms | — | 1.25 | 2.50 | |
| anthropic | claude-opus-4-5-20251101 | 🔍Context Recall | pass | $2.66 | 2399ms | — | 5.00 | 25.00 | |
| together | Kimi-K2.6 | 🚀Throughput | ok | $2.67 | 5913ms | — | 0.75 | 3.50 | |
| deepinfra | Kimi-K2.6 | 🚀Throughput | ok | $2.67 | 7202ms | — | 0.75 | 3.50 | |
| cerebras | zai-glm-4.7 | 🧮Reasoning | ok | $2.72 | 1804ms | — | 2.25 | 2.75 | |
| openrouter | qwen3.6-flash | 💻Code Gen | ok | $2.74 | 435ms | — | 0.19 | 1.13 | |
| nvidia | nemotron-3-ultra-550b-a55b | 🚀Throughput | ok | $2.75 | 15005ms | — | 0.60 | 3.60 | |
| openai | gpt-4-turbo-2024-04-09 | 🔍Context Recall | pass | $2.75 | 4206ms | — | 10.00 | 30.00 | |
| openrouter | kimi-k2.6 | 💻Code Gen | ok | $2.82 | 1318ms | — | 0.68 | 3.42 | |
| openrouter | qwen3.7-plus | 🚀Throughput | ok | $2.90 | 735ms | — | 0.32 | 1.28 | |
| openrouter | glm-5 | 🧮Reasoning | ok | $3.01 | 10122ms | — | 0.95 | 3.15 | |
| together | Kimi-K2.6 | 💻Code Gen | ok | $3.04 | 4414ms | — | 0.75 | 3.50 | |
| fireworks | kimi-k2p6 | 🚀Throughput | ok | $3.06 | 10343ms | — | 0.95 | 4.00 | |
| openrouter | mistral-large | 🚀Throughput | ok | $3.07 | 601ms | — | 2.00 | 6.00 | |
| openrouter | palmyra-x5 | 🚀Throughput | ok | $3.18 | 632ms | — | 0.60 | 6.00 | |
| deepinfra | Kimi-K2.6 | 💻Code Gen | ok | $3.35 | 8982ms | — | 0.75 | 3.50 | |
| deepinfra | Qwen3.6-27B | { }JSON Output | pass | $3.46 | 27944ms | — | 0.32 | 3.20 | |
| deepinfra | Qwen3.6-27B | 🧮Reasoning | ok | $3.50 | 32249ms | — | 0.32 | 3.20 | |
| anthropic | claude-opus-4-7 | 🔍Context Recall | pass | $3.51 | 2183ms | — | 5.00 | 25.00 | |
| openai | gpt-4-turbo-2024-04-09 | 💻Code Gen | ok | $3.52 | 3460ms | — | 10.00 | 30.00 | |
| openrouter | grok-build-0.1 | 🚀Throughput | ok | $3.58 | 888ms | — | 1.00 | 2.00 | |
| fireworks | kimi-k2p6 | 🧮Reasoning | ok | $3.61 | 9180ms | — | 0.95 | 4.00 | |
| openrouter | qwen3.6-max-preview | 🧮Reasoning | ok | $3.72 | 996ms | — | 1.04 | 6.24 | |
| anthropic | claude-opus-4-8 | 🔍Context Recall | pass | $3.74 | 1769ms | — | 5.00 | 25.00 | |
| openrouter | mistral-medium-3-5 | 🚀Throughput | ok | $3.82 | 620ms | — | 1.50 | 7.50 | |
| openrouter | glm-4.5 | 🚀Throughput | ok | $3.88 | 9550ms | — | 0.60 | 2.20 | |
| openrouter | kimi-k2.6 | 🧮Reasoning | ok | $3.92 | 1097ms | — | 0.68 | 3.42 | |
| openrouter | qwen3.6-max-preview | { }JSON Output | pass | $3.98 | 1380ms | — | 1.04 | 6.24 | |
| deepinfra | Kimi-K2.6 | 🧮Reasoning | ok | $4.06 | 10424ms | — | 0.75 | 3.50 | |
| openrouter | qwen3-235b-a22b | 💻Code Gen | ok | $4.19 | 364ms | — | 0.46 | 1.82 | |
| openrouter | aion-3.0 | 🚀Throughput | ok | $4.22 | 1093ms | — | 3.00 | 6.00 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 💻Code Gen | ok | $4.23 | 249ms | — | 0.13 | 1.56 | |
| anthropic | claude-opus-4-5-20251101 | 🔧Tool Use | pass | $4.34 | 1973ms | — | 5.00 | 25.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 💻Code Gen | ok | $4.41 | 1953ms | — | 0.13 | 1.56 | |
| deepinfra | Qwen3-Max-Thinking | 🚀Throughput | ok | $4.58 | 16870ms | — | 1.20 | 6.00 | |
| openrouter | qwen3.5-plus-20260420 | 🚀Throughput | ok | $4.60 | 670ms | — | 0.30 | 1.80 | |
| deepinfra | Qwen3.5-397B-A17B | 🧮Reasoning | ok | $4.76 | 51795ms | — | 0.45 | 3.00 | |
| openrouter | grok-build-0.1 | 🧮Reasoning | ok | $4.99 | 684ms | — | 1.00 | 2.00 | |
| together | Kimi-K2.6 | 🧮Reasoning | ok | $5.01 | 7744ms | — | 0.75 | 3.50 | |
| openrouter | qwen3-235b-a22b | 🚀Throughput | ok | $5.04 | 373ms | — | 0.46 | 1.82 | |
| openrouter | glm-5v-turbo | 💻Code Gen | ok | $5.05 | 2583ms | — | 1.20 | 4.00 | |
| openrouter | command-r-plus-08-2024 | 🚀Throughput | ok | $5.07 | 884ms | — | 2.50 | 10.00 | |
| anthropic | claude-opus-4-6 | 💻Code Gen | ok | $6.05 | 5858ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | 💻Code Gen | ok | $6.05 | 7028ms | — | 5.00 | 25.00 | |
| openai | gpt-4.1 | 🚀Throughput | ok | $6.12 | 7182ms | — | 2.00 | 8.00 | |
| openrouter | glm-5.1 | 🚀Throughput | ok | $6.29 | 3644ms | — | 0.97 | 3.04 | |
| openrouter | nova-premier-v1 | 🚀Throughput | ok | $6.41 | 766ms | — | 2.50 | 12.50 | |
| openrouter | seed-2.0-lite | 🚀Throughput | ok | $6.65 | 403ms | — | 0.25 | 2.00 | |
| openrouter | sonar-pro-search | 🚀Throughput | ok | $7.49 | 1073ms | — | 3.00 | 15.00 | |
| openai | gpt-4o-2024-05-13 | 🚀Throughput | ok | $7.65 | 4812ms | — | 2.50 | 10.00 | |
| openai | gpt-4o | 🚀Throughput | ok | $7.65 | 13290ms | — | 2.50 | 10.00 | |
| openrouter | qwen3.6-max-preview | 💻Code Gen | ok | $7.93 | 1660ms | — | 1.04 | 6.24 | |
| anthropic | claude-opus-4-8 | 💻Code Gen | ok | $7.96 | 4213ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-7 | 💻Code Gen | ok | $8.67 | 5186ms | — | 5.00 | 25.00 | |
| openrouter | kimi-k2.6 | 🚀Throughput | ok | $9.51 | 1183ms | — | 0.68 | 3.42 | |
| openrouter | step-3.7-flash | 💻Code Gen | ok | $17.29 | 2491ms | — | 0.20 | 1.15 | |
| openrouter | grok-4.20-multi-agent | 🔍Context Recall | pass | $17.40 | 564ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 🧮Reasoning | ok | $17.46 | 631ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 🚀Throughput | ok | $18.50 | 953ms | — | 1.25 | 2.50 | |
| anthropic | claude-opus-4-6 | 🚀Throughput | ok | $19.09 | 19638ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | 🚀Throughput | ok | $19.09 | 14071ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-8 | 🚀Throughput | ok | $19.19 | 10915ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-7 | 🚀Throughput | ok | $19.21 | 12279ms | — | 5.00 | 25.00 | |
| openai | gpt-4-turbo-2024-04-09 | 🚀Throughput | ok | $23.05 | 14375ms | — | 10.00 | 30.00 | |
| openrouter | grok-4.20-multi-agent | ⚡Ping | ok | $23.39 | 590ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 💻Code Gen | ok | $25.42 | 667ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | { }JSON Output | pass | $28.49 | 620ms | — | 1.25 | 2.50 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🚀Throughput | ok | — | 457ms | — | 0.66 | 1.00 | |
| openrouter | sonar-reasoning-pro | 🚀Throughput | ok | — | 10108ms | — | 2.00 | 8.00 | |
| openai | gpt-4 | 🔧Tool Use | pass | — | 3205ms | — | — | — | |
| openai | gpt-4 | 🔍Context Recall | pass | — | 1588ms | — | — | — | |
| openai | gpt-4 | 🚀Throughput | ok | — | 12374ms | — | — | — | |
| openai | gpt-4 | 💻Code Gen | ok | — | 4011ms | — | — | — | |
| openai | gpt-4 | { }JSON Output | pass | — | 1535ms | — | — | — | |
| openai | gpt-4 | 🧮Reasoning | ok | — | 2705ms | — | — | — | |
| openai | gpt-4 | ⚡Ping | ok | — | 3412ms | — | — | — | |
| gemini | gemini-3.5-flash | 🔧Tool Use | pass | — | 1082ms | — | — | — | |
| gemini | gemini-3.5-flash | 🔍Context Recall | pass | — | 1673ms | — | — | — | |
| gemini | gemini-3.5-flash | 🚀Throughput | ok | — | 4615ms | — | — | — | |
| gemini | gemini-3.5-flash | 💻Code Gen | ok | — | 2808ms | — | — | — | |
| gemini | gemini-3.5-flash | { }JSON Output | pass | — | 2346ms | — | — | — | |
| gemini | gemini-3.5-flash | 🧮Reasoning | ok | — | 2762ms | — | — | — | |
| gemini | gemini-3.5-flash | ⚡Ping | ok | — | 1312ms | — | — | — | |
| gemini | gemini-3.1-flash-image | 🔧Tool Use | pass | — | 1311ms | — | — | — | |
| gemini | gemini-3.1-flash-image | 🔍Context Recall | pass | — | 1230ms | — | — | — | |
| gemini | gemini-3.1-flash-image | 🚀Throughput | ok | — | 6364ms | — | — | — | |
| gemini | gemini-3.1-flash-image | 💻Code Gen | ok | — | 1596ms | — | — | — | |
| gemini | gemini-3.1-flash-image | { }JSON Output | pass | — | 1403ms | — | — | — | |
| gemini | gemini-3.1-flash-image | 🧮Reasoning | ok | — | 1404ms | — | — | — | |
| gemini | gemini-3.1-flash-image | ⚡Ping | ok | — | 2054ms | — | — | — | |
| openrouter | sonar-deep-research | 🚀Throughput | ok | — | 10128ms | — | 2.00 | 8.00 | |
| openrouter | sonar-deep-research | ⚡Ping | ok | — | 10137ms | — | 2.00 | 8.00 | |
| openrouter | inflection-3-pi | 🚀Throughput | ok | — | 984ms | — | 2.50 | 10.00 | |
| openrouter | inflection-3-pi | ⚡Ping | ok | — | 2189ms | — | 2.50 | 10.00 | |
| openai | gpt-3.5-turbo-0125 | 🔧Tool Use | pass | — | 1398ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🔍Context Recall | pass | — | 1815ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🚀Throughput | ok | — | 4247ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 💻Code Gen | ok | — | 1823ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | { }JSON Output | pass | — | 1787ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🧮Reasoning | ok | — | 6264ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | ⚡Ping | ok | — | 1460ms | — | — | — | |
| gemini | nano-banana-pro-preview | 🔧Tool Use | pass | — | 3053ms | — | — | — | |
| gemini | nano-banana-pro-preview | 🔍Context Recall | pass | — | 5834ms | — | — | — | |
| gemini | nano-banana-pro-preview | 💻Code Gen | ok | — | 12338ms | — | — | — | |
| gemini | nano-banana-pro-preview | { }JSON Output | pass | — | 5799ms | — | — | — | |
| gemini | nano-banana-pro-preview | 🧮Reasoning | ok | — | 7003ms | — | — | — | |
| gemini | nano-banana-pro-preview | ⚡Ping | ok | — | 2210ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 🔧Tool Use | pass | — | 2353ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 🔍Context Recall | pass | — | 3782ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 💻Code Gen | ok | — | 6463ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | { }JSON Output | pass | — | 5380ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 🧮Reasoning | ok | — | 5005ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | ⚡Ping | ok | — | 2500ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 🔧Tool Use | pass | — | 2607ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 🔍Context Recall | pass | — | 5579ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 💻Code Gen | ok | — | 8548ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | { }JSON Output | pass | — | 5714ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 🧮Reasoning | ok | — | 9164ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | ⚡Ping | ok | — | 3987ms | — | — | — | |
| openrouter | nemotron-nano-12b-v2-vl:free | ⚡Ping | ok | — | 1572ms | — | 0.00 | 0.00 | |
| gemini | gemini-3.1-pro-preview | 🔧Tool Use | pass | — | 6308ms | — | — | — | |
| gemini | gemini-3.1-pro-preview | 🔍Context Recall | pass | — | 3878ms | — | — | — | |
| gemini | gemini-3.1-pro-preview | 💻Code Gen | ok | — | 7157ms | — | — | — | |
| gemini | gemini-3.1-pro-preview | { }JSON Output | pass | — | 4607ms | — | — | — | |
| gemini | gemini-3.1-pro-preview | 🧮Reasoning | ok | — | 6813ms | — | — | — | |
| gemini | gemini-3.1-pro-preview | ⚡Ping | ok | — | 2385ms | — | — | — | |
| gemini | gemini-3-pro-image | 🔧Tool Use | pass | — | 3198ms | — | — | — | |
| gemini | gemini-3-pro-image | 🔍Context Recall | pass | — | 5447ms | — | — | — | |
| gemini | gemini-3-pro-image | 💻Code Gen | ok | — | 14059ms | — | — | — | |
| gemini | gemini-3-pro-image | { }JSON Output | pass | — | 6509ms | — | — | — | |
| gemini | gemini-3-pro-image | 🧮Reasoning | ok | — | 8844ms | — | — | — | |
| gemini | gemini-3-pro-image | ⚡Ping | ok | — | 3022ms | — | — | — | |
| openai | gpt-4-0613 | 🔧Tool Use | pass | — | 1382ms | — | — | — | |
| openai | gpt-4-0613 | 🔍Context Recall | pass | — | 2993ms | — | — | — | |
| openai | gpt-4-0613 | 🚀Throughput | ok | — | 19244ms | — | — | — | |
| openai | gpt-4-0613 | 💻Code Gen | ok | — | 7795ms | — | — | — | |
| openai | gpt-4-0613 | { }JSON Output | pass | — | 2041ms | — | — | — | |
| openai | gpt-4-0613 | 🧮Reasoning | ok | — | 2445ms | — | — | — | |
| openai | gpt-4-0613 | ⚡Ping | ok | — | 2225ms | — | — | — | |
| gemini | gemini-pro-latest | 🔧Tool Use | pass | — | 2954ms | — | — | — | |
| gemini | gemini-pro-latest | 🔍Context Recall | pass | — | 5028ms | — | — | — | |
| gemini | gemini-pro-latest | 💻Code Gen | ok | — | 6797ms | — | — | — | |
| gemini | gemini-pro-latest | { }JSON Output | pass | — | 4865ms | — | — | — | |
| gemini | gemini-pro-latest | 🧮Reasoning | ok | — | 7731ms | — | — | — | |
| gemini | gemini-pro-latest | ⚡Ping | ok | — | 2814ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🔧Tool Use | pass | — | 695ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🔍Context Recall | pass | — | 880ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🚀Throughput | ok | — | 2893ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 💻Code Gen | ok | — | 1009ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | { }JSON Output | pass | — | 783ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🧮Reasoning | ok | — | 690ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | ⚡Ping | ok | — | 780ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🧠Multi-Step Logic | pass | — | 164ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🚀Throughput | ok | — | 154ms | — | — | — | |
| deepseek | deepseek-v4-pro | 📝Summarizationreal | pass | — | 233ms | — | — | — | |
| deepseek | deepseek-v4-pro | 📄Data Extractionreal | pass | — | 166ms | — | — | — | |
| deepseek | deepseek-v4-pro | 📋Instruction Followreal | pass | — | 142ms | — | — | — | |
| deepseek | deepseek-v4-pro | ✅Format Compliancereal | pass | — | 194ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🪡Long-Context Needle | pass | — | 278ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🏷️Classificationreal | pass | — | 153ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🔧Tool Use | pass | — | 154ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🔍Context Recall | pass | — | 188ms | — | — | — | |
| deepseek | deepseek-v4-pro | code_algo | pass | — | 157ms | — | — | — | |
| deepseek | deepseek-v4-pro | code_refactor_preserve | pass | — | 149ms | — | — | — | |
| deepseek | deepseek-v4-pro | code_to_spec | pass | — | 177ms | — | — | — | |
| deepseek | deepseek-v4-pro | code_fix_bug | pass | — | 148ms | — | — | — | |
| deepseek | deepseek-v4-pro | 💻Code Gen | ok | — | 179ms | — | — | — | |
| deepseek | deepseek-v4-pro | { }JSON Output | pass | — | 152ms | — | — | — | |
| deepseek | deepseek-v4-pro | 🧮Reasoning | ok | — | 154ms | — | — | — | |
| deepseek | deepseek-v4-pro | ⚡Ping | ok | — | 161ms | — | — | — | |
| zhipu | glm-4.6 | code_to_spec | pass | — | 8521ms | — | — | — | |
| zhipu | glm-4.6 | code_fix_bug | pass | — | 10958ms | — | — | — | |
| zhipu | glm-4.6 | { }JSON Output | pass | — | 3379ms | — | — | — | |
| zhipu | glm-4.6 | ⚡Ping | ok | — | 1743ms | — | — | — | |
| dashscope | qwen-max | 🧠Multi-Step Logic | pass | — | 441ms | — | — | — | |
| dashscope | qwen-max | 🪡Long-Context Needle | pass | — | 1634ms | — | — | — | |
| dashscope | qwen-max | ✅Format Compliancereal | pass | — | 1499ms | — | — | — | |
| dashscope | qwen-max | 📋Instruction Followreal | pass | — | 1667ms | — | — | — | |
| dashscope | qwen-max | 📄Data Extractionreal | pass | — | 2638ms | — | — | — | |
| dashscope | qwen-max | 🏷️Classificationreal | pass | — | 534ms | — | — | — | |
| dashscope | qwen-max | 📝Summarizationreal | pass | — | 2513ms | — | — | — | |
| dashscope | qwen-max | 🔧Tool Use | pass | — | 592ms | — | — | — | |
| dashscope | qwen-max | 🔍Context Recall | pass | — | 762ms | — | — | — | |
| dashscope | qwen-max | 🚀Throughput | ok | — | 8009ms | — | — | — | |
| dashscope | qwen-max | code_algo | pass | — | 1792ms | — | — | — | |
| dashscope | qwen-max | code_refactor_preserve | pass | — | 1139ms | — | — | — | |
| dashscope | qwen-max | code_to_spec | pass | — | 2434ms | — | — | — | |
| dashscope | qwen-max | code_fix_bug | pass | — | 1506ms | — | — | — | |
| dashscope | qwen-max | 💻Code Gen | ok | — | 1639ms | — | — | — | |
| dashscope | qwen-max | { }JSON Output | pass | — | 665ms | — | — | — | |
| dashscope | qwen-max | 🧮Reasoning | ok | — | 896ms | — | — | — | |
| dashscope | qwen-max | ⚡Ping | ok | — | 554ms | — | — | — | |
| moonshot | kimi-k2.7-code | 🪡Long-Context Needle | pass | — | 3547ms | — | — | — | |
| moonshot | kimi-k2.7-code | ✅Format Compliancereal | pass | — | 10340ms | — | — | — | |
| moonshot | kimi-k2.7-code | 📋Instruction Followreal | pass | — | 13292ms | — | — | — | |
| moonshot | kimi-k2.7-code | 📄Data Extractionreal | pass | — | 9162ms | — | — | — | |
| moonshot | kimi-k2.7-code | 🏷️Classificationreal | pass | — | 7585ms | — | — | — | |
| moonshot | kimi-k2.7-code | 📝Summarizationreal | pass | — | 9772ms | — | — | — | |
| moonshot | kimi-k2.7-code | 🔧Tool Use | pass | — | 2347ms | — | — | — | |
| moonshot | kimi-k2.7-code | 🔍Context Recall | pass | — | 1860ms | — | — | — | |
| moonshot | kimi-k2.7-code | 🚀Throughput | ok | — | 12687ms | — | — | — | |
| moonshot | kimi-k2.7-code | code_algo | pass | — | 10438ms | — | — | — | |
| moonshot | kimi-k2.7-code | code_refactor_preserve | pass | — | 9577ms | — | — | — | |
| moonshot | kimi-k2.7-code | code_to_spec | pass | — | 9752ms | — | — | — | |
| moonshot | kimi-k2.7-code | code_fix_bug | pass | — | 8127ms | — | — | — | |
| moonshot | kimi-k2.7-code | 💻Code Gen | ok | — | 8525ms | — | — | — | |
| moonshot | kimi-k2.7-code | { }JSON Output | pass | — | 2205ms | — | — | — | |
| moonshot | kimi-k2.7-code | 🧮Reasoning | ok | — | 2515ms | — | — | — | |
| moonshot | kimi-k2.7-code | ⚡Ping | ok | — | 1359ms | — | — | — | |
| mistral | mistral-large-latest | 🪡Long-Context Needle | pass | — | 911ms | — | — | — | |
| mistral | mistral-large-latest | ✅Format Compliancereal | pass | — | 1983ms | — | — | — | |
| mistral | mistral-large-latest | 📋Instruction Followreal | pass | — | 4285ms | — | — | — | |
| mistral | mistral-large-latest | 📄Data Extractionreal | pass | — | 2479ms | — | — | — | |
| mistral | mistral-large-latest | 🏷️Classificationreal | pass | — | 1313ms | — | — | — | |
| mistral | mistral-large-latest | 📝Summarizationreal | pass | — | 2804ms | — | — | — | |
| mistral | mistral-large-latest | 🔧Tool Use | pass | — | 2346ms | — | — | — | |
| mistral | mistral-large-latest | 🔍Context Recall | pass | — | 3212ms | — | — | — | |
| mistral | mistral-large-latest | 🚀Throughput | ok | — | 8146ms | — | — | — | |
| mistral | mistral-large-latest | code_algo | pass | — | 2068ms | — | — | — | |
| mistral | mistral-large-latest | code_refactor_preserve | pass | — | 1101ms | — | — | — | |
| mistral | mistral-large-latest | code_to_spec | pass | — | 3399ms | — | — | — | |
| mistral | mistral-large-latest | code_fix_bug | pass | — | 1606ms | — | — | — | |
| mistral | mistral-large-latest | 💻Code Gen | ok | — | 2243ms | — | — | — | |
| mistral | mistral-large-latest | { }JSON Output | pass | — | 1037ms | — | — | — | |
| mistral | mistral-large-latest | 🧮Reasoning | ok | — | 1274ms | — | — | — | |
| mistral | mistral-large-latest | ⚡Ping | ok | — | 812ms | — | — | — | |
| xai | grok-4.5 | 🪡Long-Context Needle | pass | — | 1987ms | — | — | — | |
| xai | grok-4.5 | ✅Format Compliancereal | pass | — | 5650ms | — | — | — | |
| xai | grok-4.5 | 📋Instruction Followreal | pass | — | 7426ms | — | — | — | |
| xai | grok-4.5 | 📄Data Extractionreal | pass | — | 2748ms | — | — | — | |
| xai | grok-4.5 | 🏷️Classificationreal | pass | — | 4204ms | — | — | — | |
| xai | grok-4.5 | 📝Summarizationreal | pass | — | 5157ms | — | — | — | |
| xai | grok-4.5 | 🔧Tool Use | pass | — | 1455ms | — | — | — | |
| xai | grok-4.5 | 🔍Context Recall | pass | — | 2684ms | — | — | — | |
| xai | grok-4.5 | 🚀Throughput | ok | — | 7045ms | — | — | — | |
| xai | grok-4.5 | code_algo | pass | — | 2701ms | — | — | — | |
| xai | grok-4.5 | code_refactor_preserve | pass | — | 2761ms | — | — | — | |
| xai | grok-4.5 | code_to_spec | pass | — | 3297ms | — | — | — | |
| xai | grok-4.5 | code_fix_bug | pass | — | 7525ms | — | — | — | |
| xai | grok-4.5 | 💻Code Gen | ok | — | 2373ms | — | — | — | |
| xai | grok-4.5 | { }JSON Output | pass | — | 2198ms | — | — | — |
Each cell is the latest single run (n=1) — a fluke and a real weakness look the same here. For repeated-run, variance-aware numbers see the Deep Suite and Coding Models. On speed/latency tests, ok means the model responded, not that it was correct.