Loading benchmark data…
EyesInAI·Loading live benchmark data
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
| Expand row | Test | Status | |||||||
|---|---|---|---|---|---|---|---|---|---|
| openrouter | nemotron-3-ultra-550b-a55b:free | 🔍Context Recall | pass | free | 452ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🚀Throughput | ok | free | 502ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 💻Code Gen | ok | free | 741ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | { }JSON Output | pass | free | 440ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🧮Reasoning | ok | free | 452ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | ⚡Ping | ok | free | 717ms | — | 0.00 | 0.00 | |
| openrouter | dots-3-note-preview:free | 🔍Context Recall | pass | free | 558ms | — | 0.00 | 0.00 | |
| openrouter | dots-3-note-preview:free | 💻Code Gen | ok | free | 565ms | — | 0.00 | 0.00 | |
| openrouter | dots-3-note-preview:free | { }JSON Output | pass | free | 591ms | — | 0.00 | 0.00 | |
| openrouter | dots-3-note-preview:free | ⚡Ping | ok | free | 562ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-super-vl:free | 🔍Context Recall | pass | free | 343ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-super-vl:free | 💻Code Gen | ok | free | 339ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-super-vl:free | { }JSON Output | pass | free | 341ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-super-vl:free | ⚡Ping | ok | free | 359ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3.5-super-vl-120b-a12b | 🔍Context Recall | pass | free | 2477ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3.5-super-vl-120b-a12b | 💻Code Gen | ok | free | 3547ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3.5-super-vl-120b-a12b | { }JSON Output | pass | free | 1260ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3.5-super-vl-120b-a12b | 🧮Reasoning | ok | free | 1921ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3.5-super-vl-120b-a12b | ⚡Ping | ok | free | 827ms | — | 0.00 | 0.00 | |
| nvidia | gpt-oss-20b | 🔍Context Recall | pass | free | 17952ms | — | 0.00 | 0.00 | |
| nvidia | gpt-oss-20b | 🚀Throughput | ok | free | 28579ms | — | 0.00 | 0.00 | |
| nvidia | gpt-oss-20b | 💻Code Gen | ok | free | 30558ms | — | 0.00 | 0.00 | |
| nvidia | gpt-oss-20b | 🧮Reasoning | ok | free | 14379ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🔍Context Recall | pass | free | 483ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🚀Throughput | ok | free | 610ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | { }JSON Output | pass | free | 472ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🧮Reasoning | ok | free | 476ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | ⚡Ping | ok | free | 535ms | — | 0.00 | 0.00 | |
| together | Ternary-Bonsai-27B | 🔧Tool Use | pass | free | 1974ms | — | 0.00 | 0.00 | |
| together | Ternary-Bonsai-27B | 🔍Context Recall | pass | free | 13825ms | — | 0.00 | 0.00 | |
| together | Ternary-Bonsai-27B | 💻Code Gen | ok | free | 18699ms | — | 0.00 | 0.00 | |
| together | Ternary-Bonsai-27B | { }JSON Output | pass | free | 12068ms | — | 0.00 | 0.00 | |
| together | Ternary-Bonsai-27B | 🧮Reasoning | ok | free | 14788ms | — | 0.00 | 0.00 | |
| together | Ternary-Bonsai-27B | ⚡Ping | ok | free | 2713ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-lightning:free | 🔍Context Recall | pass | free | 403ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-lightning:free | 💻Code Gen | ok | free | 405ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-lightning:free | { }JSON Output | pass | free | 478ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-lightning:free | 🧮Reasoning | ok | free | 453ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3.5-lightning:free | ⚡Ping | ok | free | 407ms | — | 0.00 | 0.00 | |
| groq | qwen3.8-27b | 🔧Tool Use | pass | free | 319ms | — | 0.00 | 0.00 | |
| groq | qwen3.8-27b | 🔍Context Recall | pass | free | 329ms | — | 0.00 | 0.00 | |
| openrouter | mistral-nemo | ⚡Ping | ok | <$0.01 | 594ms | — | 0.03 | 0.03 | |
| openrouter | command-r7b-12-2024 | ⚡Ping | ok | <$0.01 | 706ms | — | 0.04 | 0.15 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | ⚡Ping | ok | <$0.01 | 1569ms | — | 0.03 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 1134ms | — | 0.02 | 0.04 | |
| openrouter | hy-mt2-1.8b | ⚡Ping | ok | <$0.01 | 417ms | — | 0.04 | 0.18 | |
| gemini | gemini-2.5-flash-lite | ⚡Ping | ok | <$0.01 | 1706ms | — | 0.07 | 0.30 | |
| openrouter | llama-3.2-1b-instruct | ⚡Ping | ok | <$0.01 | 382ms | — | 0.03 | 0.20 | |
| openrouter | nova-lite-v1 | ⚡Ping | ok | <$0.01 | 1657ms | — | 0.06 | 0.24 | |
| openrouter | gemma-3-12b-it | ⚡Ping | ok | <$0.01 | 464ms | — | 0.05 | 0.15 | |
| deepinfra | gemma-3-12b-it | ⚡Ping | ok | <$0.01 | 921ms | — | 0.05 | 0.15 | |
| openrouter | llama-3.1-8b-instruct | ⚡Ping | ok | <$0.01 | 421ms | — | 0.05 | 0.08 | |
| openrouter | hy-mt2-7b | ⚡Ping | ok | <$0.01 | 592ms | — | 0.07 | 0.29 | |
| openrouter | ministral-3b-2512 | ⚡Ping | ok | <$0.01 | 511ms | — | 0.10 | 0.10 | |
| openrouter | qwen3-coder-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 1495ms | — | 0.07 | 0.28 | |
| deepinfra | DeepSeek-V4-Flash | ⚡Ping | ok | <$0.01 | 1398ms | — | 0.09 | 0.18 | |
| openrouter | mistral-small-3.2-24b-instruct | ⚡Ping | ok | <$0.01 | 1203ms | — | 0.07 | 0.20 | |
| openrouter | deepseek-v4-flash | ⚡Ping | ok | <$0.01 | 1129ms | — | 0.09 | 0.18 | |
| openrouter | mistral-nemo | 🧮Reasoning | ok | <$0.01 | 479ms | — | 0.03 | 0.03 | |
| openrouter | reka-edge | ⚡Ping | ok | <$0.01 | 612ms | — | 0.10 | 0.10 | |
| deepinfra | gemma-3-27b-it | ⚡Ping | ok | <$0.01 | 2592ms | — | 0.08 | 0.16 | |
| openrouter | voxtral-small-24b-2507 | ⚡Ping | ok | <$0.01 | 657ms | — | 0.10 | 0.30 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🧮Reasoning | ok | <$0.01 | 3054ms | — | 0.02 | 0.04 | |
| deepinfra | gemma-4-26B-A4B-it | ⚡Ping | ok | <$0.01 | 1037ms | — | 0.07 | 0.34 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | ⚡Ping | ok | <$0.01 | 448ms | — | 0.10 | 0.30 | |
| openrouter | command-r-08-2024 | ⚡Ping | ok | <$0.01 | 656ms | — | 0.15 | 0.60 | |
| openrouter | hy-mt2-30b-a3b | ⚡Ping | ok | <$0.01 | 426ms | — | 0.07 | 0.29 | |
| openrouter | llama-4-scout | ⚡Ping | ok | <$0.01 | 626ms | — | 0.10 | 0.30 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | { }JSON Output | pass | <$0.01 | 2650ms | — | 0.02 | 0.04 | |
| openrouter | nex-n2.5-pro | ⚡Ping | ok | <$0.01 | 1039ms | — | 0.07 | 0.25 | |
| openrouter | qwen3-235b-a22b-2507 | ⚡Ping | ok | <$0.01 | 860ms | — | 0.09 | 0.55 | |
| deepinfra | gemma-4-31B-it-turbo | ⚡Ping | ok | <$0.01 | 894ms | — | 0.09 | 0.34 | |
| openrouter | gemma-3-27b-it | ⚡Ping | ok | <$0.01 | 427ms | — | 0.08 | 0.35 | |
| openai | gpt-4o-mini | ⚡Ping | ok | <$0.01 | 2299ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | ⚡Ping | ok | <$0.01 | 757ms | — | 0.15 | 0.60 | |
| openrouter | llama-3.2-3b-instruct | ⚡Ping | ok | <$0.01 | 344ms | — | 0.05 | 0.33 | |
| openrouter | mistral-nemo | { }JSON Output | pass | <$0.01 | 499ms | — | 0.03 | 0.03 | |
| together | qwen-2-1.5b-instruct | ⚡Ping | ok | <$0.01 | 1901ms | — | 0.10 | 0.10 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | { }JSON Output | pass | <$0.01 | 2077ms | — | 0.03 | 0.03 | |
| gemini | gemini-3.1-flash-lite-image | ⚡Ping | ok | <$0.01 | 1290ms | — | 0.25 | 1.50 | |
| openrouter | solar-mini4 | ⚡Ping | ok | <$0.01 | 606ms | — | 0.05 | 0.20 | |
| openrouter | deepseek-v3.2-exp | ⚡Ping | ok | <$0.01 | 1892ms | — | 0.27 | 0.41 | |
| deepinfra | DeepSeek-V4.1-Flash | ⚡Ping | ok | <$0.01 | 1395ms | — | 0.20 | 0.60 | |
| openrouter | qwen3-coder-next | ⚡Ping | ok | <$0.01 | 469ms | — | 0.12 | 0.80 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | ⚡Ping | ok | <$0.01 | 949ms | — | 0.07 | 0.20 | |
| openrouter | deepseek-v3.2 | ⚡Ping | ok | <$0.01 | 772ms | — | 0.26 | 0.38 | |
| openrouter | deepseek-v4.1-flash-1017 | ⚡Ping | ok | <$0.01 | 905ms | — | 0.02 | 0.19 | |
| openrouter | mistral-nemo | 💻Code Gen | ok | <$0.01 | 374ms | — | 0.03 | 0.03 | |
| openrouter | qwen3-coder-flash | ⚡Ping | ok | <$0.01 | 838ms | — | 0.20 | 0.97 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🔧Tool Use | pass | <$0.01 | 3424ms | — | 0.03 | 0.03 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 💻Code Gen | ok | <$0.01 | 6894ms | — | 0.03 | 0.03 | |
| openrouter | llama-3.1-8b-instruct | 🧮Reasoning | ok | <$0.01 | 625ms | — | 0.05 | 0.08 | |
| openrouter | deepseek-chat-v3.1 | ⚡Ping | ok | <$0.01 | 2424ms | — | 0.25 | 0.95 | |
| openrouter | llama-4-maverick | ⚡Ping | ok | <$0.01 | 1202ms | — | 0.19 | 0.65 | |
| openrouter | llama-3.2-1b-instruct | 🧮Reasoning | ok | <$0.01 | 202ms | — | 0.03 | 0.20 | |
| openrouter | deepseek-v3.1-terminus | ⚡Ping | ok | <$0.01 | 1656ms | — | 0.27 | 1.00 | |
| openrouter | codestral-2508 | ⚡Ping | ok | <$0.01 | 605ms | — | 0.30 | 0.90 | |
| openrouter | llama-3.3-70b-instruct | ⚡Ping | ok | <$0.01 | 437ms | — | 0.10 | 0.32 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 💻Code Gen | ok | <$0.01 | 3946ms | — | 0.02 | 0.04 | |
| deepinfra | DeepSeek-V3 | ⚡Ping | ok | <$0.01 | 9323ms | — | 0.32 | 0.89 | |
| openrouter | summarize | ⚡Ping | ok | <$0.01 | 1079ms | — | 0.04 | 0.00 | |
| deepinfra | DeepSeek-V3.1 | ⚡Ping | ok | <$0.01 | 1091ms | — | 0.27 | 1.00 | |
| openrouter | hy-mt2-1.8b | 🧮Reasoning | ok | <$0.01 | 466ms | — | 0.04 | 0.18 | |
| together | qwen-2-1.5b-instruct | 🧮Reasoning | ok | <$0.01 | 368ms | — | 0.10 | 0.10 | |
| openrouter | ling-3.0-flash | ⚡Ping | ok | <$0.01 | 911ms | — | 0.02 | 0.06 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🔍Context Recall | pass | <$0.01 | 2100ms | — | 0.02 | 0.04 | |
| openrouter | summarize | 🧮Reasoning | ok | <$0.01 | 1268ms | — | 0.04 | 0.00 | |
| openrouter | qwen-2.5-72b-instruct | ⚡Ping | ok | <$0.01 | 389ms | — | 0.36 | 0.40 | |
| openrouter | llama-3.1-8b-instruct | { }JSON Output | pass | <$0.01 | 597ms | — | 0.05 | 0.08 | |
| openrouter | summarize | 🚀Throughput | ok | <$0.01 | 863ms | — | 0.04 | 0.00 | |
| openrouter | gemma-3-12b-it | 🧮Reasoning | ok | <$0.01 | 380ms | — | 0.05 | 0.15 | |
| openrouter | unslopnemo-12b | ⚡Ping | ok | <$0.01 | 522ms | — | 0.40 | 0.40 | |
| openrouter | voxtral-small-24b-2507 | 🧮Reasoning | ok | <$0.01 | 690ms | — | 0.10 | 0.30 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 1076ms | — | 0.30 | 1.00 | |
| openrouter | nova-lite-v1 | 🧮Reasoning | ok | <$0.01 | 1008ms | — | 0.06 | 0.24 | |
| openrouter | mistral-nemo | 🔍Context Recall | pass | <$0.01 | 439ms | — | 0.03 | 0.03 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🔍Context Recall | pass | <$0.01 | 1699ms | — | 0.03 | 0.03 | |
| openrouter | mimo-v2.6-flash | ⚡Ping | ok | <$0.01 | 601ms | — | 0.14 | 0.28 | |
| openrouter | summarize | { }JSON Output | pass | <$0.01 | 1549ms | — | 0.04 | 0.00 | |
| openrouter | qwen3-vl-235b-a22b-instruct | ⚡Ping | ok | <$0.01 | 696ms | — | 0.21 | 1.90 | |
| openrouter | ministral-3b-2512 | 🧮Reasoning | ok | <$0.01 | 534ms | — | 0.10 | 0.10 | |
| openrouter | ling-3.0-flash | { }JSON Output | pass | <$0.01 | 827ms | — | 0.02 | 0.06 | |
| openrouter | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 1143ms | — | 0.02 | 0.09 | |
| openai | gpt-4.1-mini-2025-04-14 | ⚡Ping | ok | <$0.01 | 2458ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | ⚡Ping | ok | <$0.01 | 999ms | — | 0.40 | 1.60 | |
| openai | gpt-5.6-luna | ⚡Ping | ok | <$0.01 | 835ms | — | 0.20 | 1.20 | |
| openrouter | hy-mt2-1.8b | { }JSON Output | pass | <$0.01 | 418ms | — | 0.04 | 0.18 | |
| openrouter | granite-4.2-8b | ⚡Ping | ok | <$0.01 | 390ms | — | 0.06 | 0.15 | |
| openrouter | hy-mt2-7b | 🧮Reasoning | ok | <$0.01 | 397ms | — | 0.07 | 0.29 | |
| openrouter | sonar | ⚡Ping | ok | <$0.01 | 1518ms | — | 1.00 | 1.00 | |
| openrouter | ling-3.0-flash | 🧮Reasoning | ok | <$0.01 | 775ms | — | 0.02 | 0.06 | |
| openrouter | nova-lite-v1 | { }JSON Output | pass | <$0.01 | 1052ms | — | 0.06 | 0.24 | |
| openrouter | command-r7b-12-2024 | { }JSON Output | pass | <$0.01 | 451ms | — | 0.04 | 0.15 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | ⚡Ping | ok | <$0.01 | 995ms | — | 0.05 | 0.08 | |
| openai | gpt-6-luna | ⚡Ping | ok | <$0.01 | 1185ms | — | 0.10 | 0.50 | |
| deepinfra | GLM-5.3-Flash | ⚡Ping | ok | <$0.01 | 1904ms | — | 0.15 | 0.50 | |
| openrouter | llama-3.2-1b-instruct | 🔍Context Recall | pass | <$0.01 | 272ms | — | 0.03 | 0.20 | |
| openrouter | moondream3.1-9b-a2b | ⚡Ping | ok | <$0.01 | 455ms | — | 0.30 | 2.50 | |
| deepinfra | gemma-3-27b-it | 🧮Reasoning | ok | <$0.01 | 2267ms | — | 0.08 | 0.16 | |
| deepinfra | DeepSeek-V4-Flash | { }JSON Output | pass | <$0.01 | 1458ms | — | 0.09 | 0.18 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🧮Reasoning | ok | <$0.01 | 1211ms | — | 0.07 | 0.20 | |
| openrouter | deepseek-v4-flash | { }JSON Output | pass | <$0.01 | 1952ms | — | 0.09 | 0.18 | |
| openrouter | perceptron-mk1.5 | ⚡Ping | ok | <$0.01 | 769ms | — | 0.15 | 1.50 | |
| openrouter | perceptron-mk1 | ⚡Ping | ok | <$0.01 | 733ms | — | 0.15 | 1.50 | |
| openrouter | llama-3.2-1b-instruct | { }JSON Output | pass | <$0.01 | 607ms | — | 0.03 | 0.20 | |
| openrouter | reka-edge | { }JSON Output | pass | <$0.01 | 651ms | — | 0.10 | 0.10 | |
| deepinfra | gemma-3-27b-it | { }JSON Output | pass | <$0.01 | 3137ms | — | 0.08 | 0.16 | |
| openrouter | ministral-3b-2512 | { }JSON Output | pass | <$0.01 | 522ms | — | 0.10 | 0.10 | |
| openrouter | gemma-3-12b-it | { }JSON Output | pass | <$0.01 | 420ms | — | 0.05 | 0.15 | |
| deepinfra | gemma-3-12b-it | { }JSON Output | pass | <$0.01 | 2143ms | — | 0.05 | 0.15 | |
| deepinfra | DeepSeek-V4-Flash | 🧮Reasoning | ok | $0.010 | 2920ms | — | 0.09 | 0.18 | |
| openrouter | deepseek-v4-flash | 🧮Reasoning | ok | $0.010 | 1059ms | — | 0.09 | 0.18 | |
| openrouter | hy-mt2-7b | { }JSON Output | pass | $0.010 | 417ms | — | 0.07 | 0.29 | |
| openrouter | mistral-small-3.2-24b-instruct | 🧮Reasoning | ok | $0.010 | 1672ms | — | 0.07 | 0.20 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🔧Tool Use | pass | $0.011 | 1066ms | — | 0.07 | 0.20 | |
| openrouter | solar-mini4 | { }JSON Output | pass | $0.011 | 899ms | — | 0.05 | 0.20 | |
| openrouter | nex-n2.5-pro | { }JSON Output | pass | $0.011 | 2108ms | — | 0.07 | 0.25 | |
| openrouter | llama-3.1-8b-instruct | 💻Code Gen | ok | $0.011 | 630ms | — | 0.05 | 0.08 | |
| gemini | gemini-2.5-flash-lite | 🔧Tool Use | pass | $0.011 | 906ms | — | 0.07 | 0.30 | |
| openrouter | gpt-oss-20b | 🔍Context Recall | pass | $0.011 | 1841ms | — | 0.02 | 0.09 | |
| openrouter | hy-mt2-1.8b | 🔍Context Recall | pass | $0.011 | 398ms | — | 0.04 | 0.18 | |
| deepinfra | gpt-oss-120b | ⚡Ping | ok | $0.011 | 2207ms | — | 0.04 | 0.17 | |
| openrouter | hy-mt2-30b-a3b | 🧮Reasoning | ok | $0.012 | 381ms | — | 0.07 | 0.29 | |
| deepinfra | gemma-3-12b-it | 🧮Reasoning | ok | $0.012 | 2845ms | — | 0.05 | 0.15 | |
| openrouter | hy-mt2-30b-a3b | { }JSON Output | pass | $0.012 | 421ms | — | 0.07 | 0.29 | |
| openrouter | command-r7b-12-2024 | 🔍Context Recall | pass | $0.012 | 458ms | — | 0.04 | 0.15 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | { }JSON Output | pass | $0.012 | 1309ms | — | 0.10 | 0.30 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | { }JSON Output | pass | $0.012 | 1366ms | — | 0.07 | 0.20 | |
| openrouter | mistral-small-3.2-24b-instruct | { }JSON Output | pass | $0.012 | 856ms | — | 0.07 | 0.20 | |
| openrouter | command-r7b-12-2024 | 🧮Reasoning | ok | $0.012 | 708ms | — | 0.04 | 0.15 | |
| deepinfra | granite-4.2-8b | ⚡Ping | ok | $0.013 | 2012ms | — | 0.06 | 0.25 | |
| gemini | gemini-2.5-flash-lite | { }JSON Output | pass | $0.013 | 968ms | — | 0.07 | 0.30 | |
| deepinfra | gemma-4-26B-A4B-it | 🔧Tool Use | pass | $0.013 | 1045ms | — | 0.07 | 0.34 | |
| openrouter | mistral-medium-3 | ⚡Ping | ok | $0.013 | 643ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | ⚡Ping | ok | $0.013 | 1159ms | — | 0.40 | 2.00 | |
| openrouter | llama-3.2-3b-instruct | 🧮Reasoning | ok | $0.013 | 385ms | — | 0.05 | 0.33 | |
| openrouter | deepseek-v4.1-flash-1017 | 🔍Context Recall | pass | $0.013 | 599ms | — | 0.02 | 0.19 | |
| openrouter | deepseek-v4.1-flash | ⚡Ping | ok | $0.013 | 895ms | — | 0.04 | 0.50 | |
| openrouter | solar-mini4 | 🧮Reasoning | ok | $0.013 | 929ms | — | 0.05 | 0.20 | |
| openrouter | ling-3.0-flash | 🔍Context Recall | pass | $0.014 | 1343ms | — | 0.02 | 0.06 | |
| openrouter | summarize | 🔍Context Recall | pass | $0.014 | 2157ms | — | 0.04 | 0.00 | |
| openrouter | deepseek-v4-flash-0731 | ⚡Ping | ok | $0.014 | 1022ms | — | 0.12 | 0.24 | |
| openrouter | mercury-3 | ⚡Ping | ok | $0.014 | 348ms | — | 0.10 | 0.35 | |
| openrouter | laguna-xs-2.1 | ⚡Ping | ok | $0.014 | 434ms | — | 0.06 | 0.12 | |
| deepinfra | gemma-4-31B-it-turbo | 🧮Reasoning | ok | $0.014 | 1558ms | — | 0.09 | 0.34 | |
| openrouter | gemma-2-27b-it | ⚡Ping | ok | $0.014 | 723ms | — | 0.65 | 0.65 | |
| openrouter | kimi-k2 | ⚡Ping | ok | $0.014 | 1959ms | — | 0.57 | 2.30 | |
| openrouter | llama-3.2-3b-instruct | { }JSON Output | pass | $0.014 | 514ms | — | 0.05 | 0.33 | |
| openrouter | qwen3-coder-30b-a3b-instruct | { }JSON Output | pass | $0.014 | 1140ms | — | 0.07 | 0.28 | |
| openrouter | llama-3.1-8b-instruct | 🔍Context Recall | pass | $0.014 | 360ms | — | 0.05 | 0.08 | |
| openrouter | deepseek-v4-pro | ⚡Ping | ok | $0.014 | 963ms | — | 0.95 | 1.90 | |
| openrouter | llama-3.3-70b-instruct | 🧮Reasoning | ok | $0.014 | 544ms | — | 0.10 | 0.32 | |
| deepinfra | gpt-oss-120b | 🔧Tool Use | pass | $0.014 | 2367ms | — | 0.04 | 0.17 | |
| openrouter | llama-4-scout | 🧮Reasoning | ok | $0.014 | 367ms | — | 0.10 | 0.30 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | { }JSON Output | pass | $0.015 | 1523ms | — | 0.05 | 0.08 | |
| openrouter | kimi-k2-0905 | ⚡Ping | ok | $0.015 | 762ms | — | 0.60 | 2.50 | |
| deepinfra | gemma-4-31B-it-turbo | 🔧Tool Use | pass | $0.015 | 949ms | — | 0.09 | 0.34 | |
| openrouter | ministral-3b-2512 | 💻Code Gen | ok | $0.015 | 775ms | — | 0.10 | 0.10 | |
| openrouter | llama-4-scout | { }JSON Output | pass | $0.015 | 870ms | — | 0.10 | 0.30 | |
| openrouter | nova-pro-v1 | ⚡Ping | ok | $0.015 | 1220ms | — | 0.80 | 3.20 | |
| together | qwen-2-1.5b-instruct | 💻Code Gen | ok | $0.015 | 1128ms | — | 0.10 | 0.10 | |
| openrouter | solar-mini4 | 🔍Context Recall | pass | $0.016 | 1016ms | — | 0.05 | 0.20 | |
| openrouter | llama-3.3-70b-instruct | { }JSON Output | pass | $0.016 | 410ms | — | 0.10 | 0.32 | |
| deepinfra | Seed-2.0-mini | ⚡Ping | ok | $0.016 | 1889ms | — | 0.10 | 0.40 | |
| openrouter | mistral-nemo | 🚀Throughput | ok | $0.016 | 392ms | — | 0.03 | 0.03 | |
| deepinfra | gemma-4-31B-it-turbo | { }JSON Output | pass | $0.016 | 1416ms | — | 0.09 | 0.34 | |
| openrouter | gpt-oss-20b | 🧮Reasoning | ok | $0.016 | 745ms | — | 0.02 | 0.09 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🧮Reasoning | ok | $0.016 | 1067ms | — | 0.07 | 0.28 | |
| openrouter | hy3 | ⚡Ping | ok | $0.017 | 1260ms | — | 0.13 | 0.53 | |
| openrouter | gemma-3-27b-it | { }JSON Output | pass | $0.017 | 651ms | — | 0.08 | 0.35 | |
| openrouter | voxtral-small-24b-2507 | { }JSON Output | pass | $0.017 | 652ms | — | 0.10 | 0.30 | |
| openrouter | l3.1-euryale-70b | ⚡Ping | ok | $0.017 | 355ms | — | 0.85 | 0.85 | |
| deepinfra | gemma-4-26B-A4B-it | { }JSON Output | pass | $0.017 | 1099ms | — | 0.07 | 0.34 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 🧮Reasoning | ok | $0.017 | 2986ms | — | 0.05 | 0.08 | |
| deepinfra | gemma-4-26B-A4B-it | 🧮Reasoning | ok | $0.017 | 1251ms | — | 0.07 | 0.34 | |
| openrouter | remm-slerp-l2-13b | ⚡Ping | ok | $0.017 | 773ms | — | 0.35 | 0.65 | |
| openrouter | deepseek-v4.1-flash-1017 | 🧮Reasoning | ok | $0.017 | 1455ms | — | 0.02 | 0.19 | |
| openrouter | unslopnemo-12b | 🧮Reasoning | ok | $0.018 | 516ms | — | 0.40 | 0.40 | |
| gemini | gemini-3.6-flash | ⚡Ping | ok | $0.018 | 2585ms | — | 1.50 | 7.50 | |
| openrouter | hermes-3-llama-3.1-405b | ⚡Ping | ok | $0.018 | 362ms | — | 1.00 | 1.00 | |
| openrouter | nova-lite-v1 | 🔍Context Recall | pass | $0.018 | 794ms | — | 0.06 | 0.24 | |
| openrouter | qwen3-14b | ⚡Ping | ok | $0.018 | 394ms | — | 0.12 | 0.24 | |
| deepinfra | gemma-3-12b-it | 🔍Context Recall | pass | $0.018 | 2513ms | — | 0.05 | 0.15 | |
| gemini | gemini-2.5-flash-lite | 🧮Reasoning | ok | $0.018 | 928ms | — | 0.07 | 0.30 | |
| openrouter | qwen3.5-9b | { }JSON Output | pass | $0.018 | 615ms | — | 0.17 | 0.25 | |
| deepinfra | Qwen3.8-Flash | ⚡Ping | ok | $0.018 | 2330ms | — | 0.11 | 0.38 | |
| openrouter | llama-3.2-1b-instruct | 💻Code Gen | ok | $0.018 | 269ms | — | 0.03 | 0.20 | |
| openrouter | hy-mt2-7b | 🔍Context Recall | pass | $0.018 | 443ms | — | 0.07 | 0.29 | |
| openrouter | gemma-3-12b-it | 🔍Context Recall | pass | $0.019 | 796ms | — | 0.05 | 0.15 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | ⚡Ping | ok | $0.019 | 458ms | — | 0.60 | 2.40 | |
| deepinfra | DeepSeek-V4-Pro | ⚡Ping | ok | $0.019 | 990ms | — | 1.30 | 2.60 | |
| deepinfra | DeepSeek-V4-Pro-0813 | ⚡Ping | ok | $0.019 | 878ms | — | 1.30 | 2.60 | |
| gemini | gemini-3.5-flash | ⚡Ping | ok | $0.019 | 2183ms | — | 1.50 | 9.00 | |
| deepinfra | gemma-4-26B-A4B-it | 🔍Context Recall | pass | $0.020 | 1115ms | — | 0.07 | 0.34 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 💻Code Gen | ok | $0.020 | 4403ms | — | 0.05 | 0.08 | |
| openrouter | ternary-bonsai-2-27b | ⚡Ping | ok | $0.020 | 1230ms | — | 0.07 | 0.50 | |
| openai | gpt-4o-mini | 🔧Tool Use | pass | $0.020 | 970ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | 🔧Tool Use | pass | $0.020 | 840ms | — | 0.15 | 0.60 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 🔍Context Recall | pass | $0.020 | 1204ms | — | 0.05 | 0.08 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🧮Reasoning | ok | $0.021 | 469ms | — | 0.10 | 0.30 | |
| openrouter | relace-search | ⚡Ping | ok | $0.021 | 1665ms | — | 1.00 | 3.00 | |
| openrouter | glm-5.2 | ⚡Ping | ok | $0.021 | 1016ms | — | 0.01 | 7.00 | |
| openrouter | nex-n2.5-pro | 🔍Context Recall | pass | $0.021 | 448ms | — | 0.07 | 0.25 | |
| openrouter | gemma-3-27b-it | 🧮Reasoning | ok | $0.021 | 573ms | — | 0.08 | 0.35 | |
| deepinfra | MiMo-V2.6-Pro | ⚡Ping | ok | $0.022 | 1154ms | — | 0.43 | 0.87 | |
| openrouter | mimo-v2.6-pro | ⚡Ping | ok | $0.022 | 372ms | — | 0.43 | 0.87 | |
| deepinfra | GLM-5.3-Flash | 🧮Reasoning | ok | $0.022 | 1701ms | — | 0.15 | 0.50 | |
| groq | gpt-oss-20b | ⚡Ping | ok | $0.022 | 262ms | — | 0.10 | 0.50 | |
| openrouter | qwen3-235b-a22b-2507 | { }JSON Output | pass | $0.022 | 376ms | — | 0.09 | 0.55 | |
| together | NVIDIA-Nemotron-3.5-Super-VL | ⚡Ping | ok | $0.022 | 902ms | — | 0.15 | 0.50 | |
| openrouter | gpt-oss-20b | 💻Code Gen | ok | $0.022 | 711ms | — | 0.02 | 0.09 | |
| openrouter | hy3-preview | ⚡Ping | ok | $0.022 | 2041ms | — | 0.18 | 0.60 | |
| openrouter | deepseek-v4.1-flash-1017 | { }JSON Output | pass | $0.022 | 1572ms | — | 0.02 | 0.19 | |
| openrouter | reka-edge | 🔍Context Recall | pass | $0.023 | 777ms | — | 0.10 | 0.10 | |
| openrouter | gemma-3-12b-it | 💻Code Gen | ok | $0.023 | 698ms | — | 0.05 | 0.15 | |
| openrouter | nova-2-lite-v1 | ⚡Ping | ok | $0.023 | 1381ms | — | 0.30 | 2.50 | |
| openrouter | nemotron-3.5-super-vl | ⚡Ping | ok | $0.023 | 472ms | — | 0.15 | 0.50 | |
| gemini | gemini-2.5-flash-lite | 🔍Context Recall | pass | $0.023 | 946ms | — | 0.07 | 0.30 | |
| deepinfra | gemma-3-12b-it | 💻Code Gen | ok | $0.024 | 4886ms | — | 0.05 | 0.15 | |
| openrouter | deepseek-v3.2 | { }JSON Output | pass | $0.024 | 1109ms | — | 0.26 | 0.38 | |
| openrouter | gpt-oss-20b | { }JSON Output | pass | $0.024 | 341ms | — | 0.02 | 0.09 | |
| deepinfra | gpt-oss-120b | 🧮Reasoning | ok | $0.024 | 4622ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🔍Context Recall | pass | $0.024 | 1218ms | — | 0.10 | 0.30 | |
| deepinfra | gemma-4-31B-it-turbo | 🔍Context Recall | pass | $0.024 | 1014ms | — | 0.09 | 0.34 | |
| openrouter | ministral-3b-2512 | 🔍Context Recall | pass | $0.024 | 489ms | — | 0.10 | 0.10 | |
| openrouter | solar-mini4 | 💻Code Gen | ok | $0.024 | 628ms | — | 0.05 | 0.20 | |
| openrouter | mistral-small-3.2-24b-instruct | 💻Code Gen | ok | $0.025 | 765ms | — | 0.07 | 0.20 | |
| deepinfra | DeepSeek-V4.1-Flash | 🧮Reasoning | ok | $0.025 | 1223ms | — | 0.20 | 0.60 | |
| openrouter | deepseek-v4-flash-0731 | { }JSON Output | pass | $0.025 | 1077ms | — | 0.12 | 0.24 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🔍Context Recall | pass | $0.025 | 1554ms | — | 0.07 | 0.20 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 💻Code Gen | ok | $0.025 | 2309ms | — | 0.07 | 0.20 | |
| openrouter | hy-mt2-30b-a3b | 🔍Context Recall | pass | $0.025 | 398ms | — | 0.07 | 0.29 | |
| openrouter | llama-3.2-3b-instruct | 🔍Context Recall | pass | $0.025 | 435ms | — | 0.05 | 0.33 | |
| openrouter | mimo-v2.6-flash | 🧮Reasoning | ok | $0.025 | 594ms | — | 0.14 | 0.28 | |
| openrouter | reka-edge | 💻Code Gen | ok | $0.026 | 598ms | — | 0.10 | 0.10 | |
| deepinfra | DeepSeek-V4-Flash | 🔍Context Recall | pass | $0.026 | 1831ms | — | 0.09 | 0.18 | |
| deepinfra | gemma-3-27b-it | 💻Code Gen | ok | $0.026 | 4753ms | — | 0.08 | 0.16 | |
| openrouter | qwen-2.5-coder-32b-instruct | ⚡Ping | ok | $0.026 | 634ms | — | 0.66 | 1.00 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🔍Context Recall | pass | $0.026 | 1182ms | — | 0.07 | 0.28 | |
| deepinfra | DeepSeek-V4.1-Flash | { }JSON Output | pass | $0.026 | 1259ms | — | 0.20 | 0.60 | |
| openrouter | mistral-small-3.2-24b-instruct | 🔍Context Recall | pass | $0.026 | 755ms | — | 0.07 | 0.20 | |
| gemini | gemini-3.1-pro-preview-customtools | ⚡Ping | ok | $0.026 | 3001ms | — | 2.00 | 12.00 | |
| gemini | gemini-3-pro-image | ⚡Ping | ok | $0.026 | 2984ms | — | 2.00 | 12.00 | |
| gemini | gemini-3-pro-image-preview | ⚡Ping | ok | $0.026 | 3184ms | — | 2.00 | 12.00 | |
| openai | gpt-6-luna | 🔍Context Recall | pass | $0.026 | 1608ms | — | 0.10 | 0.50 | |
| openrouter | deepseek-v4-flash | 🔍Context Recall | pass | $0.026 | 1226ms | — | 0.09 | 0.18 | |
| openrouter | deepseek-v3.2-exp | { }JSON Output | pass | $0.027 | 1510ms | — | 0.27 | 0.41 | |
| deepinfra | gemma-3-27b-it | 🔍Context Recall | pass | $0.028 | 5259ms | — | 0.08 | 0.16 | |
| openai | gpt-5.4-mini-2026-03-17 | ⚡Ping | ok | $0.028 | 1024ms | — | 0.75 | 4.50 | |
| openai | gpt-5.4-mini | ⚡Ping | ok | $0.028 | 861ms | — | 0.75 | 4.50 | |
| deepinfra | gemma-3-27b-it | 🔧Tool Use | pass | $0.028 | 1807ms | — | 0.08 | 0.16 | |
| openrouter | ling-3.0-flash | 💻Code Gen | ok | $0.028 | 851ms | — | 0.02 | 0.06 | |
| deepinfra | gpt-oss-120b | { }JSON Output | pass | $0.028 | 4255ms | — | 0.04 | 0.17 | |
| openai | gpt-4o-mini | { }JSON Output | pass | $0.029 | 1094ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | { }JSON Output | pass | $0.029 | 963ms | — | 0.15 | 0.60 | |
| openrouter | gpt-oss-120b | ⚡Ping | ok | $0.029 | 625ms | — | 0.15 | 0.60 | |
| deepinfra | GLM-5.3-Flash | { }JSON Output | pass | $0.029 | 1320ms | — | 0.15 | 0.50 | |
| openrouter | hy-mt2-1.8b | 💻Code Gen | ok | $0.029 | 483ms | — | 0.04 | 0.18 | |
| openrouter | moondream3.1-9b-a2b | 🧮Reasoning | ok | $0.029 | 383ms | — | 0.30 | 2.50 | |
| openrouter | voxtral-small-24b-2507 | 🔍Context Recall | pass | $0.030 | 562ms | — | 0.10 | 0.30 | |
| openrouter | command-r-08-2024 | { }JSON Output | pass | $0.030 | 559ms | — | 0.15 | 0.60 | |
| openrouter | qwen-2.5-72b-instruct | 🧮Reasoning | ok | $0.030 | 800ms | — | 0.36 | 0.40 | |
| openrouter | command-r-08-2024 | 🧮Reasoning | ok | $0.030 | 1164ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-coder-next | { }JSON Output | pass | $0.030 | 582ms | — | 0.12 | 0.80 | |
| deepinfra | DeepSeek-V4-Flash | 💻Code Gen | ok | $0.031 | 5880ms | — | 0.09 | 0.18 | |
| openrouter | llama-4-maverick | { }JSON Output | pass | $0.031 | 1278ms | — | 0.19 | 0.65 | |
| openrouter | nova-lite-v1 | 💻Code Gen | ok | $0.031 | 983ms | — | 0.06 | 0.24 | |
| openai | gpt-4o-mini | 🧮Reasoning | ok | $0.032 | 1732ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-v3.2-exp | 🧮Reasoning | ok | $0.032 | 1431ms | — | 0.27 | 0.41 | |
| openrouter | nex-n2.5-pro | 🧮Reasoning | ok | $0.032 | 408ms | — | 0.07 | 0.25 | |
| openrouter | deepseek-v4-flash-vision-exp | ⚡Ping | ok | $0.032 | 431ms | — | 0.22 | 0.65 | |
| openrouter | deepseek-v4-flash-0731 | 🧮Reasoning | ok | $0.032 | 1073ms | — | 0.12 | 0.24 | |
| openrouter | ling-3.0-flash | 🚀Throughput | ok | $0.033 | 810ms | — | 0.02 | 0.06 | |
| openrouter | hy-mt2-7b | 💻Code Gen | ok | $0.033 | 431ms | — | 0.07 | 0.29 | |
| openrouter | deepseek-v4.1-flash | 🔍Context Recall | pass | $0.033 | 935ms | — | 0.04 | 0.50 | |
| openrouter | qwen3-14b | 💻Code Gen | ok | $0.033 | 451ms | — | 0.12 | 0.24 | |
| openrouter | longcat-2.0 | ⚡Ping | ok | $0.033 | 1158ms | — | 0.30 | 1.20 | |
| openrouter | lfm-2.5-24b-a2b | ⚡Ping | ok | $0.033 | 664ms | — | 0.05 | 0.70 | |
| openrouter | minimax-m3.1-flash | ⚡Ping | ok | $0.033 | 1056ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-235b-a22b-2507 | 🧮Reasoning | ok | $0.033 | 343ms | — | 0.09 | 0.55 | |
| openrouter | mercury-3 | { }JSON Output | pass | $0.034 | 365ms | — | 0.10 | 0.35 | |
| openrouter | qwen-2.5-72b-instruct | { }JSON Output | pass | $0.034 | 372ms | — | 0.36 | 0.40 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | 🔍Context Recall | pass | $0.034 | 13909ms | — | 0.10 | 0.30 | |
| anthropic | claude-haiku-4-5-20251001 | ⚡Ping | ok | $0.034 | 770ms | — | 1.00 | 5.00 | |
| openrouter | llama-3.3-70b-instruct | 🔍Context Recall | pass | $0.034 | 473ms | — | 0.10 | 0.32 | |
| openrouter | voxtral-small-24b-2507 | 💻Code Gen | ok | $0.034 | 500ms | — | 0.10 | 0.30 | |
| openrouter | mercury-3 | 🔍Context Recall | pass | $0.035 | 485ms | — | 0.10 | 0.35 | |
| openrouter | qwen3-coder-next | 🔍Context Recall | pass | $0.035 | 845ms | — | 0.12 | 0.80 | |
| openrouter | remm-slerp-l2-13b | 🧮Reasoning | ok | $0.035 | 945ms | — | 0.35 | 0.65 | |
| openrouter | llama-4-scout | 🔍Context Recall | pass | $0.035 | 405ms | — | 0.10 | 0.30 | |
| openrouter | ternary-bonsai-2-27b | 🔍Context Recall | pass | $0.035 | 1797ms | — | 0.07 | 0.50 | |
| openrouter | qwen3-235b-a22b-2507 | 🔍Context Recall | pass | $0.035 | 451ms | — | 0.09 | 0.55 | |
| openrouter | mimo-v2.6-flash | { }JSON Output | pass | $0.035 | 580ms | — | 0.14 | 0.28 | |
| openrouter | qwen3.7-flash | ⚡Ping | ok | $0.036 | 509ms | — | 0.03 | 0.13 | |
| openrouter | sonar-pro | ⚡Ping | ok | $0.036 | 1592ms | — | 3.00 | 15.00 | |
| openai | gpt-4.1 | ⚡Ping | ok | $0.036 | 1938ms | — | 2.00 | 8.00 | |
| openrouter | sonar-pro-search | ⚡Ping | ok | $0.036 | 2161ms | — | 3.00 | 15.00 | |
| openrouter | deepseek-chat-v3.1 | { }JSON Output | pass | $0.037 | 916ms | — | 0.25 | 0.95 | |
| openrouter | command-r-plus-08-2024 | ⚡Ping | ok | $0.037 | 710ms | — | 2.50 | 10.00 | |
| openrouter | command-a | ⚡Ping | ok | $0.037 | 5306ms | — | 2.50 | 10.00 | |
| openrouter | mimo-v2.5 | ⚡Ping | ok | $0.038 | 1261ms | — | 0.40 | 2.00 | |
| openrouter | gemma-3-27b-it | 🔍Context Recall | pass | $0.038 | 808ms | — | 0.08 | 0.35 | |
| openrouter | codestral-2508 | { }JSON Output | pass | $0.038 | 693ms | — | 0.30 | 0.90 | |
| openrouter | gpt-6.1-terra | ⚡Ping | ok | $0.038 | 2093ms | — | 1.00 | 5.00 | |
| openrouter | hy-mt2-30b-a3b | 💻Code Gen | ok | $0.038 | 405ms | — | 0.07 | 0.29 | |
| openrouter | mercury-2 | ⚡Ping | ok | $0.038 | 379ms | — | 0.25 | 0.75 | |
| deepinfra | GLM-5.3-Flash | 🔧Tool Use | pass | $0.039 | 1023ms | — | 0.15 | 0.50 | |
| openrouter | unslopnemo-12b | { }JSON Output | pass | $0.039 | 478ms | — | 0.40 | 0.40 | |
| deepinfra | DeepSeek-V4-Flash | 🔧Tool Use | pass | $0.040 | 2726ms | — | 0.09 | 0.18 | |
| deepinfra | DeepSeek-V3.1 | { }JSON Output | pass | $0.040 | 1724ms | — | 0.27 | 1.00 | |
| openrouter | deepseek-v4-flash-0731 | 🔍Context Recall | pass | $0.041 | 446ms | — | 0.12 | 0.24 | |
| deepinfra | Qwen3.8-Flash | { }JSON Output | pass | $0.041 | 2987ms | — | 0.11 | 0.38 | |
| deepinfra | DeepSeek-V3 | 🧮Reasoning | ok | $0.041 | 5971ms | — | 0.32 | 0.89 | |
| together | Qwen3.5-9B | ⚡Ping | ok | $0.041 | 19134ms | — | 0.17 | 0.25 | |
| openai | gpt-4o-mini-2024-07-18 | 🧮Reasoning | ok | $0.042 | 1119ms | — | 0.15 | 0.60 | |
| openrouter | step-3.5-flash | ⚡Ping | ok | $0.042 | 1188ms | — | 0.10 | 0.30 | |
| openrouter | llama-4-maverick | 🧮Reasoning | ok | $0.043 | 1248ms | — | 0.19 | 0.65 | |
| openrouter | qwen3.5-flash-02-23 | ⚡Ping | ok | $0.043 | 892ms | — | 0.07 | 0.26 | |
| openrouter | llama-3.1-8b-instruct | 🚀Throughput | ok | $0.043 | 413ms | — | 0.05 | 0.08 | |
| groq | gpt-oss-20b | 🔧Tool Use | pass | $0.044 | 302ms | — | 0.10 | 0.50 | |
| fireworks | gpt-oss-120b | ⚡Ping | ok | $0.044 | 715ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-chat-v3.1 | 🧮Reasoning | ok | $0.044 | 459ms | — | 0.25 | 0.95 | |
| openai | gpt-4o-2024-08-06 | ⚡Ping | ok | $0.045 | 1325ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | ⚡Ping | ok | $0.045 | 1972ms | — | 2.50 | 10.00 | |
| openrouter | nemotron-3.5-lightning | ⚡Ping | ok | $0.045 | 422ms | — | 0.07 | 0.20 | |
| openrouter | qwen3-14b | 🧮Reasoning | ok | $0.045 | 472ms | — | 0.12 | 0.24 | |
| openrouter | mimo-v2.6-flash | 🔍Context Recall | pass | $0.045 | 1105ms | — | 0.14 | 0.28 | |
| openrouter | beam-1.0-501b-a23b | ⚡Ping | ok | $0.045 | 734ms | — | 0.25 | 1.00 | |
| deepinfra | DeepSeek-V3 | { }JSON Output | pass | $0.046 | 3200ms | — | 0.32 | 0.89 | |
| openrouter | qwen3-coder-next | 🧮Reasoning | ok | $0.046 | 478ms | — | 0.12 | 0.80 | |
| openrouter | deepseek-v4.1-flash-1017 | 💻Code Gen | ok | $0.046 | 963ms | — | 0.02 | 0.19 | |
| openrouter | qwen3.8-27b | ⚡Ping | ok | $0.046 | 402ms | — | 0.15 | 1.88 | |
| deepinfra | DeepSeek-V4.1-Flash | 🔍Context Recall | pass | $0.046 | 1051ms | — | 0.20 | 0.60 | |
| openrouter | qwen3-30b-a3b | ⚡Ping | ok | $0.046 | 383ms | — | 0.12 | 0.50 | |
| openai | gpt-5.6-luna | 🧮Reasoning | ok | $0.047 | 1647ms | — | 0.20 | 1.20 | |
| openrouter | gpt-oss-20b | 🚀Throughput | ok | $0.047 | 767ms | — | 0.02 | 0.09 | |
| openai | gpt-4o-mini | 🔍Context Recall | pass | $0.047 | 2002ms | — | 0.15 | 0.60 | |
| gemini | gemini-3.1-flash-lite-image | 🔧Tool Use | pass | $0.047 | 549ms | — | 0.25 | 1.50 | |
| openrouter | perceptron-mk1.5 | { }JSON Output | pass | $0.048 | 426ms | — | 0.15 | 1.50 | |
| openrouter | perceptron-mk1 | { }JSON Output | pass | $0.048 | 804ms | — | 0.15 | 1.50 | |
| openai | gpt-4o-mini-2024-07-18 | 🔍Context Recall | pass | $0.048 | 1758ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-coder-flash | { }JSON Output | pass | $0.048 | 806ms | — | 0.20 | 0.97 | |
| openrouter | mistral-medium-3-5 | ⚡Ping | ok | $0.048 | 582ms | — | 1.50 | 7.50 | |
| gemini | gemini-2.5-flash-lite | 💻Code Gen | ok | $0.048 | 1154ms | — | 0.07 | 0.30 | |
| openrouter | mercury-3 | 🧮Reasoning | ok | $0.049 | 351ms | — | 0.10 | 0.35 | |
| openrouter | command-r-08-2024 | 🔍Context Recall | pass | $0.049 | 479ms | — | 0.15 | 0.60 | |
| openrouter | qwen3.5-9b | ⚡Ping | ok | $0.049 | 421ms | — | 0.17 | 0.25 | |
| deepinfra | gemma-4-26B-A4B-it | 💻Code Gen | ok | $0.049 | 2235ms | — | 0.07 | 0.34 | |
| openrouter | llama-4-scout | 💻Code Gen | ok | $0.050 | 671ms | — | 0.10 | 0.30 | |
| deepinfra | GLM-5.3-Flash | 🔍Context Recall | pass | $0.050 | 1598ms | — | 0.15 | 0.50 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 💻Code Gen | ok | $0.050 | 1840ms | — | 0.07 | 0.28 | |
| deepinfra | gemma-4-31B-it-turbo | 💻Code Gen | ok | $0.051 | 3140ms | — | 0.09 | 0.34 | |
| openrouter | deepseek-v3.1-terminus | { }JSON Output | pass | $0.051 | 1678ms | — | 0.27 | 1.00 | |
| deepinfra | NVIDIA-Nemotron-3.5-Super-VL | ⚡Ping | ok | $0.051 | 1375ms | — | 0.15 | 0.50 | |
| deepinfra | DeepSeek-V3.1 | 🧮Reasoning | ok | $0.052 | 2330ms | — | 0.27 | 1.00 | |
| together | qwen-2-1.5b-instruct | 🚀Throughput | ok | $0.052 | 1884ms | — | 0.10 | 0.10 | |
| openrouter | gemma-3-27b-it | 💻Code Gen | ok | $0.052 | 554ms | — | 0.08 | 0.35 | |
| deepinfra | Qwen3.8-Flash | 🔍Context Recall | pass | $0.052 | 2583ms | — | 0.11 | 0.38 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 💻Code Gen | ok | $0.052 | 247ms | — | 0.10 | 0.30 | |
| openrouter | deepseek-v4.1-flash | 🧮Reasoning | ok | $0.053 | 1126ms | — | 0.04 | 0.50 | |
| openrouter | llama-3.2-3b-instruct | 💻Code Gen | ok | $0.053 | 479ms | — | 0.05 | 0.33 | |
| openrouter | mimo-v2.6-flash | 💻Code Gen | ok | $0.053 | 676ms | — | 0.14 | 0.28 | |
| openrouter | ministral-3b-2512 | 🚀Throughput | ok | $0.053 | 463ms | — | 0.10 | 0.10 | |
| openrouter | reka-edge | 🚀Throughput | ok | $0.053 | 616ms | — | 0.10 | 0.10 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | { }JSON Output | pass | $0.054 | 1146ms | — | 0.30 | 1.00 | |
| openai | gpt-4.1-mini | 🔧Tool Use | pass | $0.054 | 1048ms | — | 0.40 | 1.60 | |
| fireworks | gpt-oss-120b | 🔧Tool Use | pass | $0.055 | 715ms | — | 0.15 | 0.60 | |
| openrouter | qwen-2.5-72b-instruct | 💻Code Gen | ok | $0.055 | 371ms | — | 0.36 | 0.40 | |
| openrouter | deepseek-v3.1-terminus | 🧮Reasoning | ok | $0.055 | 717ms | — | 0.27 | 1.00 | |
| openrouter | l3.1-euryale-70b | 🧮Reasoning | ok | $0.055 | 389ms | — | 0.85 | 0.85 | |
| deepinfra | Seed-1.8 | ⚡Ping | ok | $0.056 | 2276ms | — | 0.25 | 2.00 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🧮Reasoning | ok | $0.056 | 328ms | — | 0.66 | 1.00 | |
| deepinfra | gpt-oss-120b | 💻Code Gen | ok | $0.056 | 9263ms | — | 0.04 | 0.17 | |
| openai | gpt-5.6-luna | 🔍Context Recall | pass | $0.056 | 1318ms | — | 0.20 | 1.20 | |
| openrouter | gemma-2-27b-it | 🧮Reasoning | ok | $0.056 | 369ms | — | 0.65 | 0.65 | |
| deepinfra | Qwen3.8-Flash | 🧮Reasoning | ok | $0.056 | 3460ms | — | 0.11 | 0.38 | |
| openai | gpt-4.1-mini-2025-04-14 | { }JSON Output | pass | $0.056 | 852ms | — | 0.40 | 1.60 | |
| gemini | gemini-3.1-flash-lite-image | { }JSON Output | pass | $0.056 | 1060ms | — | 0.25 | 1.50 | |
| deepinfra | MiMo-V2.6-Pro | { }JSON Output | pass | $0.057 | 2966ms | — | 0.43 | 0.87 | |
| openai | gpt-6-luna | 💻Code Gen | ok | $0.057 | 2160ms | — | 0.10 | 0.50 | |
| openrouter | deepseek-v3.2-exp | 🔍Context Recall | pass | $0.057 | 1948ms | — | 0.27 | 0.41 | |
| openrouter | mimo-v2.6-pro | { }JSON Output | pass | $0.058 | 1382ms | — | 0.43 | 0.87 | |
| openrouter | perceptron-mk1.5 | 🔍Context Recall | pass | $0.058 | 803ms | — | 0.15 | 1.50 | |
| openrouter | remm-slerp-l2-13b | { }JSON Output | pass | $0.060 | 734ms | — | 0.35 | 0.65 | |
| openai | gpt-4.1-mini | { }JSON Output | pass | $0.060 | 1173ms | — | 0.40 | 1.60 | |
| deepinfra | Qwen3.8-Flash | 🔧Tool Use | pass | $0.060 | 2799ms | — | 0.11 | 0.38 | |
| openai | gpt-4.1-mini-2025-04-14 | 🧮Reasoning | ok | $0.060 | 1659ms | — | 0.40 | 1.60 | |
| openrouter | seed-2.0-lite | ⚡Ping | ok | $0.060 | 459ms | — | 0.25 | 2.00 | |
| openai | gpt-4.1-mini | 🧮Reasoning | ok | $0.060 | 1024ms | — | 0.40 | 1.60 | |
| groq | gpt-oss-120b | ⚡Ping | ok | $0.061 | 386ms | — | 0.15 | 0.75 | |
| openrouter | glm-4.5v | ⚡Ping | ok | $0.061 | 666ms | — | 0.60 | 1.80 | |
| openrouter | deepseek-v4.1-flash | { }JSON Output | pass | $0.061 | 1540ms | — | 0.04 | 0.50 | |
| deepinfra | GLM-5.3-Flash | 💻Code Gen | ok | $0.062 | 3148ms | — | 0.15 | 0.50 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔧Tool Use | pass | $0.062 | 980ms | — | 0.40 | 1.60 | |
| deepinfra | granite-4.2-8b | 🔍Context Recall | pass | $0.063 | 5735ms | — | 0.06 | 0.25 | |
| openai | gpt-6-luna | { }JSON Output | pass | $0.063 | 2869ms | — | 0.10 | 0.50 | |
| openrouter | command-r-08-2024 | 💻Code Gen | ok | $0.064 | 551ms | — | 0.15 | 0.60 | |
| together | Beam-1.0-501B-A23B | ⚡Ping | ok | $0.064 | 1056ms | — | 0.40 | 1.20 | |
| openrouter | seed-1.6-flash | { }JSON Output | pass | $0.064 | 256ms | — | 0.07 | 0.30 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | 🧮Reasoning | ok | $0.065 | 1491ms | — | 0.30 | 1.00 | |
| openrouter | qwen3-coder-flash | 🧮Reasoning | ok | $0.065 | 762ms | — | 0.20 | 0.97 | |
| openrouter | kimi-k2.7-code | ⚡Ping | ok | $0.065 | 2142ms | — | 0.60 | 3.50 | |
| openrouter | llama-3.3-70b-instruct | 💻Code Gen | ok | $0.065 | 386ms | — | 0.10 | 0.32 | |
| openrouter | deepseek-v3.2 | 🔍Context Recall | pass | $0.065 | 1199ms | — | 0.26 | 0.38 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | ⚡Ping | ok | $0.066 | 1832ms | — | 0.44 | 1.32 | |
| openrouter | qwen3-14b | { }JSON Output | pass | $0.068 | 390ms | — | 0.12 | 0.24 | |
| openrouter | llama-4-maverick | 🔍Context Recall | pass | $0.068 | 1142ms | — | 0.19 | 0.65 | |
| openai | gpt-6-luna | 🧮Reasoning | ok | $0.068 | 2149ms | — | 0.10 | 0.50 | |
| openrouter | glm-4.7-flash | ⚡Ping | ok | $0.068 | 685ms | — | 0.06 | 0.40 | |
| fireworks | gpt-oss-120b | 🧮Reasoning | ok | $0.068 | 1019ms | — | 0.15 | 0.60 | |
| openrouter | gemma-2-27b-it | { }JSON Output | pass | $0.069 | 755ms | — | 0.65 | 0.65 | |
| deepinfra | Mistral-Small-24B-Instruct-2501 | 🚀Throughput | ok | $0.070 | 11112ms | — | 0.05 | 0.08 | |
| openai | gpt-4o-mini-2024-07-18 | 💻Code Gen | ok | $0.070 | 1869ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | 💻Code Gen | ok | $0.071 | 1681ms | — | 0.15 | 0.60 | |
| openrouter | ternary-bonsai-2-27b | { }JSON Output | pass | $0.071 | 905ms | — | 0.07 | 0.50 | |
| openrouter | sonar | { }JSON Output | pass | $0.071 | 2310ms | — | 1.00 | 1.00 | |
| openrouter | gpt-oss-120b | 🧮Reasoning | ok | $0.071 | 957ms | — | 0.15 | 0.60 | |
| deepinfra | DeepSeek-V4.1-Flash | 💻Code Gen | ok | $0.071 | 1908ms | — | 0.20 | 0.60 | |
| deepinfra | Seed-2.0-mini | 🔍Context Recall | pass | $0.071 | 2623ms | — | 0.10 | 0.40 | |
| openrouter | l3.1-euryale-70b | { }JSON Output | pass | $0.071 | 374ms | — | 0.85 | 0.85 | |
| openrouter | qwen3-vl-235b-a22b-instruct | { }JSON Output | pass | $0.072 | 581ms | — | 0.21 | 1.90 | |
| openrouter | deepseek-v3.2-exp | 💻Code Gen | ok | $0.072 | 1272ms | — | 0.27 | 0.41 | |
| openrouter | sonar | 🧮Reasoning | ok | $0.073 | 1224ms | — | 1.00 | 1.00 | |
| deepinfra | MiMo-V2.6-Pro | 🔧Tool Use | pass | $0.073 | 1257ms | — | 0.43 | 0.87 | |
| openai | gpt-5.6-terra | ⚡Ping | ok | $0.074 | 981ms | — | 2.00 | 12.00 | |
| openrouter | deepseek-v4-flash-0731 | 💻Code Gen | ok | $0.074 | 452ms | — | 0.12 | 0.24 | |
| deepinfra | granite-4.2-8b | { }JSON Output | pass | $0.074 | 7520ms | — | 0.06 | 0.25 | |
| openrouter | gpt-oss-120b | 🔍Context Recall | pass | $0.075 | 1318ms | — | 0.15 | 0.60 | |
| together | Qwen3.5-9B | 🔧Tool Use | pass | $0.075 | 2279ms | — | 0.17 | 0.25 | |
| fireworks | gpt-oss-120b | 🔍Context Recall | pass | $0.075 | 607ms | — | 0.15 | 0.60 | |
| openrouter | codestral-2508 | 🔍Context Recall | pass | $0.075 | 864ms | — | 0.30 | 0.90 | |
| openrouter | qwen-2.5-coder-32b-instruct | { }JSON Output | pass | $0.075 | 349ms | — | 0.66 | 1.00 | |
| openrouter | command-r7b-12-2024 | 🚀Throughput | ok | $0.076 | 446ms | — | 0.04 | 0.15 | |
| groq | gpt-oss-120b | 🔧Tool Use | pass | $0.076 | 349ms | — | 0.15 | 0.75 | |
| openrouter | gpt-6.1-sol | ⚡Ping | ok | $0.076 | 702ms | — | 2.00 | 10.00 | |
| openrouter | hermes-3-llama-3.1-405b | 🧮Reasoning | ok | $0.076 | 388ms | — | 1.00 | 1.00 | |
| anthropic | claude-sonnet-5 | ⚡Ping | ok | $0.076 | 1141ms | — | 2.00 | 10.00 | |
| openrouter | deepseek-v3.2 | 🧮Reasoning | ok | $0.077 | 958ms | — | 0.26 | 0.38 | |
| openrouter | seed-1.6-flash | 🧮Reasoning | ok | $0.077 | 256ms | — | 0.07 | 0.30 | |
| openrouter | gemma-3-12b-it | 🚀Throughput | ok | $0.077 | 504ms | — | 0.05 | 0.15 | |
| openrouter | granite-4.2-8b | 🚀Throughput | ok | $0.078 | 366ms | — | 0.06 | 0.15 | |
| openrouter | deepseek-v3.1-terminus | 🔍Context Recall | pass | $0.079 | 640ms | — | 0.27 | 1.00 | |
| openrouter | mimo-v2.6-pro | 🧮Reasoning | ok | $0.079 | 372ms | — | 0.43 | 0.87 | |
| deepinfra | DeepSeek-V3.1 | 🔧Tool Use | pass | $0.079 | 4022ms | — | 0.27 | 1.00 | |
| openrouter | nemotron-3.5-super-vl | { }JSON Output | pass | $0.080 | 527ms | — | 0.15 | 0.50 | |
| groq | gpt-oss-20b | { }JSON Output | pass | $0.080 | 391ms | — | 0.10 | 0.50 | |
| openrouter | qwen3-coder-flash | 🔍Context Recall | pass | $0.080 | 494ms | — | 0.20 | 0.97 | |
| anthropic | claude-sonnet-5-5 | ⚡Ping | ok | $0.080 | 1056ms | — | 2.00 | 10.00 | |
| openrouter | mistral-medium-3 | 🧮Reasoning | ok | $0.080 | 724ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🧮Reasoning | ok | $0.080 | 1174ms | — | 0.40 | 2.00 | |
| openrouter | ternary-bonsai-2-27b | 🧮Reasoning | ok | $0.080 | 964ms | — | 0.07 | 0.50 | |
| openrouter | mercury-3 | 💻Code Gen | ok | $0.081 | 324ms | — | 0.10 | 0.35 | |
| openrouter | seed-2-1-turbo | ⚡Ping | ok | $0.081 | 424ms | — | 0.50 | 2.50 | |
| openrouter | deepseek-v4-flash-vision-exp | 🔍Context Recall | pass | $0.081 | 368ms | — | 0.22 | 0.65 | |
| openrouter | deepseek-chat-v3.1 | 🔍Context Recall | pass | $0.082 | 1144ms | — | 0.25 | 0.95 | |
| together | MiniMax-M3 | ⚡Ping | ok | $0.083 | 3424ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-v3.2 | 💻Code Gen | ok | $0.083 | 617ms | — | 0.26 | 0.38 | |
| openrouter | perceptron-mk1.5 | 🧮Reasoning | ok | $0.083 | 832ms | — | 0.15 | 1.50 | |
| openrouter | step-3.5-flash | 🔍Context Recall | pass | $0.084 | 1190ms | — | 0.10 | 0.30 | |
| openrouter | perceptron-mk1 | 🧮Reasoning | ok | $0.084 | 878ms | — | 0.15 | 1.50 | |
| openrouter | qwen-2.5-72b-instruct | 🔍Context Recall | pass | $0.085 | 403ms | — | 0.36 | 0.40 | |
| openrouter | perceptron-mk1 | 🔍Context Recall | pass | $0.085 | 786ms | — | 0.15 | 1.50 | |
| deepinfra | MiMo-V2.6-Pro | 🧮Reasoning | ok | $0.085 | 1447ms | — | 0.43 | 0.87 | |
| openrouter | gemma-2-27b-it | 💻Code Gen | ok | $0.085 | 361ms | — | 0.65 | 0.65 | |
| openrouter | step-5-preview | ⚡Ping | ok | $0.086 | 681ms | — | 1.00 | 2.70 | |
| openrouter | qwen3-coder-next | 💻Code Gen | ok | $0.086 | 522ms | — | 0.12 | 0.80 | |
| openrouter | minimax-m3.1-flash | 🧮Reasoning | ok | $0.086 | 696ms | — | 0.15 | 0.60 | |
| together | NVIDIA-Nemotron-3.5-Super-VL | { }JSON Output | pass | $0.086 | 590ms | — | 0.15 | 0.50 | |
| openrouter | deepseek-v4-flash-vision-exp | { }JSON Output | pass | $0.086 | 745ms | — | 0.22 | 0.65 | |
| openrouter | nova-pro-v1 | 🧮Reasoning | ok | $0.087 | 835ms | — | 0.80 | 3.20 | |
| deepinfra | Seed-2.0-pro | ⚡Ping | ok | $0.087 | 2532ms | — | 0.50 | 3.00 | |
| openrouter | devstral-2512 | { }JSON Output | pass | $0.088 | 1178ms | — | 0.40 | 2.00 | |
| openrouter | nex-n2.5-pro | 💻Code Gen | ok | $0.088 | 525ms | — | 0.07 | 0.25 | |
| deepinfra | Seed-2.0-mini | { }JSON Output | pass | $0.088 | 2958ms | — | 0.10 | 0.40 | |
| openrouter | hermes-3-llama-3.1-405b | { }JSON Output | pass | $0.088 | 375ms | — | 1.00 | 1.00 | |
| openrouter | seed-1.6-flash | ⚡Ping | ok | $0.088 | 315ms | — | 0.07 | 0.30 | |
| openrouter | qwen3-235b-a22b-2507 | 💻Code Gen | ok | $0.088 | 384ms | — | 0.09 | 0.55 | |
| deepinfra | DeepSeek-V3.1 | 🔍Context Recall | pass | $0.089 | 2652ms | — | 0.27 | 1.00 | |
| openrouter | hy-mt2-1.8b | 🚀Throughput | ok | $0.090 | 432ms | — | 0.04 | 0.18 | |
| groq | gpt-oss-120b | 🧮Reasoning | ok | $0.091 | 407ms | — | 0.15 | 0.75 | |
| openrouter | mistral-medium-3 | { }JSON Output | pass | $0.092 | 678ms | — | 0.40 | 2.00 | |
| openai | gpt-5.4-2026-03-05 | ⚡Ping | ok | $0.092 | 1193ms | — | 2.50 | 15.00 | |
| openrouter | glm-4.7-flash | { }JSON Output | pass | $0.093 | 445ms | — | 0.06 | 0.40 | |
| openrouter | minimax-m3.1-flash | { }JSON Output | pass | $0.093 | 477ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-14b | 🔍Context Recall | pass | $0.094 | 421ms | — | 0.12 | 0.24 | |
| openrouter | laguna-xs-2.1 | { }JSON Output | pass | $0.094 | 423ms | — | 0.06 | 0.12 | |
| openrouter | kimi-k2-0905 | 🧮Reasoning | ok | $0.094 | 846ms | — | 0.60 | 2.50 | |
| openrouter | qwen3.5-flash-02-23 | 🧮Reasoning | ok | $0.095 | 531ms | — | 0.07 | 0.26 | |
| deepinfra | NVIDIA-Nemotron-3.5-Super-VL | { }JSON Output | pass | $0.096 | 1115ms | — | 0.15 | 0.50 | |
| openrouter | codestral-2508 | 🧮Reasoning | ok | $0.096 | 621ms | — | 0.30 | 0.90 | |
| openrouter | morph-v3-large | ⚡Ping | ok | $0.097 | 760ms | — | 0.90 | 1.90 | |
| openrouter | unslopnemo-12b | 🔍Context Recall | pass | $0.097 | 470ms | — | 0.40 | 0.40 | |
| openrouter | inkling-small | ⚡Ping | ok | $0.098 | 365ms | — | 0.45 | 1.20 | |
| openrouter | seed-1.6-flash | 🔍Context Recall | pass | $0.098 | 355ms | — | 0.07 | 0.30 | |
| deepinfra | DeepSeek-V3 | 🔍Context Recall | pass | $0.099 | 13487ms | — | 0.32 | 0.89 | |
| openrouter | aion-2.0 | ⚡Ping | ok | $0.099 | 975ms | — | 0.80 | 1.60 | |
| openrouter | llama-3.2-1b-instruct | 🚀Throughput | ok | $0.102 | 424ms | — | 0.03 | 0.20 | |
| anthropic | claude-sonnet-4-5-20250929 | ⚡Ping | ok | $0.102 | 1209ms | — | 3.00 | 15.00 | |
| openrouter | mistral-small-3.2-24b-instruct | 🚀Throughput | ok | $0.102 | 806ms | — | 0.07 | 0.20 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | 🔍Context Recall | pass | $0.103 | 1208ms | — | 0.30 | 1.00 | |
| openrouter | moondream3.1-9b-a2b | 🔍Context Recall | pass | $0.104 | 355ms | — | 0.30 | 2.50 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🧮Reasoning | ok | $0.104 | 2138ms | — | 0.21 | 1.90 | |
| openrouter | solar-mini4 | 🚀Throughput | ok | $0.104 | 892ms | — | 0.05 | 0.20 | |
| openrouter | deepseek-v4-flash-vision-exp | 🧮Reasoning | ok | $0.104 | 1022ms | — | 0.22 | 0.65 | |
| openrouter | deepseek-chat-v3.1 | 💻Code Gen | ok | $0.105 | 448ms | — | 0.25 | 0.95 | |
| openrouter | seed-2.0-code | ⚡Ping | ok | $0.105 | 403ms | — | 0.50 | 3.00 | |
| openrouter | llama-4-maverick | 💻Code Gen | ok | $0.106 | 1129ms | — | 0.19 | 0.65 | |
| openai | gpt-5.6-luna | { }JSON Output | pass | $0.106 | 2128ms | — | 0.20 | 1.20 | |
| deepinfra | granite-4.2-8b | 🔧Tool Use | pass | $0.106 | 8314ms | — | 0.06 | 0.25 | |
| openrouter | glm-4.5-air | ⚡Ping | ok | $0.107 | 1234ms | — | 0.13 | 0.85 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | { }JSON Output | pass | $0.107 | 1126ms | — | 0.44 | 1.32 | |
| openrouter | qwen3.5-flash-02-23 | 🔍Context Recall | pass | $0.108 | 573ms | — | 0.07 | 0.26 | |
| openrouter | codestral-2508 | 💻Code Gen | ok | $0.108 | 577ms | — | 0.30 | 0.90 | |
| openrouter | laguna-xs-2.1 | 🔍Context Recall | pass | $0.109 | 431ms | — | 0.06 | 0.12 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🧮Reasoning | ok | $0.109 | 462ms | — | 0.60 | 2.40 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🔍Context Recall | pass | $0.109 | 502ms | — | 0.21 | 1.90 | |
| deepinfra | DeepSeek-V3 | 💻Code Gen | ok | $0.110 | 8425ms | — | 0.32 | 0.89 | |
| openrouter | minimax-m3.1-flash | 🔍Context Recall | pass | $0.110 | 886ms | — | 0.15 | 0.60 | |
| openrouter | minimax-m2.1 | ⚡Ping | ok | $0.110 | 1624ms | — | 0.30 | 1.20 | |
| openrouter | kimi-k2-0905 | { }JSON Output | pass | $0.110 | 1212ms | — | 0.60 | 2.50 | |
| gemini | gemini-3.1-flash-lite-image | 🔍Context Recall | pass | $0.111 | 677ms | — | 0.25 | 1.50 | |
| openrouter | glm-5 | ⚡Ping | ok | $0.111 | 2378ms | — | 1.00 | 3.20 | |
| openrouter | qwen3.7-flash | 🔍Context Recall | pass | $0.111 | 1624ms | — | 0.03 | 0.13 | |
| openrouter | seed-1.6 | ⚡Ping | ok | $0.112 | 425ms | — | 0.25 | 2.00 | |
| openrouter | mercury-2 | 🧮Reasoning | ok | $0.112 | 356ms | — | 0.25 | 0.75 | |
| deepinfra | NVIDIA-Nemotron-3.5-Super-VL | 🔧Tool Use | pass | $0.112 | 985ms | — | 0.15 | 0.50 | |
| deepinfra | NVIDIA-Nemotron-3.5-Super-VL | 🔍Context Recall | pass | $0.114 | 1325ms | — | 0.15 | 0.50 | |
| openrouter | deepseek-v3.1-terminus | 💻Code Gen | ok | $0.114 | 565ms | — | 0.27 | 1.00 | |
| gemini | gemini-3.1-flash-lite-image | 🧮Reasoning | ok | $0.114 | 1185ms | — | 0.25 | 1.50 | |
| openrouter | nemotron-3.5-super-vl | 🔍Context Recall | pass | $0.115 | 2245ms | — | 0.15 | 0.50 | |
| openrouter | mistral-medium-3 | 🔍Context Recall | pass | $0.115 | 592ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🔍Context Recall | pass | $0.115 | 999ms | — | 0.40 | 2.00 | |
| deepinfra | DeepSeek-V3.1 | 💻Code Gen | ok | $0.116 | 3291ms | — | 0.27 | 1.00 | |
| openrouter | moondream3.1-9b-a2b | { }JSON Output | pass | $0.116 | 862ms | — | 0.30 | 2.50 | |
| openrouter | beam-1.0-501b-a23b | 🔍Context Recall | pass | $0.117 | 582ms | — | 0.25 | 1.00 | |
| openrouter | mistral-large-4-0 | ⚡Ping | ok | $0.118 | 1036ms | — | 0.70 | 2.10 | |
| fireworks | gpt-oss-120b | { }JSON Output | pass | $0.119 | 1688ms | — | 0.15 | 0.60 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔍Context Recall | pass | $0.121 | 1132ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🔍Context Recall | pass | $0.121 | 995ms | — | 0.40 | 1.60 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | 🔧Tool Use | pass | $0.121 | 974ms | — | 0.30 | 1.00 | |
| together | Beam-1.0-501B-A23B | 🔧Tool Use | pass | $0.122 | 470ms | — | 0.40 | 1.20 | |
| openrouter | nova-lite-v1 | 🚀Throughput | ok | $0.122 | 969ms | — | 0.06 | 0.24 | |
| openrouter | qwen3.6-35b-a3b | ⚡Ping | ok | $0.122 | 1265ms | — | 0.10 | 0.90 | |
| groq | gpt-oss-20b | 🔍Context Recall | pass | $0.122 | 433ms | — | 0.10 | 0.50 | |
| openrouter | mimo-v2.5 | { }JSON Output | pass | $0.124 | 3621ms | — | 0.40 | 2.00 | |
| openrouter | mimo-v2.6-pro | 🔍Context Recall | pass | $0.124 | 399ms | — | 0.43 | 0.87 | |
| openrouter | laguna-xs-2.1 | 🧮Reasoning | ok | $0.124 | 403ms | — | 0.06 | 0.12 | |
| openrouter | remm-slerp-l2-13b | 🔍Context Recall | pass | $0.125 | 926ms | — | 0.35 | 0.65 | |
| together | DeepSeek-V4-Pro-0813 | ⚡Ping | ok | $0.125 | 1611ms | — | 1.32 | 3.96 | |
| openrouter | nex-n2.5-pro | 🚀Throughput | ok | $0.127 | 694ms | — | 0.07 | 0.25 | |
| openrouter | minimax-m2.7 | ⚡Ping | ok | $0.128 | 971ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-v4-pro | { }JSON Output | pass | $0.128 | 1295ms | — | 0.95 | 1.90 | |
| openrouter | nova-2-lite-v1 | { }JSON Output | pass | $0.131 | 1653ms | — | 0.30 | 2.50 | |
| openrouter | gpt-oss-120b | { }JSON Output | pass | $0.131 | 627ms | — | 0.15 | 0.60 | |
| openrouter | qwen3.5-9b | 🚀Throughput | ok | $0.132 | 441ms | — | 0.17 | 0.25 | |
| openrouter | kimi-k2.6 | ⚡Ping | ok | $0.133 | 478ms | — | 0.65 | 3.41 | |
| openrouter | qwen3.5-flash-02-23 | 🚀Throughput | ok | $0.133 | 248ms | — | 0.07 | 0.26 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | { }JSON Output | pass | $0.134 | 574ms | — | 0.60 | 2.40 | |
| deepinfra | DeepSeek-V3 | 🔧Tool Use | pass | $0.134 | 6718ms | — | 0.32 | 0.89 | |
| openrouter | mercury-2 | 🔍Context Recall | pass | $0.135 | 344ms | — | 0.25 | 0.75 | |
| openrouter | hy4-preview | ⚡Ping | ok | $0.138 | 375ms | — | 0.83 | 2.50 | |
| openrouter | aion-3.0-mini | ⚡Ping | ok | $0.139 | 812ms | — | 0.70 | 1.40 | |
| openrouter | sonar | 💻Code Gen | ok | $0.139 | 1152ms | — | 1.00 | 1.00 | |
| deepinfra | DeepSeek-V4-Flash | 🚀Throughput | ok | $0.139 | 31563ms | — | 0.09 | 0.18 | |
| together | NVIDIA-Nemotron-3.5-Super-VL | 🔧Tool Use | pass | $0.139 | 799ms | — | 0.15 | 0.50 | |
| openrouter | hermes-3-llama-3.1-405b | 💻Code Gen | ok | $0.140 | 361ms | — | 1.00 | 1.00 | |
| openrouter | glm-5v-turbo | ⚡Ping | ok | $0.142 | 1065ms | — | 1.20 | 4.00 | |
| openrouter | nova-pro-v1 | { }JSON Output | pass | $0.142 | 1149ms | — | 0.80 | 3.20 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🚀Throughput | ok | $0.143 | 1107ms | — | 0.07 | 0.28 | |
| openrouter | qwen3-30b-a3b | 🔍Context Recall | pass | $0.144 | 789ms | — | 0.12 | 0.50 | |
| deepinfra | Seed-2.0-mini | 🔧Tool Use | pass | $0.145 | 3303ms | — | 0.10 | 0.40 | |
| openrouter | longcat-2.0 | { }JSON Output | pass | $0.145 | 790ms | — | 0.30 | 1.20 | |
| openrouter | mercury-2 | { }JSON Output | pass | $0.145 | 362ms | — | 0.25 | 0.75 | |
| openrouter | mimo-v2.6-flash | 🚀Throughput | ok | $0.145 | 522ms | — | 0.14 | 0.28 | |
| openrouter | step-3.7-flash | ⚡Ping | ok | $0.145 | 2153ms | — | 0.20 | 1.15 | |
| openrouter | qwen3-30b-a3b | { }JSON Output | pass | $0.145 | 393ms | — | 0.12 | 0.50 | |
| openai | gpt-5.4-mini-2026-03-17 | { }JSON Output | pass | $0.146 | 1086ms | — | 0.75 | 4.50 | |
| openai | gpt-5.4-mini | { }JSON Output | pass | $0.146 | 964ms | — | 0.75 | 4.50 | |
| openrouter | qwen3.8-27b | 🔍Context Recall | pass | $0.146 | 389ms | — | 0.15 | 1.88 | |
| deepinfra | DeepSeek-V4-Pro-0813 | 🧮Reasoning | ok | $0.147 | 1929ms | — | 1.30 | 2.60 | |
| openrouter | hy-mt2-7b | 🚀Throughput | ok | $0.150 | 526ms | — | 0.07 | 0.29 | |
| groq | gpt-oss-120b | 🔍Context Recall | pass | $0.151 | 566ms | — | 0.15 | 0.75 | |
| openrouter | hy-mt2-30b-a3b | 🚀Throughput | ok | $0.151 | 413ms | — | 0.07 | 0.29 | |
| openrouter | beam-1.0-501b-a23b | 🧮Reasoning | ok | $0.151 | 512ms | — | 0.25 | 1.00 | |
| groq | gpt-oss-120b | { }JSON Output | pass | $0.151 | 596ms | — | 0.15 | 0.75 | |
| deepinfra | DeepSeek-V4-Pro | { }JSON Output | pass | $0.152 | 1275ms | — | 1.30 | 2.60 | |
| deepinfra | DeepSeek-V4-Pro | 🧮Reasoning | ok | $0.152 | 1179ms | — | 1.30 | 2.60 | |
| openrouter | beam-1.0-501b-a23b | { }JSON Output | pass | $0.152 | 589ms | — | 0.25 | 1.00 | |
| openrouter | hy3-preview | { }JSON Output | pass | $0.153 | 1961ms | — | 0.18 | 0.60 | |
| openrouter | mimo-v2.5-pro | ⚡Ping | ok | $0.153 | 3400ms | — | 0.48 | 1.80 | |
| openrouter | voxtral-small-24b-2507 | 🚀Throughput | ok | $0.153 | 520ms | — | 0.10 | 0.30 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🚀Throughput | ok | $0.154 | 11906ms | — | 0.07 | 0.20 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🚀Throughput | ok | $0.154 | 585ms | — | 0.10 | 0.30 | |
| openrouter | llama-4-scout | 🚀Throughput | ok | $0.154 | 612ms | — | 0.10 | 0.30 | |
| openrouter | step-3.5-flash | 🚀Throughput | ok | $0.154 | 1379ms | — | 0.10 | 0.30 | |
| groq | gpt-oss-20b | 🧮Reasoning | ok | $0.156 | 629ms | — | 0.10 | 0.50 | |
| openai | gpt-5.6-luna | 💻Code Gen | ok | $0.157 | 2176ms | — | 0.20 | 1.20 | |
| openrouter | glm-5.3-flashx | { }JSON Output | pass | $0.158 | 843ms | — | 0.37 | 1.25 | |
| openrouter | glm-4.5-air | { }JSON Output | pass | $0.158 | 381ms | — | 0.13 | 0.85 | |
| openrouter | muse-glimmer-30b | ⚡Ping | ok | $0.159 | 454ms | — | 0.30 | 1.20 | |
| deepinfra | MiMo-V2.6-Pro | 🔍Context Recall | pass | $0.160 | 1403ms | — | 0.43 | 0.87 | |
| openrouter | qwen3.7-flash | { }JSON Output | pass | $0.160 | 819ms | — | 0.03 | 0.13 | |
| openrouter | gpt-6-luna-pro | ⚡Ping | ok | $0.161 | 575ms | — | 0.10 | 0.50 | |
| openrouter | mercury-2 | 💻Code Gen | ok | $0.161 | 328ms | — | 0.25 | 0.75 | |
| deepinfra | DeepSeek-V4-Pro-0813 | { }JSON Output | pass | $0.163 | 1173ms | — | 1.30 | 2.60 | |
| together | NVIDIA-Nemotron-3.5-Super-VL | 🔍Context Recall | pass | $0.163 | 896ms | — | 0.15 | 0.50 | |
| openrouter | qwen3-vl-30b-a3b-thinking | ⚡Ping | ok | $0.164 | 1183ms | — | 0.29 | 1.00 | |
| openrouter | llama-3.3-70b-instruct | 🚀Throughput | ok | $0.164 | 662ms | — | 0.10 | 0.32 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | 🔍Context Recall | pass | $0.165 | 1247ms | — | 0.44 | 1.32 | |
| openrouter | mimo-v2.5 | 🧮Reasoning | ok | $0.165 | 1171ms | — | 0.40 | 2.00 | |
| openrouter | llama-3.2-3b-instruct | 🚀Throughput | ok | $0.167 | 534ms | — | 0.05 | 0.33 | |
| openrouter | relace-search | { }JSON Output | pass | $0.168 | 1282ms | — | 1.00 | 3.00 | |
| openrouter | deepseek-v4.1-flash | 💻Code Gen | ok | $0.170 | 684ms | — | 0.04 | 0.50 | |
| anthropic | claude-opus-4-6 | ⚡Ping | ok | $0.170 | 4568ms | — | 5.00 | 25.00 | |
| openrouter | gpt-oss-120b | 💻Code Gen | ok | $0.172 | 1246ms | — | 0.15 | 0.60 | |
| openrouter | gemma-2-27b-it | 🔍Context Recall | pass | $0.174 | 464ms | — | 0.65 | 0.65 | |
| openai | gpt-5.4-mini-2026-03-17 | 🧮Reasoning | ok | $0.175 | 1056ms | — | 0.75 | 4.50 | |
| openai | gpt-5.4-mini | 🧮Reasoning | ok | $0.175 | 1186ms | — | 0.75 | 4.50 | |
| together | Beam-1.0-501B-A23B | 🔍Context Recall | pass | $0.175 | 510ms | — | 0.40 | 1.20 | |
| openrouter | gpt-6.1-terra | { }JSON Output | pass | $0.176 | 905ms | — | 1.00 | 5.00 | |
| openrouter | inkling-small | { }JSON Output | pass | $0.176 | 355ms | — | 0.45 | 1.20 | |
| openrouter | qwen3-30b-a3b | 🧮Reasoning | ok | $0.177 | 377ms | — | 0.12 | 0.50 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🔍Context Recall | pass | $0.177 | 340ms | — | 0.66 | 1.00 | |
| openrouter | gemma-3-27b-it | 🚀Throughput | ok | $0.178 | 585ms | — | 0.08 | 0.35 | |
| openrouter | qwen3.7-flash | 🧮Reasoning | ok | $0.179 | 830ms | — | 0.03 | 0.13 | |
| openrouter | nemotron-3.5-super-vl | 💻Code Gen | ok | $0.180 | 1485ms | — | 0.15 | 0.50 | |
| openrouter | qwen3-coder-flash | 💻Code Gen | ok | $0.181 | 700ms | — | 0.20 | 0.97 | |
| openai | gpt-4.1-mini | 💻Code Gen | ok | $0.181 | 1705ms | — | 0.40 | 1.60 | |
| openrouter | morph-v3-large | 🧮Reasoning | ok | $0.183 | 735ms | — | 0.90 | 1.90 | |
| together | MiniMax-M3 | 🔧Tool Use | pass | $0.183 | 636ms | — | 0.30 | 1.20 | |
| deepinfra | GLM-4.7 | ⚡Ping | ok | $0.183 | 4393ms | — | 0.40 | 1.75 | |
| openrouter | glm-4.7-flash | 🔍Context Recall | pass | $0.183 | 441ms | — | 0.06 | 0.40 | |
| openai | gpt-4.1-mini-2025-04-14 | 💻Code Gen | ok | $0.186 | 1445ms | — | 0.40 | 1.60 | |
| openrouter | nova-2-lite-v1 | 🧮Reasoning | ok | $0.186 | 1050ms | — | 0.30 | 2.50 | |
| openrouter | hy3 | { }JSON Output | pass | $0.186 | 1504ms | — | 0.13 | 0.53 | |
| together | Beam-1.0-501B-A23B | { }JSON Output | pass | $0.188 | 521ms | — | 0.40 | 1.20 | |
| openrouter | moondream3.1-9b-a2b | 💻Code Gen | ok | $0.189 | 366ms | — | 0.30 | 2.50 | |
| together | MiniMax-M3 | { }JSON Output | pass | $0.189 | 1289ms | — | 0.30 | 1.20 | |
| openrouter | step-3.7-flash | 🔍Context Recall | pass | $0.190 | 2143ms | — | 0.20 | 1.15 | |
| anthropic | claude-opus-5 | ⚡Ping | ok | $0.190 | 1032ms | — | 5.00 | 25.00 | |
| together | Muse-Glimmer-30B | ⚡Ping | ok | $0.190 | 3802ms | — | 0.35 | 1.50 | |
| openrouter | glm-5.3-flashx | 🧮Reasoning | ok | $0.190 | 1265ms | — | 0.37 | 1.25 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🧮Reasoning | ok | $0.191 | 619ms | — | 0.60 | 2.40 | |
| openrouter | mimo-v2.5 | 🔍Context Recall | pass | $0.191 | 1215ms | — | 0.40 | 2.00 | |
| deepinfra | granite-4.2-8b | 🚀Throughput | ok | $0.192 | 19160ms | — | 0.06 | 0.25 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | 🧮Reasoning | ok | $0.192 | 1978ms | — | 0.44 | 1.32 | |
| openrouter | morph-v3-large | { }JSON Output | pass | $0.192 | 683ms | — | 0.90 | 1.90 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔍Context Recall | pass | $0.193 | 519ms | — | 0.60 | 2.40 | |
| together | Qwen3.5-9B | 🚀Throughput | ok | $0.196 | 9484ms | — | 0.17 | 0.25 | |
| openrouter | perceptron-mk1 | 💻Code Gen | ok | $0.196 | 902ms | — | 0.15 | 1.50 | |
| groq | gpt-oss-20b | 💻Code Gen | ok | $0.198 | 695ms | — | 0.10 | 0.50 | |
| openrouter | deepseek-v3.2 | 🚀Throughput | ok | $0.200 | 663ms | — | 0.26 | 0.38 | |
| openrouter | hy3-preview | 🧮Reasoning | ok | $0.201 | 1896ms | — | 0.18 | 0.60 | |
| openrouter | perceptron-mk1.5 | 💻Code Gen | ok | $0.202 | 398ms | — | 0.15 | 1.50 | |
| openrouter | ternary-bonsai-2-27b | 💻Code Gen | ok | $0.204 | 1437ms | — | 0.07 | 0.50 | |
| openrouter | nemotron-3.5-lightning | 🔍Context Recall | pass | $0.205 | 384ms | — | 0.07 | 0.20 | |
| openrouter | minimax-m2.5 | { }JSON Output | pass | $0.207 | 533ms | — | 0.30 | 1.20 | |
| openrouter | relace-search | 🧮Reasoning | ok | $0.207 | 1735ms | — | 1.00 | 3.00 | |
| openrouter | deepseek-v4-pro | 🔍Context Recall | pass | $0.208 | 2126ms | — | 0.95 | 1.90 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 💻Code Gen | ok | $0.208 | 682ms | — | 0.21 | 1.90 | |
| openrouter | l3.1-euryale-70b | 🔍Context Recall | pass | $0.208 | 377ms | — | 0.85 | 0.85 | |
| openrouter | mimo-v2.6-pro-ultraspeed | ⚡Ping | ok | $0.209 | 4681ms | — | 4.35 | 8.70 | |
| openai | gpt-5.4-mini-2026-03-17 | 🔍Context Recall | pass | $0.209 | 945ms | — | 0.75 | 4.50 | |
| openai | gpt-5.4-mini | 🔍Context Recall | pass | $0.209 | 1383ms | — | 0.75 | 4.50 | |
| openrouter | glm-4.7-flash | 🧮Reasoning | ok | $0.210 | 595ms | — | 0.06 | 0.40 | |
| openrouter | sonar | 🔍Context Recall | pass | $0.212 | 3075ms | — | 1.00 | 1.00 | |
| openrouter | nemotron-3.5-lightning | { }JSON Output | pass | $0.213 | 957ms | — | 0.07 | 0.20 | |
| openrouter | qwen-2.5-72b-instruct | 🚀Throughput | ok | $0.214 | 347ms | — | 0.36 | 0.40 | |
| together | NVIDIA-Nemotron-3.5-Super-VL | 💻Code Gen | ok | $0.214 | 1076ms | — | 0.15 | 0.50 | |
| together | GLM-5.3 | ⚡Ping | ok | $0.216 | 1109ms | — | 1.40 | 4.40 | |
| openrouter | l3.1-euryale-70b | 💻Code Gen | ok | $0.219 | 396ms | — | 0.85 | 0.85 | |
| deepinfra | NVIDIA-Nemotron-3.5-Super-VL | 💻Code Gen | ok | $0.220 | 1521ms | — | 0.15 | 0.50 | |
| openai | gpt-5.4-mini-2026-03-17 | 🔧Tool Use | pass | $0.222 | 1061ms | — | 0.75 | 4.50 | |
| openai | gpt-5.4-mini | 🔧Tool Use | pass | $0.222 | 819ms | — | 0.75 | 4.50 | |
| fireworks | gpt-oss-120b | 💻Code Gen | ok | $0.223 | 2813ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | 💻Code Gen | ok | $0.224 | 2022ms | — | 0.30 | 1.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | { }JSON Output | pass | $0.225 | 1164ms | — | 0.29 | 1.00 | |
| gemini | gemini-3.1-flash-lite-image | 💻Code Gen | ok | $0.226 | 1088ms | — | 0.25 | 1.50 | |
| openrouter | glimpse | ⚡Ping | ok | $0.226 | 624ms | — | 0.60 | 3.00 | |
| openrouter | kimi-k2-0905 | 🔍Context Recall | pass | $0.228 | 723ms | — | 0.60 | 2.50 | |
| openrouter | longcat-2.0 | 🔍Context Recall | pass | $0.229 | 1017ms | — | 0.30 | 1.20 | |
| openrouter | hermes-3-llama-3.1-405b | 🔍Context Recall | pass | $0.231 | 366ms | — | 1.00 | 1.00 | |
| openrouter | granite-4.2-8b | 🧮Reasoning | ok | $0.231 | 945ms | — | 0.06 | 0.15 | |
| openrouter | devstral-2512 | 💻Code Gen | ok | $0.237 | 1216ms | — | 0.40 | 2.00 | |
| openrouter | hy3-preview | 🔍Context Recall | pass | $0.239 | 2096ms | — | 0.18 | 0.60 | |
| openrouter | glm-5.3-flashx | ⚡Ping | ok | $0.240 | 925ms | — | 0.37 | 1.25 | |
| groq | gpt-oss-120b | 💻Code Gen | ok | $0.240 | 863ms | — | 0.15 | 0.75 | |
| openrouter | seed-1.6 | { }JSON Output | pass | $0.241 | 473ms | — | 0.25 | 2.00 | |
| openrouter | glm-5.3-flashx | 🔍Context Recall | pass | $0.241 | 860ms | — | 0.37 | 1.25 | |
| openrouter | minimax-m2.7 | 🔍Context Recall | pass | $0.242 | 324ms | — | 0.30 | 1.20 | |
| openrouter | laguna-xs-2.1 | 💻Code Gen | ok | $0.243 | 436ms | — | 0.06 | 0.12 | |
| anthropic | claude-haiku-4-5-20251001 | 🧮Reasoning | ok | $0.247 | 934ms | — | 1.00 | 5.00 | |
| openrouter | mistral-medium-3 | 💻Code Gen | ok | $0.247 | 516ms | — | 0.40 | 2.00 | |
| openrouter | mimo-v2.6-pro | 💻Code Gen | ok | $0.250 | 397ms | — | 0.43 | 0.87 | |
| openrouter | nemotron-3.5-lightning | 🧮Reasoning | ok | $0.252 | 531ms | — | 0.07 | 0.20 | |
| openrouter | gpt-6-luna-pro | 🔍Context Recall | pass | $0.253 | 719ms | — | 0.10 | 0.50 | |
| together | MiniMax-M3 | 🧮Reasoning | ok | $0.253 | 2546ms | — | 0.30 | 1.20 | |
| openrouter | nova-2-lite-v1 | 🔍Context Recall | pass | $0.254 | 1031ms | — | 0.30 | 2.50 | |
| openrouter | deepseek-v4-pro | 🧮Reasoning | ok | $0.255 | 1603ms | — | 0.95 | 1.90 | |
| deepinfra | Seed-2.0-mini | 🧮Reasoning | ok | $0.257 | 5863ms | — | 0.10 | 0.40 | |
| gemini | gemini-3.6-flash | 🔧Tool Use | pass | $0.257 | 1430ms | — | 1.50 | 7.50 | |
| openrouter | morph-v3-large | 💻Code Gen | ok | $0.259 | 459ms | — | 0.90 | 1.90 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔧Tool Use | pass | $0.259 | 601ms | — | 0.60 | 2.40 | |
| openrouter | inkling-small | 💻Code Gen | ok | $0.260 | 385ms | — | 0.45 | 1.20 | |
| deepinfra | gemma-4-26B-A4B-it | 🚀Throughput | ok | $0.260 | 13300ms | — | 0.07 | 0.34 | |
| openrouter | deepseek-v4-flash-vision-exp | 💻Code Gen | ok | $0.261 | 462ms | — | 0.22 | 0.65 | |
| openrouter | kimi-k2 | 💻Code Gen | ok | $0.261 | 1193ms | — | 0.57 | 2.30 | |
| openrouter | inkling | ⚡Ping | ok | $0.261 | 637ms | — | 1.00 | 4.05 | |
| openrouter | longcat-2.0 | 🧮Reasoning | ok | $0.263 | 1051ms | — | 0.30 | 1.20 | |
| openrouter | nemotron-3.5-lightning | 💻Code Gen | ok | $0.267 | 451ms | — | 0.07 | 0.20 | |
| openrouter | mimo-v2.5-pro | 🧮Reasoning | ok | $0.267 | 1122ms | — | 0.48 | 1.80 | |
| openrouter | gpt-6.1-terra | 🔍Context Recall | pass | $0.269 | 554ms | — | 1.00 | 5.00 | |
| openai | gpt-4.1 | 🔧Tool Use | pass | $0.270 | 1412ms | — | 2.00 | 8.00 | |
| openrouter | kimi-k2-0905 | 💻Code Gen | ok | $0.270 | 824ms | — | 0.60 | 2.50 | |
| openrouter | step-3.7-flash | { }JSON Output | pass | $0.272 | 2502ms | — | 0.20 | 1.15 | |
| deepinfra | GLM-4.7 | 🔧Tool Use | pass | $0.274 | 7257ms | — | 0.40 | 1.75 | |
| openrouter | glm-4.7 | ⚡Ping | ok | $0.274 | 3057ms | — | 0.54 | 1.98 | |
| openrouter | glm-4.7-flash | 💻Code Gen | ok | $0.274 | 509ms | — | 0.06 | 0.40 | |
| openrouter | gpt-6-luna-pro | 🧮Reasoning | ok | $0.275 | 1189ms | — | 0.10 | 0.50 | |
| openrouter | qwen3-235b-a22b-2507 | 🚀Throughput | ok | $0.278 | 362ms | — | 0.09 | 0.55 | |
| openrouter | qwen3.5-9b | 🔍Context Recall | pass | $0.280 | 867ms | — | 0.17 | 0.25 | |
| openrouter | glm-4.5v | { }JSON Output | pass | $0.281 | 621ms | — | 0.60 | 1.80 | |
| gemini | gemini-3.5-flash | 🔧Tool Use | pass | $0.284 | 1817ms | — | 1.50 | 9.00 | |
| deepinfra | DeepSeek-V4-Pro-0813 | 🔍Context Recall | pass | $0.285 | 2370ms | — | 1.30 | 2.60 | |
| gemini | gemini-3.6-flash | { }JSON Output | pass | $0.288 | 2702ms | — | 1.50 | 7.50 | |
| openrouter | command-r-plus-08-2024 | 🧮Reasoning | ok | $0.292 | 595ms | — | 2.50 | 10.00 | |
| openrouter | minimax-m2.5 | ⚡Ping | ok | $0.293 | 1575ms | — | 0.30 | 1.20 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 💻Code Gen | ok | $0.294 | 584ms | — | 0.60 | 2.40 | |
| anthropic | claude-haiku-4-5-20251001 | { }JSON Output | pass | $0.294 | 833ms | — | 1.00 | 5.00 | |
| openrouter | qwen3.7-flash | 💻Code Gen | ok | $0.294 | 534ms | — | 0.03 | 0.13 | |
| openrouter | muse-spark-open | ⚡Ping | ok | $0.296 | 3860ms | — | 1.25 | 4.25 | |
| openrouter | aion-3.5-mini | { }JSON Output | pass | $0.297 | 1775ms | — | 0.70 | 1.40 | |
| openrouter | qwen3.8-2.4t-a95b | ⚡Ping | ok | $0.298 | 1173ms | — | 2.00 | 6.00 | |
| openrouter | kimi-k2.7-code | 🔍Context Recall | pass | $0.298 | 1052ms | — | 0.60 | 3.50 | |
| together | MiniMax-M3 | 🔍Context Recall | pass | $0.299 | 1997ms | — | 0.30 | 1.20 | |
| together | Qwen3.5-9B | { }JSON Output | pass | $0.300 | 9260ms | — | 0.17 | 0.25 | |
| openrouter | command-r-08-2024 | 🚀Throughput | ok | $0.304 | 473ms | — | 0.15 | 0.60 | |
| openrouter | nemotron-3-ultra-550b-a55b | ⚡Ping | ok | $0.305 | 544ms | — | 0.60 | 2.40 | |
| anthropic | claude-haiku-4-5-20251001 | 🔍Context Recall | pass | $0.307 | 809ms | — | 1.00 | 5.00 | |
| openrouter | morph-v3-large | 🔍Context Recall | pass | $0.309 | 680ms | — | 0.90 | 1.90 | |
| gemini | gemini-2.5-flash-lite | 🚀Throughput | ok | $0.309 | 4374ms | — | 0.07 | 0.30 | |
| openrouter | qwen3.6-27b | ⚡Ping | ok | $0.313 | 388ms | — | 0.32 | 3.20 | |
| openrouter | gpt-oss-120b | 🚀Throughput | ok | $0.315 | 537ms | — | 0.15 | 0.60 | |
| openrouter | seed-2-1-turbo | { }JSON Output | pass | $0.319 | 3972ms | — | 0.50 | 2.50 | |
| openrouter | qwen3.8-27b | 🧮Reasoning | ok | $0.319 | 754ms | — | 0.15 | 1.88 | |
| together | Qwen3.5-9B | 🔍Context Recall | pass | $0.320 | 7890ms | — | 0.17 | 0.25 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🧮Reasoning | ok | $0.320 | 1811ms | — | 0.29 | 1.00 | |
| openrouter | qwen3.8-27b | { }JSON Output | pass | $0.323 | 684ms | — | 0.15 | 1.88 | |
| together | Qwen3.8-2.4T-A95B | ⚡Ping | ok | $0.328 | 1932ms | — | 2.00 | 6.00 | |
| openrouter | glm-4.5 | ⚡Ping | ok | $0.328 | 8893ms | — | 0.60 | 2.20 | |
| openrouter | mistral-medium-3-5 | { }JSON Output | pass | $0.329 | 821ms | — | 1.50 | 7.50 | |
| openrouter | relace-search | 🔍Context Recall | pass | $0.330 | 1183ms | — | 1.00 | 3.00 | |
| openrouter | llama-4-maverick | 🚀Throughput | ok | $0.334 | 1648ms | — | 0.19 | 0.65 | |
| openai | gpt-4o-2024-08-06 | 🔧Tool Use | pass | $0.338 | 1187ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | 🔧Tool Use | pass | $0.338 | 1129ms | — | 2.50 | 10.00 | |
| openrouter | minimax-m2.5 | 🔍Context Recall | pass | $0.338 | 2180ms | — | 0.30 | 1.20 | |
| openrouter | aion-2.0 | { }JSON Output | pass | $0.338 | 723ms | — | 0.80 | 1.60 | |
| openai | gpt-4.1 | { }JSON Output | pass | $0.338 | 1369ms | — | 2.00 | 8.00 | |
| openrouter | gpt-6-luna-pro | { }JSON Output | pass | $0.338 | 662ms | — | 0.10 | 0.50 | |
| gemini | gemini-3.5-flash | { }JSON Output | pass | $0.339 | 2952ms | — | 1.50 | 9.00 | |
| deepinfra | DeepSeek-V4-Pro | 🔍Context Recall | pass | $0.339 | 1569ms | — | 1.30 | 2.60 | |
| openrouter | step-3.7-flash | 🧮Reasoning | ok | $0.339 | 2859ms | — | 0.20 | 1.15 | |
| openrouter | qwen3.6-plus | ⚡Ping | ok | $0.341 | 3557ms | — | 0.33 | 1.95 | |
| openrouter | aion-3.0 | ⚡Ping | ok | $0.342 | 1618ms | — | 3.00 | 6.00 | |
| openrouter | nova-2-lite-v1 | 💻Code Gen | ok | $0.343 | 1023ms | — | 0.30 | 2.50 | |
| openrouter | remm-slerp-l2-13b | 🚀Throughput | ok | $0.349 | 779ms | — | 0.35 | 0.65 | |
| deepinfra | granite-4.2-8b | 🧮Reasoning | ok | $0.349 | 23014ms | — | 0.06 | 0.25 | |
| openrouter | gemma-2-27b-it | 🚀Throughput | ok | $0.350 | 363ms | — | 0.65 | 0.65 | |
| openrouter | lfm-2.5-24b-a2b | 🚀Throughput | ok | $0.352 | 655ms | — | 0.05 | 0.70 | |
| deepinfra | granite-4.2-8b | 💻Code Gen | ok | $0.352 | 15715ms | — | 0.06 | 0.25 | |
| deepinfra | Qwen3.5-27B | 🔧Tool Use | pass | $0.352 | 2890ms | — | 0.26 | 2.60 | |
| openai | gpt-4o-2024-08-06 | { }JSON Output | pass | $0.352 | 791ms | — | 2.50 | 10.00 | |
| gemini | gemini-3.6-flash | 🚀Throughput | ok | $0.352 | 6505ms | — | 1.50 | 7.50 | |
| openai | gpt-4o-2024-11-20 | { }JSON Output | pass | $0.352 | 1189ms | — | 2.50 | 10.00 | |
| openrouter | qwen3.7-plus | ⚡Ping | ok | $0.354 | 942ms | — | 0.32 | 1.28 | |
| together | NVIDIA-Nemotron-3.5-Super-VL | 🧮Reasoning | ok | $0.356 | 974ms | — | 0.15 | 0.50 | |
| gemini | gemini-3.6-flash | 🧮Reasoning | ok | $0.360 | 3321ms | — | 1.50 | 7.50 | |
| openrouter | mistral-medium-3-5 | 🧮Reasoning | ok | $0.360 | 552ms | — | 1.50 | 7.50 | |
| deepinfra | Seed-1.8 | 🔍Context Recall | pass | $0.362 | 4087ms | — | 0.25 | 2.00 | |
| openrouter | aion-3.5-mini | ⚡Ping | ok | $0.363 | 1661ms | — | 0.70 | 1.40 | |
| together | Beam-1.0-501B-A23B | 🧮Reasoning | ok | $0.370 | 971ms | — | 0.40 | 1.20 | |
| deepinfra | DeepSeek-V4-Pro-0813 | 💻Code Gen | ok | $0.372 | 1838ms | — | 1.30 | 2.60 | |
| openrouter | mercury-2 | 🚀Throughput | ok | $0.375 | 334ms | — | 0.25 | 0.75 | |
| gemini | gemini-3-pro-image-preview | 🔧Tool Use | pass | $0.378 | 3889ms | — | 2.00 | 12.00 | |
| openrouter | glm-5.3-prime | ⚡Ping | ok | $0.379 | 608ms | — | 2.80 | 8.80 | |
| openrouter | gpt-6-astra | ⚡Ping | ok | $0.380 | 1335ms | — | 10.00 | 50.00 | |
| deepinfra | Seed-1.8 | 🧮Reasoning | ok | $0.382 | 4717ms | — | 0.25 | 2.00 | |
| deepinfra | GLM-5.3-Flash | 🚀Throughput | ok | $0.384 | 16436ms | — | 0.15 | 0.50 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🔍Context Recall | pass | $0.388 | 1657ms | — | 0.29 | 1.00 | |
| openai | gpt-5.6-terra | { }JSON Output | pass | $0.388 | 1470ms | — | 2.00 | 12.00 | |
| groq | gpt-oss-20b | 🚀Throughput | ok | $0.388 | 1122ms | — | 0.10 | 0.50 | |
| openrouter | step-3.5-flash | { }JSON Output | pass | $0.390 | 1208ms | — | 0.10 | 0.30 | |
| openrouter | hy3 | 🧮Reasoning | ok | $0.391 | 2480ms | — | 0.13 | 0.53 | |
| openrouter | minimax-m2.1 | { }JSON Output | pass | $0.393 | 1971ms | — | 0.30 | 1.20 | |
| openai | gpt-4.1 | 🧮Reasoning | ok | $0.396 | 1510ms | — | 2.00 | 8.00 | |
| openrouter | gpt-6-luna-pro | 💻Code Gen | ok | $0.403 | 1072ms | — | 0.10 | 0.50 | |
| openrouter | qwen3-coder-next | 🚀Throughput | ok | $0.405 | 459ms | — | 0.12 | 0.80 | |
| gemini | gemini-3.5-flash | 🚀Throughput | ok | $0.405 | 6546ms | — | 1.50 | 9.00 | |
| openrouter | inkling-small | 🧮Reasoning | ok | $0.407 | 926ms | — | 0.45 | 1.20 | |
| openrouter | nova-pro-v1 | 💻Code Gen | ok | $0.407 | 696ms | — | 0.80 | 3.20 | |
| openrouter | nova-pro-v1 | 🔍Context Recall | pass | $0.408 | 2402ms | — | 0.80 | 3.20 | |
| openrouter | nemotron-3.5-super-vl | 🧮Reasoning | ok | $0.420 | 943ms | — | 0.15 | 0.50 | |
| together | DeepSeek-V4-Pro-0813 | 🧮Reasoning | ok | $0.424 | 1274ms | — | 1.32 | 3.96 | |
| gemini | gemini-3.5-flash | 🧮Reasoning | ok | $0.425 | 4917ms | — | 1.50 | 9.00 | |
| openrouter | glimpse | 🔍Context Recall | pass | $0.426 | 423ms | — | 0.60 | 3.00 | |
| openrouter | command-r-plus-08-2024 | { }JSON Output | pass | $0.427 | 1340ms | — | 2.50 | 10.00 | |
| openrouter | aion-3.0-mini | { }JSON Output | pass | $0.430 | 791ms | — | 0.70 | 1.40 | |
| openrouter | seed-2.0-lite | { }JSON Output | pass | $0.432 | 1028ms | — | 0.25 | 2.00 | |
| openrouter | qwen3.5-plus-02-15 | ⚡Ping | ok | $0.432 | 588ms | — | 0.26 | 1.56 | |
| openrouter | mistral-medium-3-5 | 🔍Context Recall | pass | $0.432 | 673ms | — | 1.50 | 7.50 | |
| openrouter | seed-1.6 | 🔍Context Recall | pass | $0.432 | 412ms | — | 0.25 | 2.00 | |
| openrouter | sonar-pro-search | { }JSON Output | pass | $0.435 | 3599ms | — | 3.00 | 15.00 | |
| openrouter | kimi-k3 | ⚡Ping | ok | $0.438 | 2103ms | — | 0.19 | 15.00 | |
| openrouter | gpt-6.1-terra | 🧮Reasoning | ok | $0.439 | 1145ms | — | 1.00 | 5.00 | |
| openrouter | inkling-small | 🔍Context Recall | pass | $0.439 | 374ms | — | 0.45 | 1.20 | |
| openrouter | aion-3.0-mini | 🔍Context Recall | pass | $0.440 | 1281ms | — | 0.70 | 1.40 | |
| openrouter | hy4-preview | 🔍Context Recall | pass | $0.442 | 1257ms | — | 0.83 | 2.50 | |
| openrouter | qwen3.8-max-0902 | ⚡Ping | ok | $0.442 | 1014ms | — | 2.00 | 6.00 | |
| deepinfra | Qwen3.5-27B | ⚡Ping | ok | $0.444 | 4119ms | — | 0.26 | 2.60 | |
| openrouter | muse-glimmer-30b | 🔍Context Recall | pass | $0.444 | 477ms | — | 0.30 | 1.20 | |
| openrouter | muse-glimmer-30b | { }JSON Output | pass | $0.445 | 362ms | — | 0.30 | 1.20 | |
| deepinfra | Seed-2.0-mini | 💻Code Gen | ok | $0.446 | 8890ms | — | 0.10 | 0.40 | |
| openai | gpt-5.4-2026-03-05 | 🧮Reasoning | ok | $0.448 | 1383ms | — | 2.50 | 15.00 | |
| openrouter | sonar-pro | { }JSON Output | pass | $0.450 | 2094ms | — | 3.00 | 15.00 | |
| openrouter | mimo-v2.6-pro | 🚀Throughput | ok | $0.451 | 414ms | — | 0.43 | 0.87 | |
| together | MiniMax-M3 | 💻Code Gen | ok | $0.453 | 4489ms | — | 0.30 | 1.20 | |
| deepinfra | Seed-1.8 | { }JSON Output | pass | $0.459 | 4916ms | — | 0.25 | 2.00 | |
| openrouter | l3.1-euryale-70b | 🚀Throughput | ok | $0.459 | 365ms | — | 0.85 | 0.85 | |
| openai | gpt-4o-mini | 🚀Throughput | ok | $0.459 | 10903ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini-2024-07-18 | 🚀Throughput | ok | $0.459 | 8108ms | — | 0.15 | 0.60 | |
| openrouter | codestral-2508 | 🚀Throughput | ok | $0.460 | 565ms | — | 0.30 | 0.90 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | 🔧Tool Use | pass | $0.460 | 2731ms | — | 0.44 | 1.32 | |
| deepinfra | DeepSeek-V4.1-Flash | 🚀Throughput | ok | $0.460 | 8037ms | — | 0.20 | 0.60 | |
| together | GLM-5.2 | 🔧Tool Use | pass | $0.461 | 860ms | — | 1.40 | 4.40 | |
| gemini | gemini-3.1-pro-preview-customtools | 🔧Tool Use | pass | $0.462 | 3144ms | — | 2.00 | 12.00 | |
| gemini | gemini-3-pro-image | 🔧Tool Use | pass | $0.462 | 3116ms | — | 2.00 | 12.00 | |
| openrouter | kimi-k2.7-code | { }JSON Output | pass | $0.465 | 1082ms | — | 0.60 | 3.50 | |
| fireworks | gpt-oss-120b | 🚀Throughput | ok | $0.469 | 4307ms | — | 0.15 | 0.60 | |
| openrouter | kimi-k2 | { }JSON Output | pass | $0.469 | 2836ms | — | 0.57 | 2.30 | |
| openrouter | seed-2-1-turbo | 🔍Context Recall | pass | $0.476 | 1776ms | — | 0.50 | 2.50 | |
| gemini | gemini-3-pro-image-preview | { }JSON Output | pass | $0.476 | 5289ms | — | 2.00 | 12.00 | |
| openrouter | nemotron-3-ultra-550b-a55b | { }JSON Output | pass | $0.477 | 687ms | — | 0.60 | 2.40 | |
| openai | gpt-5.4-mini-2026-03-17 | 💻Code Gen | ok | $0.479 | 1395ms | — | 0.75 | 4.50 | |
| openrouter | deepseek-chat-v3.1 | 🚀Throughput | ok | $0.484 | 2207ms | — | 0.25 | 0.95 | |
| deepinfra | Seed-2.0-pro | 🔧Tool Use | pass | $0.489 | 4622ms | — | 0.50 | 3.00 | |
| gemini | gemini-3.1-pro-preview-customtools | 🧮Reasoning | ok | $0.494 | 3881ms | — | 2.00 | 12.00 | |
| openrouter | qwen3-coder-flash | 🚀Throughput | ok | $0.495 | 688ms | — | 0.20 | 0.97 | |
| openrouter | fugu-max | { }JSON Output | pass | $0.498 | 2065ms | — | 2.00 | 6.00 | |
| together | Muse-Glimmer-30B | 🔧Tool Use | pass | $0.499 | 3073ms | — | 0.35 | 1.50 | |
| openrouter | mimo-v2.5-pro | 🔍Context Recall | pass | $0.501 | 1069ms | — | 0.48 | 1.80 | |
| deepinfra | GLM-4.7 | { }JSON Output | pass | $0.503 | 7442ms | — | 0.40 | 1.75 | |
| openai | gpt-4o-2024-08-06 | 🧮Reasoning | ok | $0.505 | 1191ms | — | 2.50 | 10.00 | |
| openrouter | glm-5v-turbo | { }JSON Output | pass | $0.506 | 508ms | — | 1.20 | 4.00 | |
| together | Muse-Glimmer-30B | { }JSON Output | pass | $0.507 | 4086ms | — | 0.35 | 1.50 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🔍Context Recall | pass | $0.507 | 794ms | — | 0.60 | 2.40 | |
| openrouter | command-a | { }JSON Output | pass | $0.508 | 916ms | — | 2.50 | 10.00 | |
| openrouter | qwen3.5-122b-a10b | ⚡Ping | ok | $0.510 | 1268ms | — | 0.26 | 2.08 | |
| openrouter | deepseek-v3.1-terminus | 🚀Throughput | ok | $0.510 | 10602ms | — | 0.27 | 1.00 | |
| openai | gpt-5.4-mini | 💻Code Gen | ok | $0.511 | 1306ms | — | 0.75 | 4.50 | |
| deepinfra | Seed-2.0-pro | 🔍Context Recall | pass | $0.512 | 10948ms | — | 0.50 | 3.00 | |
| together | Beam-1.0-501B-A23B | 💻Code Gen | ok | $0.514 | 1161ms | — | 0.40 | 1.20 | |
| anthropic | claude-sonnet-5 | { }JSON Output | pass | $0.514 | 1148ms | — | 2.00 | 10.00 | |
| openai | gpt-5.4-2026-03-05 | { }JSON Output | pass | $0.515 | 1707ms | — | 2.50 | 15.00 | |
| openrouter | kimi-k2.7-code | 🧮Reasoning | ok | $0.516 | 1056ms | — | 0.60 | 3.50 | |
| together | DeepSeek-V4-Pro-0813 | 🔍Context Recall | pass | $0.516 | 1071ms | — | 1.32 | 3.96 | |
| openrouter | aion-2.0 | 🧮Reasoning | ok | $0.518 | 1036ms | — | 0.80 | 1.60 | |
| openrouter | command-a | 🧮Reasoning | ok | $0.522 | 557ms | — | 2.50 | 10.00 | |
| anthropic | claude-sonnet-5-5 | 🧮Reasoning | ok | $0.524 | 1632ms | — | 2.00 | 10.00 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | 💻Code Gen | ok | $0.525 | 4439ms | — | 0.44 | 1.32 | |
| openrouter | seed-1.6 | 🧮Reasoning | ok | $0.528 | 353ms | — | 0.25 | 2.00 | |
| deepinfra | DeepSeek-V4-Pro | 🔧Tool Use | pass | $0.529 | 1438ms | — | 1.30 | 2.60 | |
| openrouter | aion-3.5-mini | 🔍Context Recall | pass | $0.529 | 1193ms | — | 0.70 | 1.40 | |
| openrouter | sonar | 🚀Throughput | ok | $0.530 | 1448ms | — | 1.00 | 1.00 | |
| openrouter | lfm-2.5-24b-a2b | 🔍Context Recall | pass | $0.532 | 485ms | — | 0.05 | 0.70 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | ⚡Ping | ok | $0.533 | 692ms | — | 0.45 | 3.50 | |
| openrouter | minimax-m2.5 | 🧮Reasoning | ok | $0.536 | 2836ms | — | 0.30 | 1.20 | |
| openrouter | gpt-6.1-sol | 🔍Context Recall | pass | $0.538 | 671ms | — | 2.00 | 10.00 | |
| openrouter | grok-4.3 | ⚡Ping | ok | $0.539 | 664ms | — | 1.25 | 2.50 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🚀Throughput | ok | $0.539 | 348ms | — | 0.66 | 1.00 | |
| openrouter | hermes-3-llama-3.1-405b | 🚀Throughput | ok | $0.540 | 366ms | — | 1.00 | 1.00 | |
| gemini | gemini-3-pro-image | 🧮Reasoning | ok | $0.542 | 7091ms | — | 2.00 | 12.00 | |
| deepinfra | Seed-2.0-pro | 🧮Reasoning | ok | $0.543 | 4451ms | — | 0.50 | 3.00 | |
| openrouter | minimax-m3.1-flash | 💻Code Gen | ok | $0.544 | 606ms | — | 0.15 | 0.60 | |
| together | GLM-5.3 | 🔧Tool Use | pass | $0.545 | 988ms | — | 1.40 | 4.40 | |
| openrouter | aion-2.0 | 🔍Context Recall | pass | $0.546 | 1140ms | — | 0.80 | 1.60 | |
| openrouter | nemotron-3-ultra-550b-a55b | 💻Code Gen | ok | $0.546 | 635ms | — | 0.60 | 2.40 | |
| anthropic | claude-sonnet-5-5 | { }JSON Output | pass | $0.548 | 1550ms | — | 2.00 | 10.00 | |
| openrouter | sonar-pro | 🧮Reasoning | ok | $0.549 | 1176ms | — | 3.00 | 15.00 | |
| gemini | gemini-3-pro-image-preview | 🔍Context Recall | pass | $0.550 | 4380ms | — | 2.00 | 12.00 | |
| together | GLM-5.2 | ⚡Ping | ok | $0.550 | 2383ms | — | 1.40 | 4.40 | |
| openrouter | glm-4.6 | ⚡Ping | ok | $0.551 | 8156ms | — | 0.50 | 2.00 | |
| deepinfra | DeepSeek-V4-Pro | 💻Code Gen | ok | $0.554 | 2403ms | — | 1.30 | 2.60 | |
| openrouter | mimo-v2.5-pro | 💻Code Gen | ok | $0.554 | 1236ms | — | 0.48 | 1.80 | |
| openrouter | kimi-k3.1-pro | ⚡Ping | ok | $0.554 | 4593ms | — | 2.00 | 10.00 | |
| deepinfra | DeepSeek-V4-Pro-0813 | 🔧Tool Use | pass | $0.555 | 2116ms | — | 1.30 | 2.60 | |
| openrouter | grok-build-0.1 | ⚡Ping | ok | $0.557 | 531ms | — | 1.00 | 2.00 | |
| openai | gpt-5.6-terra | 🔍Context Recall | pass | $0.558 | 1200ms | — | 2.00 | 12.00 | |
| together | Muse-Glimmer-30B | 🔍Context Recall | pass | $0.559 | 4565ms | — | 0.35 | 1.50 | |
| openrouter | aion-3.0-mini | 💻Code Gen | ok | $0.561 | 1165ms | — | 0.70 | 1.40 | |
| openrouter | mimo-v2.6-pro-ultraspeed | { }JSON Output | pass | $0.561 | 766ms | — | 4.35 | 8.70 | |
| openrouter | sonar-pro-search | 🧮Reasoning | ok | $0.564 | 2039ms | — | 3.00 | 15.00 | |
| openrouter | seed-1.6-flash | 💻Code Gen | ok | $0.565 | 213ms | — | 0.07 | 0.30 | |
| openrouter | step-5-preview | 🔍Context Recall | pass | $0.570 | 1304ms | — | 1.00 | 2.70 | |
| openrouter | relace-search | 💻Code Gen | ok | $0.575 | 1330ms | — | 1.00 | 3.00 | |
| openai | gpt-5.5 | ⚡Ping | ok | $0.575 | 1676ms | — | 5.00 | 30.00 | |
| together | GLM-5.3 | { }JSON Output | pass | $0.575 | 1026ms | — | 1.40 | 4.40 | |
| openrouter | glm-4.6 | { }JSON Output | pass | $0.579 | 411ms | — | 0.50 | 2.00 | |
| together | DeepSeek-V4-Pro-0813 | { }JSON Output | pass | $0.582 | 1523ms | — | 1.32 | 3.96 | |
| groq | gpt-oss-120b | 🚀Throughput | ok | $0.582 | 1856ms | — | 0.15 | 0.75 | |
| openrouter | seed-2.0-lite | 🔍Context Recall | pass | $0.587 | 465ms | — | 0.25 | 2.00 | |
| openrouter | muse-glimmer-30b | 💻Code Gen | ok | $0.588 | 365ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2.1 | 🔍Context Recall | pass | $0.589 | 2241ms | — | 0.30 | 1.20 | |
| gemini | gemini-3-pro-image-preview | 🧮Reasoning | ok | $0.590 | 8000ms | — | 2.00 | 12.00 | |
| openrouter | inkling | { }JSON Output | pass | $0.592 | 624ms | — | 1.00 | 4.05 | |
| openai | gpt-4o-2024-11-20 | 🧮Reasoning | ok | $0.595 | 1607ms | — | 2.50 | 10.00 | |
| gemini | gemini-3-pro-image | { }JSON Output | pass | $0.596 | 4932ms | — | 2.00 | 12.00 | |
| deepinfra | Seed-2.0-pro | { }JSON Output | pass | $0.597 | 5740ms | — | 0.50 | 3.00 | |
| openrouter | step-3.5-flash | 🧮Reasoning | ok | $0.605 | 1168ms | — | 0.10 | 0.30 | |
| openai | gpt-5.5-2026-04-23 | ⚡Ping | ok | $0.605 | 1407ms | — | 5.00 | 30.00 | |
| openrouter | minimax-m2.1 | 💻Code Gen | ok | $0.606 | 1589ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2.7 | 🚀Throughput | ok | $0.616 | 574ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2.5 | 🚀Throughput | ok | $0.620 | 1978ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2.1 | 🚀Throughput | ok | $0.622 | 1764ms | — | 0.30 | 1.20 | |
| openrouter | gpt-6.1-sol | { }JSON Output | pass | $0.622 | 662ms | — | 2.00 | 10.00 | |
| openrouter | grok-4.5 | ⚡Ping | ok | $0.624 | 563ms | — | 2.00 | 6.00 | |
| openrouter | glimpse | { }JSON Output | pass | $0.625 | 991ms | — | 0.60 | 3.00 | |
| openrouter | muse-glimmer-30b | 🚀Throughput | ok | $0.626 | 383ms | — | 0.30 | 1.20 | |
| openrouter | step-5-preview | 💻Code Gen | ok | $0.631 | 445ms | — | 1.00 | 2.70 | |
| gemini | gemini-3-pro-image | 🔍Context Recall | pass | $0.634 | 5093ms | — | 2.00 | 12.00 | |
| gemini | gemini-3.6-flash | 🔍Context Recall | pass | $0.636 | 2588ms | — | 1.50 | 7.50 | |
| openrouter | aion-2.0 | 💻Code Gen | ok | $0.638 | 756ms | — | 0.80 | 1.60 | |
| openrouter | step-5-preview | 🧮Reasoning | ok | $0.650 | 946ms | — | 1.00 | 2.70 | |
| openrouter | qwen3.5-9b | 💻Code Gen | ok | $0.655 | 436ms | — | 0.17 | 0.25 | |
| anthropic | claude-sonnet-4-5-20250929 | { }JSON Output | pass | $0.657 | 1222ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.5-27b | ⚡Ping | ok | $0.657 | 402ms | — | 0.26 | 2.60 | |
| openrouter | hy3 | 💻Code Gen | ok | $0.671 | 1441ms | — | 0.13 | 0.53 | |
| openrouter | muse-spark-1.2 | ⚡Ping | ok | $0.673 | 2702ms | — | 1.25 | 4.25 | |
| deepinfra | Seed-1.8 | 🔧Tool Use | pass | $0.674 | 6668ms | — | 0.25 | 2.00 | |
| openrouter | minimax-m2.7 | 🧮Reasoning | ok | $0.676 | 852ms | — | 0.30 | 1.20 | |
| together | DeepSeek-V4-Pro-0813 | 🔧Tool Use | pass | $0.678 | 1009ms | — | 1.32 | 3.96 | |
| gemini | gemini-3.1-pro-preview-customtools | { }JSON Output | pass | $0.680 | 4161ms | — | 2.00 | 12.00 | |
| openrouter | seed-2.0-code | 🔍Context Recall | pass | $0.680 | 383ms | — | 0.50 | 3.00 | |
| openrouter | minimax-m2.5 | 💻Code Gen | ok | $0.688 | 1671ms | — | 0.30 | 1.20 | |
| openrouter | kimi-k2.7-code | 💻Code Gen | ok | $0.689 | 1260ms | — | 0.60 | 3.50 | |
| openai | gpt-5.4-2026-03-05 | 🔍Context Recall | pass | $0.698 | 1463ms | — | 2.50 | 15.00 | |
| openrouter | qwen3.8-27b | 💻Code Gen | ok | $0.700 | 1185ms | — | 0.15 | 1.88 | |
| gemini | gemini-3.5-flash | 🔍Context Recall | pass | $0.700 | 2909ms | — | 1.50 | 9.00 | |
| openrouter | aion-3.0-mini | 🚀Throughput | ok | $0.723 | 1484ms | — | 0.70 | 1.40 | |
| openrouter | sonar-pro | 🔍Context Recall | pass | $0.732 | 2454ms | — | 3.00 | 15.00 | |
| openrouter | step-5-preview | { }JSON Output | pass | $0.734 | 799ms | — | 1.00 | 2.70 | |
| openrouter | qwen3.6-35b-a3b | 🔍Context Recall | pass | $0.735 | 651ms | — | 0.10 | 0.90 | |
| openai | gpt-5.4-2026-03-05 | 🔧Tool Use | pass | $0.740 | 1114ms | — | 2.50 | 15.00 | |
| openai | gpt-5.6-terra | 🧮Reasoning | ok | $0.754 | 2729ms | — | 2.00 | 12.00 | |
| openrouter | perceptron-mk1.5 | 🚀Throughput | ok | $0.755 | 780ms | — | 0.15 | 1.50 | |
| openrouter | perceptron-mk1 | 🚀Throughput | ok | $0.755 | 775ms | — | 0.15 | 1.50 | |
| openrouter | lfm-2.5-24b-a2b | { }JSON Output | pass | $0.760 | 598ms | — | 0.05 | 0.70 | |
| openai | gpt-4.1 | 🔍Context Recall | pass | $0.764 | 1288ms | — | 2.00 | 8.00 | |
| together | Qwen3.5-9B | 💻Code Gen | ok | $0.765 | 26828ms | — | 0.17 | 0.25 | |
| deepinfra | Qwen3-Coder-480B-A35B-Instruct-Turbo | 🚀Throughput | ok | $0.767 | 10155ms | — | 0.30 | 1.00 | |
| openrouter | deepseek-v3.2-exp | 🚀Throughput | ok | $0.768 | 1517ms | — | 0.27 | 0.41 | |
| openrouter | gpt-6.1-sol | 🧮Reasoning | ok | $0.768 | 706ms | — | 2.00 | 10.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🧮Reasoning | ok | $0.771 | 1577ms | — | 3.00 | 15.00 | |
| openrouter | mistral-large-4-0 | { }JSON Output | pass | $0.776 | 850ms | — | 0.70 | 2.10 | |
| openrouter | qwen3.6-plus | { }JSON Output | pass | $0.781 | 529ms | — | 0.33 | 1.95 | |
| openrouter | kimi-k2.6 | { }JSON Output | pass | $0.795 | 939ms | — | 0.65 | 3.41 | |
| openai | gpt-4o-2024-08-06 | 🔍Context Recall | pass | $0.795 | 953ms | — | 2.50 | 10.00 | |
| openrouter | glm-4.7 | { }JSON Output | pass | $0.802 | 3780ms | — | 0.54 | 1.98 | |
| openrouter | sonar-pro-search | 🔍Context Recall | pass | $0.807 | 2169ms | — | 3.00 | 15.00 | |
| openrouter | minimax-m2.1 | 🧮Reasoning | ok | $0.807 | 1765ms | — | 0.30 | 1.20 | |
| openrouter | muse-spark-1.3 | ⚡Ping | ok | $0.809 | 4830ms | — | 1.25 | 4.25 | |
| openai | gpt-5.6-terra | 💻Code Gen | ok | $0.810 | 1496ms | — | 2.00 | 12.00 | |
| openrouter | hy3-preview | 💻Code Gen | ok | $0.810 | 2760ms | — | 0.18 | 0.60 | |
| openrouter | command-r-plus-08-2024 | 🔍Context Recall | pass | $0.815 | 2004ms | — | 2.50 | 10.00 | |
| openrouter | glm-4.5 | 🔍Context Recall | pass | $0.817 | 9262ms | — | 0.60 | 2.20 | |
| openrouter | qwen3.8-max-0902 | 🔍Context Recall | pass | $0.820 | 1265ms | — | 2.00 | 6.00 | |
| together | Muse-Glimmer-30B | 💻Code Gen | ok | $0.829 | 7005ms | — | 0.35 | 1.50 | |
| openrouter | qwen3.5-397b-a17b | ⚡Ping | ok | $0.829 | 562ms | — | 0.50 | 3.60 | |
| openai | gpt-4o-2024-11-20 | 🔍Context Recall | pass | $0.835 | 1449ms | — | 2.50 | 10.00 | |
| openrouter | qwen3-30b-a3b | 💻Code Gen | ok | $0.837 | 488ms | — | 0.12 | 0.50 | |
| openrouter | minimax-m2.7 | 💻Code Gen | ok | $0.842 | 283ms | — | 0.30 | 1.20 | |
| together | Qwen3.8-2.4T-A95B | { }JSON Output | pass | $0.844 | 1037ms | — | 2.00 | 6.00 | |
| openrouter | mimo-v2.6-pro-ultraspeed | 🧮Reasoning | ok | $0.853 | 5210ms | — | 4.35 | 8.70 | |
| openrouter | muse-spark-1.1 | ⚡Ping | ok | $0.860 | 3427ms | — | 1.25 | 4.25 | |
| openrouter | glm-4.5 | { }JSON Output | pass | $0.862 | 9474ms | — | 0.60 | 2.20 | |
| openrouter | qwen3.5-9b | 🧮Reasoning | ok | $0.866 | 438ms | — | 0.17 | 0.25 | |
| anthropic | claude-haiku-4-5-20251001 | 🔧Tool Use | pass | $0.874 | 1059ms | — | 1.00 | 5.00 | |
| together | Qwen3.8-2.4T-A95B | 🔍Context Recall | pass | $0.874 | 1505ms | — | 2.00 | 6.00 | |
| openai | o3-2025-04-16 | ⚡Ping | ok | $0.890 | 1076ms | — | 10.00 | 40.00 | |
| openrouter | inkling | 🔍Context Recall | pass | $0.895 | 671ms | — | 1.00 | 4.05 | |
| openrouter | lfm-2.5-24b-a2b | 💻Code Gen | ok | $0.896 | 644ms | — | 0.05 | 0.70 | |
| openrouter | gpt-6.1-terra | 💻Code Gen | ok | $0.909 | 876ms | — | 1.00 | 5.00 | |
| gemini | gemini-3.1-pro-preview-customtools | 🔍Context Recall | pass | $0.910 | 4633ms | — | 2.00 | 12.00 | |
| openrouter | gpt-6-luna-pro | 🚀Throughput | ok | $0.912 | 795ms | — | 0.10 | 0.50 | |
| openrouter | inkling | 💻Code Gen | ok | $0.919 | 1007ms | — | 1.00 | 4.05 | |
| openrouter | mistral-medium-3-5 | 💻Code Gen | ok | $0.927 | 561ms | — | 1.50 | 7.50 | |
| openrouter | glm-5.3-prime | 🧮Reasoning | ok | $0.934 | 752ms | — | 2.80 | 8.80 | |
| anthropic | claude-haiku-4-5-20251001 | 💻Code Gen | ok | $0.935 | 1737ms | — | 1.00 | 5.00 | |
| together | Beam-1.0-501B-A23B | 🚀Throughput | ok | $0.938 | 2607ms | — | 0.40 | 1.20 | |
| openrouter | fugu-max | 🧮Reasoning | ok | $0.944 | 1422ms | — | 2.00 | 6.00 | |
| together | GLM-5.3 | 🧮Reasoning | ok | $0.951 | 1432ms | — | 1.40 | 4.40 | |
| openrouter | qwen3.8-2.4t-a95b | { }JSON Output | pass | $0.952 | 1217ms | — | 2.00 | 6.00 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🚀Throughput | ok | $0.958 | 610ms | — | 0.21 | 1.90 | |
| openrouter | qwen3.8-max-0902 | { }JSON Output | pass | $0.958 | 1925ms | — | 2.00 | 6.00 | |
| openrouter | kimi-k2 | 🔍Context Recall | pass | $0.960 | 2193ms | — | 0.57 | 2.30 | |
| openrouter | glm-5v-turbo | 🧮Reasoning | ok | $0.962 | 559ms | — | 1.20 | 4.00 | |
| together | MiniMax-M3 | 🚀Throughput | ok | $0.969 | 13310ms | — | 0.30 | 1.20 | |
| openrouter | qwen3.8-2.4t-a95b | 🔍Context Recall | pass | $0.970 | 1419ms | — | 2.00 | 6.00 | |
| openrouter | deepseek-v4-pro | 🚀Throughput | ok | $0.981 | 1914ms | — | 0.95 | 1.90 | |
| openrouter | seed-2.0-code | { }JSON Output | pass | $0.989 | 402ms | — | 0.50 | 3.00 | |
| anthropic | claude-sonnet-5 | 🧮Reasoning | ok | $1.00 | 1493ms | — | 2.00 | 10.00 | |
| openrouter | command-a | 🔍Context Recall | pass | $1.01 | 1125ms | — | 2.50 | 10.00 | |
| deepinfra | GLM-4.7 | 💻Code Gen | ok | $1.01 | 21237ms | — | 0.40 | 1.75 | |
| openrouter | mimo-v2.5 | 🚀Throughput | ok | $1.01 | 1123ms | — | 0.40 | 2.00 | |
| openrouter | mistral-medium-3 | 🚀Throughput | ok | $1.02 | 498ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🚀Throughput | ok | $1.02 | 1023ms | — | 0.40 | 2.00 | |
| openrouter | grok-build-0.1 | { }JSON Output | pass | $1.03 | 367ms | — | 1.00 | 2.00 | |
| openrouter | sonar-pro-search | 💻Code Gen | ok | $1.03 | 2350ms | — | 3.00 | 15.00 | |
| openrouter | mimo-v2.5-pro | 🚀Throughput | ok | $1.03 | 1098ms | — | 0.48 | 1.80 | |
| openrouter | lfm-2.5-24b-a2b | 🧮Reasoning | ok | $1.04 | 482ms | — | 0.05 | 0.70 | |
| deepinfra | GLM-4.7 | 🔍Context Recall | pass | $1.05 | 22748ms | — | 0.40 | 1.75 | |
| deepinfra | DeepSeek-V4-Flash-Vision-Exp | 🚀Throughput | ok | $1.05 | 11165ms | — | 0.44 | 1.32 | |
| together | Qwen3.8-2.4T-A95B | 🔧Tool Use | pass | $1.05 | 943ms | — | 2.00 | 6.00 | |
| gemini | gemini-3.6-flash | 💻Code Gen | ok | $1.05 | 5038ms | — | 1.50 | 7.50 | |
| together | Muse-Spark-Open-816B-A42B | ⚡Ping | ok | $1.06 | 5489ms | — | 1.25 | 4.25 | |
| anthropic | claude-opus-4-6 | { }JSON Output | pass | $1.07 | 2036ms | — | 5.00 | 25.00 | |
| openrouter | glm-4.7 | 🔍Context Recall | pass | $1.07 | 3671ms | — | 0.54 | 1.98 | |
| openrouter | glimpse | 🧮Reasoning | ok | $1.07 | 940ms | — | 0.60 | 3.00 | |
| openai | gpt-5.4-2026-03-05 | 💻Code Gen | ok | $1.07 | 1675ms | — | 2.50 | 15.00 | |
| openrouter | sonar-pro | 💻Code Gen | ok | $1.07 | 1388ms | — | 3.00 | 15.00 | |
| openrouter | muse-wonder | ⚡Ping | ok | $1.08 | 2601ms | — | 4.00 | 20.00 | |
| openrouter | muse-glimmer-30b | 🧮Reasoning | ok | $1.09 | 491ms | — | 0.30 | 1.20 | |
| together | GLM-5.3 | 🔍Context Recall | pass | $1.09 | 1255ms | — | 1.40 | 4.40 | |
| openrouter | inkling | 🧮Reasoning | ok | $1.09 | 513ms | — | 1.00 | 4.05 | |
| openrouter | glm-4.7 | 💻Code Gen | ok | $1.09 | 5464ms | — | 0.54 | 1.98 | |
| openrouter | qwen3.7-max | ⚡Ping | ok | $1.10 | 1602ms | — | 1.48 | 4.42 | |
| openrouter | grok-4.3 | 🧮Reasoning | ok | $1.13 | 597ms | — | 1.25 | 2.50 | |
| openrouter | glm-5.3-prime | { }JSON Output | pass | $1.14 | 521ms | — | 2.80 | 8.80 | |
| gemini | gemini-3.5-flash | 💻Code Gen | ok | $1.15 | 6820ms | — | 1.50 | 9.00 | |
| together | Muse-Glimmer-30B | 🚀Throughput | ok | $1.16 | 9800ms | — | 0.35 | 1.50 | |
| openrouter | aion-3.0 | 🧮Reasoning | ok | $1.17 | 717ms | — | 3.00 | 6.00 | |
| openrouter | kimi-k2 | 🚀Throughput | ok | $1.17 | 1643ms | — | 0.57 | 2.30 | |
| openrouter | grok-4.3 | { }JSON Output | pass | $1.17 | 541ms | — | 1.25 | 2.50 | |
| openrouter | qwen3.5-122b-a10b | { }JSON Output | pass | $1.17 | 356ms | — | 0.26 | 2.08 | |
| openrouter | grok-4.5 | 🧮Reasoning | ok | $1.18 | 861ms | — | 2.00 | 6.00 | |
| openrouter | glm-5.3-flashx | 💻Code Gen | ok | $1.20 | 1418ms | — | 0.37 | 1.25 | |
| openrouter | glm-5.3-prime | 🔍Context Recall | pass | $1.20 | 645ms | — | 2.80 | 8.80 | |
| openrouter | fugu-max | ⚡Ping | ok | $1.22 | 3532ms | — | 2.00 | 6.00 | |
| openrouter | glm-5 | { }JSON Output | pass | $1.22 | 3012ms | — | 1.00 | 3.20 | |
| openrouter | qwen3.6-35b-a3b | { }JSON Output | pass | $1.22 | 659ms | — | 0.10 | 0.90 | |
| openai | gpt-4.1-mini-2025-04-14 | 🚀Throughput | ok | $1.22 | 5424ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🚀Throughput | ok | $1.22 | 5888ms | — | 0.40 | 1.60 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🚀Throughput | ok | $1.23 | 821ms | — | 0.60 | 2.40 | |
| deepinfra | Seed-2.0-pro | 💻Code Gen | ok | $1.23 | 7206ms | — | 0.50 | 3.00 | |
| anthropic | claude-opus-5 | { }JSON Output | pass | $1.23 | 1117ms | — | 5.00 | 25.00 | |
| openrouter | grok-build-0.1 | 🔍Context Recall | pass | $1.24 | 1132ms | — | 1.00 | 2.00 | |
| openai | gpt-4.1 | 💻Code Gen | ok | $1.24 | 1353ms | — | 2.00 | 8.00 | |
| openrouter | command-a | 💻Code Gen | ok | $1.25 | 4039ms | — | 2.50 | 10.00 | |
| openrouter | aion-3.0-mini | 🧮Reasoning | ok | $1.26 | 1080ms | — | 0.70 | 1.40 | |
| openrouter | moondream3.1-9b-a2b | 🚀Throughput | ok | $1.26 | 356ms | — | 0.30 | 2.50 | |
| openrouter | command-r-plus-08-2024 | 💻Code Gen | ok | $1.26 | 1333ms | — | 2.50 | 10.00 | |
| openrouter | nova-2-lite-v1 | 🚀Throughput | ok | $1.27 | 1131ms | — | 0.30 | 2.50 | |
| openrouter | kimi-k2-0905 | 🚀Throughput | ok | $1.27 | 778ms | — | 0.60 | 2.50 | |
| openrouter | kimi-k2.6 | 🔍Context Recall | pass | $1.28 | 1052ms | — | 0.65 | 3.41 | |
| anthropic | claude-opus-4-6 | 🧮Reasoning | ok | $1.28 | 2262ms | — | 5.00 | 25.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🚀Throughput | ok | $1.30 | 1457ms | — | 0.29 | 1.00 | |
| openrouter | grok-4.5 | { }JSON Output | pass | $1.31 | 762ms | — | 2.00 | 6.00 | |
| deepinfra | Qwen3.5-27B | 💻Code Gen | ok | $1.32 | 11300ms | — | 0.26 | 2.60 | |
| openrouter | glm-4.5-air | 🧮Reasoning | ok | $1.32 | 1182ms | — | 0.13 | 0.85 | |
| openrouter | mimo-v2.6-pro-ultraspeed | 🔍Context Recall | pass | $1.33 | 1719ms | — | 4.35 | 8.70 | |
| deepinfra | GLM-4.7 | 🚀Throughput | ok | $1.34 | 22196ms | — | 0.40 | 1.75 | |
| openrouter | glimpse | 💻Code Gen | ok | $1.34 | 417ms | — | 0.60 | 3.00 | |
| openrouter | glm-5 | 🧮Reasoning | ok | $1.34 | 1904ms | — | 1.00 | 3.20 | |
| openrouter | grok-4.3 | 🔍Context Recall | pass | $1.35 | 680ms | — | 1.25 | 2.50 | |
| anthropic | claude-sonnet-5 | 🔍Context Recall | pass | $1.36 | 1256ms | — | 2.00 | 10.00 | |
| anthropic | claude-sonnet-5-5 | 🔧Tool Use | pass | $1.37 | 1100ms | — | 2.00 | 10.00 | |
| openrouter | grok-4.6 | ⚡Ping | ok | $1.38 | 1224ms | — | 2.00 | 6.00 | |
| openrouter | kimi-k3.1-pro | { }JSON Output | pass | $1.40 | 2427ms | — | 2.00 | 10.00 | |
| anthropic | claude-sonnet-5-5 | 🔍Context Recall | pass | $1.41 | 1626ms | — | 2.00 | 10.00 | |
| openrouter | glm-4.5v | 🧮Reasoning | ok | $1.41 | 1419ms | — | 0.60 | 1.80 | |
| openrouter | grok-4.5 | 💻Code Gen | ok | $1.44 | 642ms | — | 2.00 | 6.00 | |
| openrouter | glm-5 | 🔍Context Recall | pass | $1.44 | 2485ms | — | 1.00 | 3.20 | |
| openrouter | muse-spark-1.2 | { }JSON Output | pass | $1.45 | 4189ms | — | 1.25 | 4.25 | |
| openai | gpt-5.5 | { }JSON Output | pass | $1.45 | 2001ms | — | 5.00 | 30.00 | |
| openrouter | muse-spark-open | 🧮Reasoning | ok | $1.46 | 3644ms | — | 1.25 | 4.25 | |
| openrouter | glm-4.7 | 🧮Reasoning | ok | $1.47 | 3889ms | — | 0.54 | 1.98 | |
| openai | gpt-5.5-2026-04-23 | 🔧Tool Use | pass | $1.48 | 1554ms | — | 5.00 | 30.00 | |
| openai | gpt-5.5 | 🔧Tool Use | pass | $1.48 | 1476ms | — | 5.00 | 30.00 | |
| openrouter | minimax-m2.7 | { }JSON Output | pass | $1.50 | 297ms | — | 0.30 | 1.20 | |
| anthropic | claude-sonnet-4-5-20250929 | 🔍Context Recall | pass | $1.52 | 1707ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.8-2.4t-a95b | 🧮Reasoning | ok | $1.52 | 1329ms | — | 2.00 | 6.00 | |
| openrouter | seed-2.0-lite | 🧮Reasoning | ok | $1.52 | 964ms | — | 0.25 | 2.00 | |
| openrouter | glm-4.5v | 🔍Context Recall | pass | $1.54 | 5056ms | — | 0.60 | 1.80 | |
| gemini | gemini-3.1-flash-lite-image | 🚀Throughput | ok | $1.54 | 2599ms | — | 0.25 | 1.50 | |
| openrouter | relace-search | 🚀Throughput | ok | $1.54 | 1332ms | — | 1.00 | 3.00 | |
| together | Muse-Spark-Open-816B-A42B | 🔧Tool Use | pass | $1.55 | 3850ms | — | 1.25 | 4.25 | |
| openrouter | aion-3.5-mini | 💻Code Gen | ok | $1.55 | 1809ms | — | 0.70 | 1.40 | |
| openrouter | kimi-k3.1-pro | 🧮Reasoning | ok | $1.57 | 1993ms | — | 2.00 | 10.00 | |
| openrouter | qwen3.5-plus-02-15 | 🔍Context Recall | pass | $1.57 | 612ms | — | 0.26 | 1.56 | |
| openrouter | qwen3.5-122b-a10b | 🔍Context Recall | pass | $1.57 | 291ms | — | 0.26 | 2.08 | |
| together | GLM-5.2 | { }JSON Output | pass | $1.58 | 4090ms | — | 1.40 | 4.40 | |
| openrouter | kimi-k3 | 🧮Reasoning | ok | $1.60 | 2012ms | — | 0.19 | 15.00 | |
| openrouter | hy4-preview | { }JSON Output | pass | $1.60 | 628ms | — | 0.83 | 2.50 | |
| openrouter | muse-spark-1.1 | { }JSON Output | pass | $1.60 | 3133ms | — | 1.25 | 4.25 | |
| openrouter | grok-build-0.1 | 💻Code Gen | ok | $1.61 | 745ms | — | 1.00 | 2.00 | |
| openrouter | nova-pro-v1 | 🚀Throughput | ok | $1.62 | 1242ms | — | 0.80 | 3.20 | |
| openai | gpt-5.5-2026-04-23 | { }JSON Output | pass | $1.63 | 1876ms | — | 5.00 | 30.00 | |
| openrouter | glm-5 | 🚀Throughput | ok | $1.64 | 2664ms | — | 1.00 | 3.20 | |
| together | DeepSeek-V4-Pro-0813 | 💻Code Gen | ok | $1.64 | 2522ms | — | 1.32 | 3.96 | |
| openrouter | glimpse | 🚀Throughput | ok | $1.64 | 430ms | — | 0.60 | 3.00 | |
| together | GLM-5.2 | 🔍Context Recall | pass | $1.65 | 1976ms | — | 1.40 | 4.40 | |
| openrouter | qwen3.6-plus | 🔍Context Recall | pass | $1.65 | 753ms | — | 0.33 | 1.95 | |
| openai | gpt-4o-2024-11-20 | 💻Code Gen | ok | $1.66 | 1790ms | — | 2.50 | 10.00 | |
| openrouter | kimi-k3.1-pro | 🔍Context Recall | pass | $1.68 | 5821ms | — | 2.00 | 10.00 | |
| together | Qwen3.8-2.4T-A95B | 🧮Reasoning | ok | $1.71 | 1780ms | — | 2.00 | 6.00 | |
| gemini | gemini-3.1-pro-preview-customtools | 💻Code Gen | ok | $1.73 | 6348ms | — | 2.00 | 12.00 | |
| gemini | gemini-3-pro-image | 💻Code Gen | ok | $1.73 | 8817ms | — | 2.00 | 12.00 | |
| openrouter | muse-spark-open | { }JSON Output | pass | $1.75 | 3236ms | — | 1.25 | 4.25 | |
| openrouter | gpt-6-astra | { }JSON Output | pass | $1.76 | 1155ms | — | 10.00 | 50.00 | |
| openrouter | qwen3.8-max-0902 | 🧮Reasoning | ok | $1.77 | 1767ms | — | 2.00 | 6.00 | |
| gemini | gemini-3-pro-image-preview | 💻Code Gen | ok | $1.77 | 8640ms | — | 2.00 | 12.00 | |
| openrouter | kimi-k2.7-code | 🚀Throughput | ok | $1.77 | 870ms | — | 0.60 | 3.50 | |
| openrouter | step-3.5-flash | 💻Code Gen | ok | $1.79 | 1147ms | — | 0.10 | 0.30 | |
| anthropic | claude-sonnet-5 | 🔧Tool Use | pass | $1.80 | 1441ms | — | 2.00 | 10.00 | |
| openrouter | qwen3.5-plus-02-15 | { }JSON Output | pass | $1.81 | 611ms | — | 0.26 | 1.56 | |
| openai | gpt-5.5 | 🔍Context Recall | pass | $1.81 | 2425ms | — | 5.00 | 30.00 | |
| openrouter | glm-4.5 | 🧮Reasoning | ok | $1.82 | 9531ms | — | 0.60 | 2.20 | |
| openrouter | qwen3.6-35b-a3b | 🧮Reasoning | ok | $1.82 | 302ms | — | 0.10 | 0.90 | |
| openai | gpt-4o-2024-08-06 | 💻Code Gen | ok | $1.83 | 2534ms | — | 2.50 | 10.00 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🚀Throughput | ok | $1.84 | 2422ms | — | 0.60 | 2.40 | |
| openrouter | glm-4.6 | 🔍Context Recall | pass | $1.84 | 8942ms | — | 0.50 | 2.00 | |
| openrouter | grok-4.6 | 💻Code Gen | ok | $1.84 | 506ms | — | 2.00 | 6.00 | |
| openai | gpt-5.5-2026-04-23 | 🔍Context Recall | pass | $1.84 | 1803ms | — | 5.00 | 30.00 | |
| openrouter | qwen3.5-27b | { }JSON Output | pass | $1.85 | 892ms | — | 0.26 | 2.60 | |
| openrouter | glm-5.2 | 💻Code Gen | ok | $1.86 | 447ms | — | 0.01 | 7.00 | |
| openrouter | mimo-v2.5-pro | { }JSON Output | pass | $1.90 | 4245ms | — | 0.48 | 1.80 | |
| openrouter | mistral-large-4-0 | 🔍Context Recall | pass | $1.90 | 877ms | — | 0.70 | 2.10 | |
| openai | o3-2025-04-16 | 🔧Tool Use | pass | $1.91 | 1077ms | — | 10.00 | 40.00 | |
| openrouter | kimi-k3 | 🔍Context Recall | pass | $1.96 | 709ms | — | 0.19 | 15.00 | |
| openrouter | aion-3.0 | 🔍Context Recall | pass | $1.97 | 1685ms | — | 3.00 | 6.00 | |
| deepinfra | Qwen3.5-27B | 🚀Throughput | ok | $1.98 | 16792ms | — | 0.26 | 2.60 | |
| deepinfra | DeepSeek-V4-Pro | 🚀Throughput | ok | $2.01 | 10367ms | — | 1.30 | 2.60 | |
| deepinfra | DeepSeek-V4-Pro-0813 | 🚀Throughput | ok | $2.01 | 15334ms | — | 1.30 | 2.60 | |
| openrouter | morph-v3-large | 🚀Throughput | ok | $2.02 | 673ms | — | 0.90 | 1.90 | |
| openrouter | gpt-6.1-sol | 💻Code Gen | ok | $2.03 | 750ms | — | 2.00 | 10.00 | |
| openrouter | qwen3.5-122b-a10b | 🧮Reasoning | ok | $2.05 | 1309ms | — | 0.26 | 2.08 | |
| openrouter | qwen3.6-35b-a3b | 💻Code Gen | ok | $2.08 | 509ms | — | 0.10 | 0.90 | |
| openrouter | grok-4.6 | { }JSON Output | pass | $2.10 | 608ms | — | 2.00 | 6.00 | |
| openrouter | aion-3.0 | { }JSON Output | pass | $2.10 | 1212ms | — | 3.00 | 6.00 | |
| openrouter | kimi-k3 | { }JSON Output | pass | $2.14 | 814ms | — | 0.19 | 15.00 | |
| openrouter | glm-5v-turbo | 🔍Context Recall | pass | $2.15 | 542ms | — | 1.20 | 4.00 | |
| openrouter | kimi-k2.6 | 💻Code Gen | ok | $2.17 | 1026ms | — | 0.65 | 3.41 | |
| deepinfra | GLM-4.7 | 🧮Reasoning | ok | $2.18 | 37590ms | — | 0.40 | 1.75 | |
| openrouter | glm-5.2 | 🔍Context Recall | pass | $2.19 | 583ms | — | 0.01 | 7.00 | |
| deepinfra | Seed-1.8 | 💻Code Gen | ok | $2.25 | 17811ms | — | 0.25 | 2.00 | |
| openrouter | muse-spark-1.3 | { }JSON Output | pass | $2.26 | 3829ms | — | 1.25 | 4.25 | |
| anthropic | claude-opus-4-6 | 🔍Context Recall | pass | $2.29 | 2826ms | — | 5.00 | 25.00 | |
| openrouter | grok-4.5 | 🔍Context Recall | pass | $2.29 | 587ms | — | 2.00 | 6.00 | |
| openrouter | muse-spark-1.1 | 🚀Throughput | ok | $2.30 | 4234ms | — | 1.25 | 4.25 | |
| deepinfra | Qwen3.5-27B | 🔍Context Recall | pass | $2.31 | 10137ms | — | 0.26 | 2.60 | |
| openrouter | glm-5.2 | { }JSON Output | pass | $2.31 | 526ms | — | 0.01 | 7.00 | |
| openrouter | glm-5.2 | 🧮Reasoning | ok | $2.32 | 418ms | — | 0.01 | 7.00 | |
| anthropic | claude-opus-5 | 🧮Reasoning | ok | $2.32 | 1864ms | — | 5.00 | 25.00 | |
| openrouter | muse-spark-open | 🚀Throughput | ok | $2.34 | 3036ms | — | 1.25 | 4.25 | |
| openrouter | fugu-max | 🔍Context Recall | pass | $2.35 | 3354ms | — | 2.00 | 6.00 | |
| openrouter | seed-2.0-lite | 💻Code Gen | ok | $2.36 | 578ms | — | 0.25 | 2.00 | |
| openrouter | qwen3.8-2.4t-a95b | 💻Code Gen | ok | $2.38 | 963ms | — | 2.00 | 6.00 | |
| openrouter | glm-4.5 | 💻Code Gen | ok | $2.40 | 8962ms | — | 0.60 | 2.20 | |
| openrouter | grok-4.6 | 🧮Reasoning | ok | $2.47 | 790ms | — | 2.00 | 6.00 | |
| openrouter | kimi-k2.6 | 🧮Reasoning | ok | $2.47 | 551ms | — | 0.65 | 3.41 | |
| openrouter | muse-spark-1.2 | 🔍Context Recall | pass | $2.50 | 4483ms | — | 1.25 | 4.25 | |
| openrouter | seed-1.6 | 💻Code Gen | ok | $2.52 | 529ms | — | 0.25 | 2.00 | |
| openrouter | gpt-6.1-terra | 🚀Throughput | ok | $2.54 | 674ms | — | 1.00 | 5.00 | |
| openrouter | deepseek-v4-pro | 💻Code Gen | ok | $2.54 | 2233ms | — | 0.95 | 1.90 | |
| openrouter | qwen3.6-27b | 🔍Context Recall | pass | $2.57 | 884ms | — | 0.32 | 3.20 | |
| openrouter | grok-4.6 | 🔍Context Recall | pass | $2.58 | 457ms | — | 2.00 | 6.00 | |
| openrouter | muse-spark-1.1 | 💻Code Gen | ok | $2.59 | 3119ms | — | 1.25 | 4.25 | |
| openrouter | muse-spark-1.2 | 💻Code Gen | ok | $2.60 | 3165ms | — | 1.25 | 4.25 | |
| anthropic | claude-sonnet-4-5-20250929 | 🔧Tool Use | pass | $2.61 | 1574ms | — | 3.00 | 15.00 | |
| openai | gpt-5.5 | 🧮Reasoning | ok | $2.64 | 2202ms | — | 5.00 | 30.00 | |
| anthropic | claude-sonnet-5 | 💻Code Gen | ok | $2.66 | 2883ms | — | 2.00 | 10.00 | |
| openrouter | gpt-6-astra | 🔍Context Recall | pass | $2.69 | 1327ms | — | 10.00 | 50.00 | |
| openrouter | seed-2-1-turbo | 🧮Reasoning | ok | $2.71 | 1076ms | — | 0.50 | 2.50 | |
| together | Muse-Spark-Open-816B-A42B | { }JSON Output | pass | $2.72 | 6173ms | — | 1.25 | 4.25 | |
| openrouter | muse-spark-1.3 | 🔍Context Recall | pass | $2.75 | 3322ms | — | 1.25 | 4.25 | |
| openrouter | grok-4.3 | 🚀Throughput | ok | $2.75 | 636ms | — | 1.25 | 2.50 | |
| openai | gpt-5.5-2026-04-23 | 🧮Reasoning | ok | $2.75 | 2301ms | — | 5.00 | 30.00 | |
| openrouter | aion-3.0 | 💻Code Gen | ok | $2.81 | 698ms | — | 3.00 | 6.00 | |
| openrouter | grok-4.7 | ⚡Ping | ok | $2.83 | 543ms | — | 2.00 | 6.00 | |
| openrouter | muse-spark-1.1 | 🔍Context Recall | pass | $2.88 | 3620ms | — | 1.25 | 4.25 | |
| openrouter | hy4-preview | 💻Code Gen | ok | $2.94 | 631ms | — | 0.83 | 2.50 | |
| openrouter | qwen3.5-27b | 🔍Context Recall | pass | $2.97 | 421ms | — | 0.26 | 2.60 | |
| deepinfra | Qwen3.5-27B | { }JSON Output | pass | $3.01 | 16811ms | — | 0.26 | 2.60 | |
| openrouter | grok-build-0.1 | 🧮Reasoning | ok | $3.01 | 368ms | — | 1.00 | 2.00 | |
| together | DeepSeek-V4-Pro-0813 | 🚀Throughput | ok | $3.04 | 4804ms | — | 1.32 | 3.96 | |
| openrouter | seed-2.0-code | 🧮Reasoning | ok | $3.05 | 520ms | — | 0.50 | 3.00 | |
| openrouter | gpt-6-sol-pro | ⚡Ping | ok | $3.05 | 685ms | — | 2.00 | 10.00 | |
| openrouter | aion-3.0 | 🚀Throughput | ok | $3.11 | 3329ms | — | 3.00 | 6.00 | |
| openrouter | qwen3.8-2.4t-a95b | 🚀Throughput | ok | $3.16 | 1063ms | — | 2.00 | 6.00 | |
| together | Qwen3.8-2.4T-A95B | 💻Code Gen | ok | $3.17 | 3681ms | — | 2.00 | 6.00 | |
| openrouter | qwen3.8-max-0902 | 🚀Throughput | ok | $3.18 | 1547ms | — | 2.00 | 6.00 | |
| openrouter | qwen3.5-122b-a10b | 💻Code Gen | ok | $3.19 | 1390ms | — | 0.26 | 2.08 | |
| openrouter | glm-5 | 💻Code Gen | ok | $3.21 | 3877ms | — | 1.00 | 3.20 | |
| openrouter | grok-4.7 | 💻Code Gen | ok | $3.27 | 571ms | — | 2.00 | 6.00 | |
| openrouter | kimi-k2 | 🧮Reasoning | ok | $3.30 | 3081ms | — | 0.57 | 2.30 | |
| openrouter | fugu-max | 🚀Throughput | ok | $3.30 | 1475ms | — | 2.00 | 6.00 | |
| openai | gpt-5.5-2026-04-23 | 💻Code Gen | ok | $3.34 | 2511ms | — | 5.00 | 30.00 | |
| openrouter | seed-2-1-turbo | 💻Code Gen | ok | $3.35 | 466ms | — | 0.50 | 2.50 | |
| openrouter | grok-4.7 | 🧮Reasoning | ok | $3.35 | 790ms | — | 2.00 | 6.00 | |
| together | GLM-5.2 | 💻Code Gen | ok | $3.37 | 9606ms | — | 1.40 | 4.40 | |
| together | Muse-Spark-Open-816B-A42B | 🔍Context Recall | pass | $3.43 | 7071ms | — | 1.25 | 4.25 | |
| openai | gpt-5.4-mini-2026-03-17 | 🚀Throughput | ok | $3.43 | 3650ms | — | 0.75 | 4.50 | |
| openai | gpt-5.4-mini | 🚀Throughput | ok | $3.43 | 5244ms | — | 0.75 | 4.50 | |
| openrouter | muse-spark-open | 💻Code Gen | ok | $3.43 | 3767ms | — | 1.25 | 4.25 | |
| together | Muse-Spark-Open-816B-A42B | 🚀Throughput | ok | $3.43 | 9647ms | — | 1.25 | 4.25 | |
| openrouter | grok-4.7 | 🔍Context Recall | pass | $3.45 | 1285ms | — | 2.00 | 6.00 | |
| openrouter | qwen3.5-397b-a17b | 🔍Context Recall | pass | $3.47 | 1870ms | — | 0.50 | 3.60 | |
| openai | gpt-5.5 | 💻Code Gen | ok | $3.49 | 3523ms | — | 5.00 | 30.00 | |
| openrouter | muse-spark-1.3 | 💻Code Gen | ok | $3.50 | 4286ms | — | 1.25 | 4.25 | |
| openrouter | gpt-6-astra | 🧮Reasoning | ok | $3.54 | 678ms | — | 10.00 | 50.00 | |
| openrouter | qwen3.6-27b | { }JSON Output | pass | $3.59 | 1338ms | — | 0.32 | 3.20 | |
| openrouter | muse-spark-1.1 | 🧮Reasoning | ok | $3.64 | 4062ms | — | 1.25 | 4.25 | |
| openrouter | mimo-v2.6-pro-ultraspeed | 💻Code Gen | ok | $3.66 | 1012ms | — | 4.35 | 8.70 | |
| openrouter | qwen3.6-plus | 🧮Reasoning | ok | $3.68 | 785ms | — | 0.33 | 1.95 | |
| openrouter | glm-5v-turbo | 💻Code Gen | ok | $3.76 | 496ms | — | 1.20 | 4.00 | |
| openrouter | grok-4.7 | { }JSON Output | pass | $3.78 | 707ms | — | 2.00 | 6.00 | |
| openrouter | qwen3.5-397b-a17b | { }JSON Output | pass | $3.80 | 1085ms | — | 0.50 | 3.60 | |
| openai | o3-2025-04-16 | 🔍Context Recall | pass | $3.81 | 924ms | — | 10.00 | 40.00 | |
| openrouter | mistral-medium-3-5 | 🚀Throughput | ok | $3.82 | 1448ms | — | 1.50 | 7.50 | |
| anthropic | claude-haiku-4-5-20251001 | 🚀Throughput | ok | $3.82 | 8482ms | — | 1.00 | 5.00 | |
| openrouter | muse-spark-1.3 | 🧮Reasoning | ok | $3.83 | 2795ms | — | 1.25 | 4.25 | |
| openrouter | grok-build-0.1 | 🚀Throughput | ok | $3.88 | 790ms | — | 1.00 | 2.00 | |
| openrouter | qwen3.5-122b-a10b | 🚀Throughput | ok | $3.88 | 905ms | — | 0.26 | 2.08 | |
| openrouter | kimi-k3.1-pro | 💻Code Gen | ok | $3.89 | 3060ms | — | 2.00 | 10.00 | |
| openrouter | qwen3.5-plus-02-15 | 🧮Reasoning | ok | $3.96 | 778ms | — | 0.26 | 1.56 | |
| together | GLM-5.2 | 🧮Reasoning | ok | $4.06 | 5098ms | — | 1.40 | 4.40 | |
| openrouter | qwen3.5-27b | 💻Code Gen | ok | $4.08 | 554ms | — | 0.26 | 2.60 | |
| together | Muse-Spark-Open-816B-A42B | 💻Code Gen | ok | $4.14 | 9195ms | — | 1.25 | 4.25 | |
| openrouter | muse-spark-open | 🔍Context Recall | pass | $4.15 | 8825ms | — | 1.25 | 4.25 | |
| openrouter | grok-4.5 | 🚀Throughput | ok | $4.21 | 533ms | — | 2.00 | 6.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🔍Context Recall | pass | $4.26 | 643ms | — | 0.45 | 3.50 | |
| anthropic | claude-opus-5 | 🔍Context Recall | pass | $4.26 | 2323ms | — | 5.00 | 25.00 | |
| openrouter | hy4-preview | 🧮Reasoning | ok | $4.41 | 1105ms | — | 0.83 | 2.50 | |
| openrouter | gpt-6-sol-pro | 🔍Context Recall | pass | $4.47 | 679ms | — | 2.00 | 10.00 | |
| openrouter | mimo-v2.6-pro-ultraspeed | 🚀Throughput | ok | $4.51 | 693ms | — | 4.35 | 8.70 | |
| openrouter | glm-5.3-prime | 🚀Throughput | ok | $4.52 | 900ms | — | 2.80 | 8.80 | |
| openrouter | gpt-6-sol-pro | { }JSON Output | pass | $4.57 | 637ms | — | 2.00 | 10.00 | |
| openrouter | step-3.7-flash | 💻Code Gen | ok | $4.62 | 3148ms | — | 0.20 | 1.15 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 💻Code Gen | ok | $4.64 | 1173ms | — | 0.29 | 1.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🧮Reasoning | ok | $4.65 | 805ms | — | 0.45 | 3.50 | |
| openrouter | qwen3.6-plus | 💻Code Gen | ok | $4.66 | 528ms | — | 0.33 | 1.95 | |
| openrouter | qwen3.7-max | { }JSON Output | pass | $4.67 | 784ms | — | 1.48 | 4.42 | |
| anthropic | claude-sonnet-5-5 | 💻Code Gen | ok | $4.68 | 3454ms | — | 2.00 | 10.00 | |
| openai | o3-2025-04-16 | { }JSON Output | pass | $4.68 | 1105ms | — | 10.00 | 40.00 | |
| openrouter | mistral-large-4-0 | 🧮Reasoning | ok | $4.74 | 960ms | — | 0.70 | 2.10 | |
| openrouter | muse-wonder | { }JSON Output | pass | $4.93 | 18081ms | — | 4.00 | 20.00 | |
| openrouter | seed-2.0-code | 💻Code Gen | ok | $5.05 | 484ms | — | 0.50 | 3.00 | |
| openrouter | command-a | 🚀Throughput | ok | $5.07 | 544ms | — | 2.50 | 10.00 | |
| openrouter | gpt-6.1-sol | 🚀Throughput | ok | $5.07 | 638ms | — | 2.00 | 10.00 | |
| openrouter | command-r-plus-08-2024 | 🚀Throughput | ok | $5.07 | 585ms | — | 2.50 | 10.00 | |
| openrouter | muse-spark-1.2 | 🧮Reasoning | ok | $5.09 | 4125ms | — | 1.25 | 4.25 | |
| openrouter | qwen3.8-max-0902 | 💻Code Gen | ok | $5.27 | 1085ms | — | 2.00 | 6.00 | |
| openrouter | gpt-6-sol-pro | 🧮Reasoning | ok | $5.34 | 995ms | — | 2.00 | 10.00 | |
| openrouter | qwen3.5-plus-02-15 | 💻Code Gen | ok | $5.37 | 807ms | — | 0.26 | 1.56 | |
| openrouter | qwen3.7-max | 🔍Context Recall | pass | $5.51 | 1693ms | — | 1.48 | 4.42 | |
| openrouter | qwen3.6-27b | 🧮Reasoning | ok | $5.85 | 713ms | — | 0.32 | 3.20 | |
| openrouter | grok-4.7 | 🚀Throughput | ok | $5.86 | 613ms | — | 2.00 | 6.00 | |
| openrouter | grok-4.6 | 🚀Throughput | ok | $5.88 | 1646ms | — | 2.00 | 6.00 | |
| anthropic | claude-opus-4-6 | 💻Code Gen | ok | $5.90 | 4581ms | — | 5.00 | 25.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | { }JSON Output | pass | $5.93 | 783ms | — | 0.45 | 3.50 | |
| together | Muse-Spark-Open-816B-A42B | 🧮Reasoning | ok | $5.96 | 11064ms | — | 1.25 | 4.25 | |
| together | GLM-5.3 | 💻Code Gen | ok | $6.03 | 7723ms | — | 1.40 | 4.40 | |
| openrouter | kimi-k3 | 💻Code Gen | ok | $6.11 | 558ms | — | 0.19 | 15.00 | |
| openai | gpt-4.1 | 🚀Throughput | ok | $6.12 | 5421ms | — | 2.00 | 8.00 | |
| openrouter | qwen3.6-27b | 💻Code Gen | ok | $6.14 | 1310ms | — | 0.32 | 3.20 | |
| openrouter | grok-4.20-multi-agent | ⚡Ping | ok | $6.16 | 1303ms | — | 1.25 | 2.50 | |
| openrouter | qwen3.5-397b-a17b | 🚀Throughput | ok | $6.39 | 1245ms | — | 0.50 | 3.60 | |
| openrouter | qwen3.6-27b | 🚀Throughput | ok | $6.40 | 1369ms | — | 0.32 | 3.20 | |
| openrouter | sonar-pro-search | 🚀Throughput | ok | $6.58 | 3631ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.7-max | 💻Code Gen | ok | $7.22 | 1551ms | — | 1.48 | 4.42 | |
| openai | o3-2025-04-16 | 🧮Reasoning | ok | $7.49 | 2268ms | — | 10.00 | 40.00 | |
| openai | gpt-4o-2024-08-06 | 🚀Throughput | ok | $7.65 | 5948ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | 🚀Throughput | ok | $7.65 | 4869ms | — | 2.50 | 10.00 | |
| anthropic | claude-sonnet-5 | 🚀Throughput | ok | $7.67 | 8039ms | — | 2.00 | 10.00 | |
| openrouter | sonar-pro | 🚀Throughput | ok | $8.02 | 1379ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.5-397b-a17b | 💻Code Gen | ok | $8.35 | 989ms | — | 0.50 | 3.60 | |
| openrouter | gpt-6-sol-pro | 💻Code Gen | ok | $8.37 | 576ms | — | 2.00 | 10.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 💻Code Gen | ok | $8.51 | 1370ms | — | 0.45 | 3.50 | |
| openrouter | fugu-ultra | ⚡Ping | ok | $8.53 | 5264ms | — | 5.00 | 30.00 | |
| openrouter | fugu-ultra | 🔍Context Recall | pass | $8.60 | 6336ms | — | 5.00 | 30.00 | |
| openrouter | qwen3.7-max | 🧮Reasoning | ok | $8.63 | 867ms | — | 1.48 | 4.42 | |
| deepinfra | Qwen3.5-27B | 🧮Reasoning | ok | $8.73 | 59641ms | — | 0.26 | 2.60 | |
| openrouter | gpt-6-astra | 💻Code Gen | ok | $9.44 | 798ms | — | 10.00 | 50.00 | |
| openrouter | glm-5.3-prime | 💻Code Gen | ok | $10.82 | 485ms | — | 2.80 | 8.80 | |
| openai | gpt-5.4-2026-03-05 | 🚀Throughput | ok | $11.43 | 11219ms | — | 2.50 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🚀Throughput | ok | $11.45 | 17881ms | — | 3.00 | 15.00 | |
| openrouter | muse-wonder | 🔍Context Recall | pass | $14.19 | 2255ms | — | 4.00 | 20.00 | |
| openrouter | fugu-ultra | { }JSON Output | pass | $14.35 | 10263ms | — | 5.00 | 30.00 | |
| openrouter | grok-4.20-multi-agent | 🔍Context Recall | pass | $14.54 | 745ms | — | 1.25 | 2.50 | |
| openai | o3-2025-04-16 | 💻Code Gen | ok | $14.91 | 2811ms | — | 10.00 | 40.00 | |
| openrouter | gpt-6-astra-pro | ⚡Ping | ok | $15.84 | 1571ms | — | 10.00 | 50.00 | |
| openrouter | gpt-6-sol-pro | 🚀Throughput | ok | $15.90 | 602ms | — | 2.00 | 10.00 | |
| openrouter | muse-wonder | 🧮Reasoning | ok | $16.77 | 7601ms | — | 4.00 | 20.00 | |
| openrouter | qwen3.5-397b-a17b | 🧮Reasoning | ok | $17.42 | 706ms | — | 0.50 | 3.60 | |
| openrouter | muse-wonder | 💻Code Gen | ok | $17.95 | 1899ms | — | 4.00 | 20.00 | |
| anthropic | claude-opus-4-6 | 🚀Throughput | ok | $19.09 | 17759ms | — | 5.00 | 25.00 | |
| openrouter | qwen3.5-27b | 🧮Reasoning | ok | $19.45 | 471ms | — | 0.26 | 2.60 | |
| openrouter | grok-4.20-multi-agent | 🧮Reasoning | ok | $19.85 | 585ms | — | 1.25 | 2.50 | |
| openrouter | gpt-6-astra-pro | { }JSON Output | pass | $20.57 | 1372ms | — | 10.00 | 50.00 | |
| openrouter | grok-4.20-multi-agent | 💻Code Gen | ok | $22.81 | 686ms | — | 1.25 | 2.50 | |
| openrouter | gpt-6-astra-pro | 🔍Context Recall | pass | $22.92 | 1323ms | — | 10.00 | 50.00 | |
| openrouter | gpt-6-astra-pro | 🧮Reasoning | ok | $23.44 | 2325ms | — | 10.00 | 50.00 | |
| openrouter | grok-4.20-multi-agent | { }JSON Output | pass | $24.07 | 741ms | — | 1.25 | 2.50 | |
| openrouter | gpt-6-astra | 🚀Throughput | ok | $25.36 | 1130ms | — | 10.00 | 50.00 | |
| openrouter | gpt-6-astra-pro | 💻Code Gen | ok | $40.25 | 999ms | — | 10.00 | 50.00 | |
| openrouter | fugu-ultra | 🧮Reasoning | ok | $53.25 | 15583ms | — | 5.00 | 30.00 | |
| openrouter | fugu-ultra | 💻Code Gen | ok | $63.74 | 15577ms | — | 5.00 | 30.00 | |
| openrouter | gpt-6-astra-pro | 🚀Throughput | ok | $79.67 | 1605ms | — | 10.00 | 50.00 | |
| openrouter | grok-4.20-multi-agent | 🚀Throughput | ok | $85.87 | 1263ms | — | 1.25 | 2.50 | |
| openrouter | fugu-ultra | 🚀Throughput | ok | $304 | 16352ms | — | 5.00 | 30.00 | |
| openrouter | jev-router | 🔍Context Recall | pass | — | 1420ms | — | — | — | |
| openrouter | jev-router | 🚀Throughput | ok | — | 1048ms | — | — | — | |
| openrouter | jev-router | 💻Code Gen | ok | — | 2316ms | — | — | — | |
| openrouter | jev-router | { }JSON Output | pass | — | 1398ms | — | — | — | |
| openrouter | jev-router | 🧮Reasoning | ok | — | 2430ms | — | — | — | |
| openrouter | jev-router | ⚡Ping | ok | — | 1957ms | — | — | — | |
| fireworks | minimax-m3 | 🔧Tool Use | pass | — | 2543ms | — | — | — | |
| fireworks | minimax-m3 | 🔍Context Recall | pass | — | 1292ms | — | — | — | |
| fireworks | minimax-m3 | 🚀Throughput | ok | — | 3894ms | — | — | — | |
| fireworks | minimax-m3 | 💻Code Gen | ok | — | 1240ms | — | — | — | |
| fireworks | minimax-m3 | { }JSON Output | pass | — | 845ms | — | — | — | |
| fireworks | minimax-m3 | 🧮Reasoning | ok | — | 1026ms | — | — | — | |
| fireworks | minimax-m3 | ⚡Ping | ok | — | 753ms | — | — | — | |
| fireworks | glm-5p3-flash | 🔧Tool Use | pass | — | 1375ms | — | — | — | |
| fireworks | glm-5p3-flash | 🔍Context Recall | pass | — | 1738ms | — | — | — | |
| fireworks | glm-5p3-flash | 💻Code Gen | ok | — | 7252ms | — | — | — | |
| fireworks | glm-5p3-flash | { }JSON Output | pass | — | 1722ms | — | — | — | |
| fireworks | glm-5p3-flash | 🧮Reasoning | ok | — | 2115ms | — | — | — | |
| fireworks | glm-5p3-flash | ⚡Ping | ok | — | 1132ms | — | — | — | |
| fireworks | glm-5p3 | 🔧Tool Use | pass | — | 950ms | — | — | — | |
| fireworks | glm-5p3 | 🔍Context Recall | pass | — | 3468ms | — | — | — | |
| fireworks | glm-5p3 | 💻Code Gen | ok | — | 8805ms | — | — | — | |
| fireworks | glm-5p3 | { }JSON Output | pass | — | 2006ms | — | — | — | |
| fireworks | glm-5p3 | 🧮Reasoning | ok | — | 1395ms | — | — | — | |
| fireworks | glm-5p3 | ⚡Ping | ok | — | 697ms | — | — | — | |
| fireworks | deepseek-v4p1-flash | 🔧Tool Use | pass | — | 1876ms | — | — | — | |
| fireworks | deepseek-v4p1-flash | 🔍Context Recall | pass | — | 1409ms | — | — | — | |
| fireworks | deepseek-v4p1-flash | 💻Code Gen | ok | — | 3677ms | — | — | — | |
| fireworks | deepseek-v4p1-flash | { }JSON Output | pass | — | 1351ms | — | — | — | |
| fireworks | deepseek-v4p1-flash | 🧮Reasoning | ok | — | 1488ms | — | — | — | |
| fireworks | deepseek-v4p1-flash | ⚡Ping | ok | — | 1342ms | — | — | — | |
| anthropic | claude-fable-5 | 🔧Tool Use | pass | — | 2731ms | — | — | — | |
| anthropic | claude-fable-5 | 🔍Context Recall | pass | — | 2715ms | — | — | — | |
| anthropic | claude-fable-5 | 🚀Throughput | ok | — | 10596ms | — | — | — | |
| anthropic | claude-fable-5 | 💻Code Gen | ok | — | 3150ms | — | — | — | |
| anthropic | claude-fable-5 | { }JSON Output | pass | — | 2126ms | — | — | — | |
| anthropic | claude-fable-5 | 🧮Reasoning | ok | — | 2614ms | — | — | — | |
| anthropic | claude-fable-5 | ⚡Ping | ok | — | 2524ms | — | — | — | |
| openrouter | solar-pro-3 | 🔍Context Recall | pass | — | 540ms | — | — | — | |
| openrouter | solar-pro-3 | 🚀Throughput | ok | — | 520ms | — | — | — | |
| openrouter | solar-pro-3 | 💻Code Gen | ok | — | 561ms | — | — | — | |
| openrouter | solar-pro-3 | { }JSON Output | pass | — | 340ms | — | — | — | |
| openrouter | solar-pro-3 | 🧮Reasoning | ok | — | 405ms | — | — | — | |
| openrouter | solar-pro-3 | ⚡Ping | ok | — | 652ms | — | — | — | |
| anthropic | claude-fable-5-1 | 🔧Tool Use | pass | — | 1394ms | — | — | — | |
| anthropic | claude-fable-5-1 | 🔍Context Recall | pass | — | 1357ms | — | — | — | |
| anthropic | claude-fable-5-1 | 🚀Throughput | ok | — | 11001ms | — | — | — | |
| anthropic | claude-fable-5-1 | 💻Code Gen | ok | — | 3395ms | — | — | — | |
| anthropic | claude-fable-5-1 | { }JSON Output | pass | — | 1312ms | — | — | — | |
| anthropic | claude-fable-5-1 | 🧮Reasoning | ok | — | 1207ms | — | — | — | |
| anthropic | claude-fable-5-1 | ⚡Ping | ok | — | 1157ms | — | — | — | |
| gemini | gemini-3.8-flash | 🔧Tool Use | pass | — | 2524ms | — | — | — | |
| gemini | gemini-3.8-flash | 🔍Context Recall | pass | — | 3090ms | — | — | — | |
| gemini | gemini-3.8-flash | 🚀Throughput | ok | — | 10843ms | — | — | — | |
| gemini | gemini-3.8-flash | { }JSON Output | pass | — | 3675ms | — | — | — | |
| gemini | gemini-3.8-flash | 🧮Reasoning | ok | — | 4552ms | — | — | — | |
| gemini | gemini-3.8-flash | ⚡Ping | ok | — | 3967ms | — | — | — | |
| gemini | gemini-3.7-flash | 🔧Tool Use | pass | — | 1962ms | — | — | — | |
| gemini | gemini-3.7-flash | 🔍Context Recall | pass | — | 4031ms | — | — | — | |
| gemini | gemini-3.7-flash | 🚀Throughput | ok | — | 8668ms | — | — | — | |
| gemini | gemini-3.7-flash | 💻Code Gen | ok | — | 6369ms | — | — | — | |
| gemini | gemini-3.7-flash | { }JSON Output | pass | — | 3494ms | — | — | — | |
| gemini | gemini-3.7-flash | 🧮Reasoning | ok | — | 4999ms | — | — | — | |
| gemini | gemini-3.7-flash | ⚡Ping | ok | — | 4266ms | — | — | — | |
| fireworks | auto | 🔧Tool Use | pass | — | 1906ms | — | — | — | |
| fireworks | auto | 🔍Context Recall | pass | — | 1784ms | — | — | — | |
| fireworks | auto | 🚀Throughput | ok | — | 7355ms | — | — | — | |
| fireworks | auto | 💻Code Gen | ok | — | 4554ms | — | — | — | |
| fireworks | auto | { }JSON Output | pass | — | 3478ms | — | — | — | |
| fireworks | auto | 🧮Reasoning | ok | — | 2934ms | — | — | — | |
| fireworks | auto | ⚡Ping | ok | — | 2291ms | — | — | — | |
| fireworks | kimi-k3 | 🔧Tool Use | pass | — | 5488ms | — | — | — | |
| fireworks | kimi-k3 | 🔍Context Recall | pass | — | 6690ms | — | — | — | |
| fireworks | kimi-k3 | 💻Code Gen | ok | — | 13256ms | — | — | — | |
| fireworks | kimi-k3 | { }JSON Output | pass | — | 4515ms | — | — | — | |
| fireworks | kimi-k3 | 🧮Reasoning | ok | — | 5284ms | — | — | — | |
| fireworks | kimi-k3 | ⚡Ping | ok | — | 2970ms | — | — | — | |
| fireworks | deepseek-v4p1-flash-1017 | 🔧Tool Use | pass | — | 795ms | — | — | — | |
| fireworks | deepseek-v4p1-flash-1017 | 🔍Context Recall | pass | — | 1099ms | — | — | — | |
| fireworks | deepseek-v4p1-flash-1017 | 💻Code Gen | ok | — | 3480ms | — | — | — | |
| fireworks | deepseek-v4p1-flash-1017 | { }JSON Output | pass | — | 1305ms | — | — | — | |
| fireworks | deepseek-v4p1-flash-1017 | 🧮Reasoning | ok | — | 1021ms | — | — | — | |
| fireworks | deepseek-v4p1-flash-1017 | ⚡Ping | ok | — | 722ms | — | — | — | |
| deepinfra | Step-5-Preview | 🔧Tool Use | pass | — | 1270ms | — | — | — | |
| deepinfra | Step-5-Preview | 🔍Context Recall | pass | — | 1284ms | — | — | — | |
| deepinfra | Step-5-Preview | 🚀Throughput | ok | — | 3847ms | — | — | — | |
| deepinfra | Step-5-Preview | 💻Code Gen | ok | — | 2823ms | — | — | — | |
| deepinfra | Step-5-Preview | { }JSON Output | pass | — | 1408ms | — | — | — | |
| deepinfra | Step-5-Preview | 🧮Reasoning | ok | — | 1711ms | — | — | — | |
| deepinfra | Step-5-Preview | ⚡Ping | ok | — | 981ms | — | — | — | |
| openrouter | gemini-2.5-flash | 🔍Context Recall | pass | — | 910ms | — | — | — | |
| openrouter | gemini-2.5-flash | 🚀Throughput | ok | — | 997ms | — | — | — | |
| openrouter | gemini-2.5-flash | 💻Code Gen | ok | — | 875ms | — | — | — | |
| openrouter | gemini-2.5-flash | { }JSON Output | pass | — | 947ms | — | — | — | |
| openrouter | gemini-2.5-flash | 🧮Reasoning | ok | — | 866ms | — | — | — | |
| openrouter | gemini-2.5-flash | ⚡Ping | ok | — | 850ms | — | — | — | |
| openrouter | claude-haiku-4.5 | 🔍Context Recall | pass | — | 1116ms | — | — | — | |
| openrouter | claude-haiku-4.5 | 🚀Throughput | ok | — | 1404ms | — | — | — | |
| openrouter | claude-haiku-4.5 | 💻Code Gen | ok | — | 1087ms | — | — | — | |
| openrouter | claude-haiku-4.5 | { }JSON Output | pass | — | 1082ms | — | — | — | |
| openrouter | claude-haiku-4.5 | 🧮Reasoning | ok | — | 1705ms | — | — | — | |
| openrouter | claude-haiku-4.5 | ⚡Ping | ok | — | 1104ms | — | — | — | |
| gemini | nano-banana-pro-preview | 🔧Tool Use | pass | — | 2789ms | — | — | — | |
| gemini | nano-banana-pro-preview | 🔍Context Recall | pass | — | 5747ms | — | — | — | |
| gemini | nano-banana-pro-preview | 💻Code Gen | ok | — | 11011ms | — | — | — | |
| gemini | nano-banana-pro-preview | { }JSON Output | pass | — | 4786ms | — | — | — | |
| gemini | nano-banana-pro-preview | 🧮Reasoning | ok | — | 7116ms | — | — | — | |
| gemini | nano-banana-pro-preview | ⚡Ping | ok | — | 3279ms | — | — | — | |
| fireworks | auto | 🔧Tool Use | pass | — | 2501ms | — | — | — | |
| fireworks | auto | 🔍Context Recall | pass | — | 3437ms | — | — | — | |
| fireworks | auto | 🚀Throughput | ok | — | 9790ms | — | — | — | |
| fireworks | auto | 💻Code Gen | ok | — | 3889ms | — | — | — | |
| fireworks | auto | { }JSON Output | pass | — | 4727ms | — | — | — | |
| fireworks | auto | 🧮Reasoning | ok | — | 3699ms | — | — | — | |
| fireworks | auto | ⚡Ping | ok | — | 2486ms | — | — | — | |
| openrouter | switchyard | 🔍Context Recall | pass | — | 2700ms | — | — | — | |
| openrouter | switchyard | 💻Code Gen | ok | — | 2590ms | — | — | — | |
| openrouter | switchyard | { }JSON Output | pass | — | 2401ms | — | — | — | |
| openrouter | switchyard | 🧮Reasoning | ok | — | 3048ms | — | — | — | |
| openrouter | switchyard | ⚡Ping | ok | — | 2228ms | — | — | — |
Each cell is the latest single run (n=1) — a fluke and a real weakness look the same here. For repeated-run, variance-aware numbers see the Deep Suite and Coding Models. On speed/latency tests, ok means the model responded, not that it was correct.