Loading benchmark data…
EyesInAI·Loading live benchmark data
Recent vs. prior changes in latency, cost, and reliability across all tested models — each model's latest results compared against its earlier ones.
| Provider | Model | Test | Runs | Latency | $ / 1k | Pass | Trend |
|---|---|---|---|---|---|---|---|
| qwen-2-1.5b-instruct | 🔧 Tool Use | 3 | — | — | 0% | ||
| qwen-2-1.5b-instruct | 🔍 Context Recall | 3 | — | — | 0% | ||
| qwen-2-1.5b-instruct | 🚀 Throughput | 3 | 1722ms | $0.055 | 100% | ||
| qwen-2-1.5b-instruct | 💻 Code Gen | 3 | 614ms | $0.015 | 100% | ||
| qwen-2-1.5b-instruct | { } JSON Output | 3 | — | — | 0% | ||
| qwen-2-1.5b-instruct | 🧮 Reasoning | 3 | 442ms | <$0.01 | 100% | ||
| qwen-2-1.5b-instruct | ⚡ Ping | 3 | 2737ms | <$0.01 | 100% | ||
| glm-5v-turbo | 🔍 Context Recall | 3 | 3469ms | $1.65 | 100% | ||
| glm-5v-turbo | 🚀 Throughput | 3 | 2133ms | $2.04 | 100% | ||
| glm-5v-turbo | 💻 Code Gen | 3 | 1963ms | $3.86 | 100% | ||
| glm-5v-turbo | { } JSON Output | 3 | 2078ms | $0.730 | 100% | ||
| glm-5v-turbo | 🧮 Reasoning | 3 | 3293ms | $1.92 | 100% | ||
| glm-5v-turbo | ⚡ Ping | 3 | 1882ms | $0.222 | 100% | ||
| glm-4.6v | 🔍 Context Recall | 3 | 1494ms | $0.702 | 100% | ||
| glm-4.6v | 🚀 Throughput | 3 | 2376ms | $0.461 | 100% | ||
| glm-4.6v | 💻 Code Gen | 3 | 3370ms | $0.709 | 50% | ||
| glm-4.6v | { } JSON Output | 3 | 1861ms | $0.225 | 100% | ||
| glm-4.6v | 🧮 Reasoning | 3 | 3731ms | $0.191 | 100% | ||
| glm-4.6v | ⚡ Ping | 3 | 2057ms | $0.054 | 100% | ||
| grok-build-0.1 | 🔍 Context Recall | 3 | 1246ms | $1.27 | 100% | ||
| grok-build-0.1 | 🚀 Throughput | 3 | 909ms | $3.84 | 100% | ||
| grok-build-0.1 | 💻 Code Gen | 3 | 1023ms | $1.40 | 100% | ||
| grok-build-0.1 | { } JSON Output | 3 | 1139ms | $1.19 | 100% | ||
| grok-build-0.1 | 🧮 Reasoning | 3 | 821ms | $2.47 | 100% | ||
| grok-build-0.1 | ⚡ Ping | 3 | 781ms | $0.446 | 100% | ||
| unslopnemo-12b | 🔍 Context Recall | 3 | 640ms | $0.095 | 100% | ||
| unslopnemo-12b | 🚀 Throughput | 3 | 572ms | $0.214 | 100% | ||
| unslopnemo-12b | 💻 Code Gen | 3 | 717ms | $0.066 | 100% | ||
| unslopnemo-12b | { } JSON Output | 3 | 1507ms | $0.039 | 100% | ||
| unslopnemo-12b | 🧮 Reasoning | 3 | 628ms | $0.020 | 50% | ||
| unslopnemo-12b | ⚡ Ping | 3 | 774ms | <$0.01 | 100% | ||
| step-3.5-flash | 🔍 Context Recall | 3 | 1437ms | $0.153 | 100% | ||
| step-3.5-flash | 🚀 Throughput | 3 | 1410ms | $0.154 | 100% | ||
| step-3.5-flash | 💻 Code Gen | 3 | 1415ms | $0.526 | 100% | ||
| step-3.5-flash | { } JSON Output | 3 | 1044ms | $0.084 | 100% | ||
| step-3.5-flash | 🧮 Reasoning | 3 | 1991ms | $0.289 | 100% | ||
| step-3.5-flash | ⚡ Ping | 3 | 1617ms | $0.039 | 100% | ||
| qwen3.6-35b-a3b | 🔍 Context Recall | 3 | 1035ms | $0.704 | 100% | ||
| qwen3.6-35b-a3b | 🚀 Throughput | 3 | 944ms | $0.454 | 100% | ||
| qwen3.6-35b-a3b | 💻 Code Gen | 3 | 1371ms | $1.39 | 100% | ||
| qwen3.6-35b-a3b | { } JSON Output | 3 | 2042ms | $1.06 | 100% | ||
| qwen3.6-35b-a3b | 🧮 Reasoning | 3 | 1195ms | $0.925 | 100% | ||
| qwen3.6-35b-a3b | ⚡ Ping | 3 | 945ms | $0.219 | 100% | ||
| qwen3.5-35b-a3b | 🔍 Context Recall | 3 | 1077ms | $0.992 | 100% | ||
| qwen3.5-35b-a3b | 🚀 Throughput | 3 | 1004ms | $0.638 | 100% | ||
| qwen3.5-35b-a3b | 💻 Code Gen | 3 | 1520ms | $2.37 | 100% | ||
| qwen3.5-35b-a3b | { } JSON Output | 3 | 890ms | $0.923 | 100% | ||
| qwen3.5-35b-a3b | 🧮 Reasoning | 3 | 1223ms | $4.60 | 100% | ||
| qwen3.5-35b-a3b | ⚡ Ping | 3 | 1009ms | $0.232 | 100% | ||
| qwen3-vl-30b-a3b-instruct | 🔍 Context Recall | 3 | 3045ms | $0.049 | 100% | ||
| qwen3-vl-30b-a3b-instruct | 🚀 Throughput | 3 | 644ms | $0.306 | 100% | ||
| qwen3-vl-30b-a3b-instruct | 💻 Code Gen | 3 | 420ms | $0.074 | 100% | ||
| qwen3-vl-30b-a3b-instruct | { } JSON Output | 3 | 2955ms | $0.027 | 100% | ||
| qwen3-vl-30b-a3b-instruct | 🧮 Reasoning | 3 | 425ms | $0.030 | 100% | ||
| qwen3-vl-30b-a3b-instruct | ⚡ Ping | 3 | 5325ms | <$0.01 | 100% | ||
| qwen3-coder-plus | 🔍 Context Recall | 3 | 766ms | $0.250 | 100% | ||
| qwen3-coder-plus | 🚀 Throughput | 3 | 1005ms | $1.65 | 100% | ||
| qwen3-coder-plus | 💻 Code Gen | 3 | 727ms | $0.355 | 100% | ||
| qwen3-coder-plus | { } JSON Output | 3 | 758ms | $0.156 | 100% | ||
| qwen3-coder-plus | 🧮 Reasoning | 3 | 1632ms | $0.174 | 100% | ||
| qwen3-coder-plus | ⚡ Ping | 3 | 845ms | $0.013 | 100% | ||
| qwen3-30b-a3b-thinking-2507 | 🔍 Context Recall | 3 | 322ms | $0.974 | 100% | ||
| qwen3-30b-a3b-thinking-2507 | 🚀 Throughput | 3 | 360ms | $3.04 | 100% | ||
| qwen3-30b-a3b-thinking-2507 | 💻 Code Gen | 3 | 679ms | $2.83 | 100% | ||
| qwen3-30b-a3b-thinking-2507 | { } JSON Output | 3 | 336ms | $0.924 | 100% | ||
| qwen3-30b-a3b-thinking-2507 | 🧮 Reasoning | 3 | 323ms | $0.670 | 100% | ||
| qwen3-30b-a3b-thinking-2507 | ⚡ Ping | 3 | 420ms | $0.363 | 100% | ||
| qwen2.5-vl-72b-instruct | 🔍 Context Recall | 3 | 667ms | $0.197 | 100% | ||
| qwen2.5-vl-72b-instruct | 🚀 Throughput | 3 | 707ms | $0.535 | 100% | ||
| qwen2.5-vl-72b-instruct | 💻 Code Gen | 3 | 750ms | $0.109 | 100% | ||
| qwen2.5-vl-72b-instruct | { } JSON Output | 3 | 871ms | $0.091 | 100% | ||
| qwen2.5-vl-72b-instruct | 🧮 Reasoning | 3 | 618ms | $0.068 | 100% | ||
| qwen2.5-vl-72b-instruct | ⚡ Ping | 3 | 1075ms | $0.019 | 100% | ||
| laguna-xs-2.1 | 🔍 Context Recall | 3 | 520ms | free | 100% | ||
| laguna-xs-2.1 | 🚀 Throughput | 3 | 508ms | free | 100% | ||
| laguna-xs-2.1 | 💻 Code Gen | 3 | 503ms | free | 100% | ||
| laguna-xs-2.1 | { } JSON Output | 3 | 516ms | free | 100% | ||
| laguna-xs-2.1 | 🧮 Reasoning | 3 | 501ms | free | 100% | ||
| laguna-xs-2.1 | ⚡ Ping | 3 | 603ms | free | 100% | ||
| nemotron-3-ultra-550b-a55b | 🔍 Context Recall | 3 | 708ms | $0.729 | 100% | ||
| nemotron-3-ultra-550b-a55b | 🚀 Throughput | 3 | 1613ms | $1.83 | 100% | ||
| nemotron-3-ultra-550b-a55b | 💻 Code Gen | 3 | 713ms | $1.00 | 100% | ||
| nemotron-3-ultra-550b-a55b | { } JSON Output | 3 | 862ms | $0.899 | 100% | ||
| nemotron-3-ultra-550b-a55b | 🧮 Reasoning | 3 | 1936ms | $0.277 | 100% | ||
| nemotron-3-ultra-550b-a55b | ⚡ Ping | 3 | 1541ms | $0.106 | 100% | ||
| hermes-3-llama-3.1-405b | 🔍 Context Recall | 2 | 658ms | $0.222 | 100% | ||
| hermes-3-llama-3.1-405b | 🚀 Throughput | 2 | 599ms | $0.540 | 100% | ||
| hermes-3-llama-3.1-405b | 💻 Code Gen | 2 | 614ms | $0.145 | 100% | ||
| hermes-3-llama-3.1-405b | { } JSON Output | 2 | 586ms | $0.088 | 100% | ||
| hermes-3-llama-3.1-405b | 🧮 Reasoning | 2 | 661ms | $0.063 | 100% | ||
| hermes-3-llama-3.1-405b | ⚡ Ping | 2 | 656ms | $0.018 | 100% | ||
| Mistral-Nemo-Instruct-2407 | 🔧 Tool Use | 2 | 3039ms | <$0.01 | 100% | ||
| Mistral-Nemo-Instruct-2407 | 🔍 Context Recall | 2 | 1321ms | <$0.01 | 100% | ||
| Mistral-Nemo-Instruct-2407 | 🚀 Throughput | 2 | — | — | 0% | ||
| Mistral-Nemo-Instruct-2407 | 💻 Code Gen | 2 | — | — | 0% | ||
| Mistral-Nemo-Instruct-2407 | { } JSON Output | 2 | 2391ms | <$0.01 | 100% | ||
| Mistral-Nemo-Instruct-2407 | 🧮 Reasoning | 2 | — | — | 0% | ||
| Mistral-Nemo-Instruct-2407 | ⚡ Ping | 2 | 1407ms | <$0.01 | 100% | ||
| gemma-4-26B-A4B-it | 🔧 Tool Use | 2 | 1335ms | $0.013 | 100% | ||
| gemma-4-26B-A4B-it | 🔍 Context Recall | 2 | 1148ms | $0.020 | 100% | ||
| gemma-4-26B-A4B-it | 🚀 Throughput | 2 | 17762ms | $0.260 | 100% | ||
| gemma-4-26B-A4B-it | 💻 Code Gen | 2 | 3820ms | $0.050 | 100% | ||
| gemma-4-26B-A4B-it | { } JSON Output | 2 | 1403ms | $0.015 | 100% | ||
| gemma-4-26B-A4B-it | 🧮 Reasoning | 2 | 1600ms | $0.017 | 100% | ||
| gemma-4-26B-A4B-it | ⚡ Ping | 2 | 1026ms | <$0.01 | 100% | ||
| Qwen3.7-Max | 🔧 Tool Use | 2 | 5002ms | $2.19 | 100% | ||
| Qwen3.7-Max | 🔍 Context Recall | 2 | 10871ms | $5.41 | 100% | ||
| Qwen3.7-Max | 🚀 Throughput | 2 | — | — | 0% | ||
| Qwen3.7-Max | 💻 Code Gen | 2 | — | — | 0% | ||
| Qwen3.7-Max | { } JSON Output | 2 | 11026ms | $4.42 | 100% | ||
| Qwen3.7-Max | 🧮 Reasoning | 2 | — | — | 0% | ||
| Qwen3.7-Max | ⚡ Ping | 2 | 8886ms | $1.98 | 100% | ||
| Qwen3.5-122B-A10B | 🔧 Tool Use | 2 | 1362ms | $0.309 | 100% | ||
| Qwen3.5-122B-A10B | 🔍 Context Recall | 2 | 2766ms | $0.921 | 100% | ||
| Qwen3.5-122B-A10B | 🚀 Throughput | 2 | 5143ms | $1.83 | 100% | ||
| Qwen3.5-122B-A10B | 💻 Code Gen | 2 | — | — | 0% | ||
| Qwen3.5-122B-A10B | { } JSON Output | 2 | — | — | 0% | ||
| Qwen3.5-122B-A10B | 🧮 Reasoning | 2 | 3073ms | $0.865 | 100% | ||
| Qwen3.5-122B-A10B | ⚡ Ping | 2 | 2402ms | $0.658 | 100% | ||
| MiniMax-M3 | 🔧 Tool Use | 2 | 5571ms | $0.186 | 100% | ||
| MiniMax-M3 | 🔍 Context Recall | 2 | 11129ms | $0.274 | 100% | ||
| MiniMax-M3 | 🚀 Throughput | 2 | — | — | 0% | ||
| MiniMax-M3 | 💻 Code Gen | 2 | — | — | 0% | ||
| MiniMax-M3 | { } JSON Output | 2 | 7416ms | $0.159 | 100% | ||
| MiniMax-M3 | 🧮 Reasoning | 2 | 9601ms | $0.169 | 100% | ||
| MiniMax-M3 | ⚡ Ping | 2 | 2925ms | $0.090 | 100% | ||
| claude-opus-4-6 | 🔧 Tool Use | 2 | — | — | 0% | ||
| claude-opus-4-6 | 🔍 Context Recall | 2 | 2423ms | $2.29 | 100% | ||
| claude-opus-4-6 | 🚀 Throughput | 2 | 18069ms | $19.09 | 100% | ||
| claude-opus-4-6 | 💻 Code Gen | 2 | 4285ms | $6.10 | 100% | ||
| claude-opus-4-6 | { } JSON Output | 2 | 2142ms | $0.895 | 100% | ||
| claude-opus-4-6 | 🧮 Reasoning | 2 | 2832ms | $1.28 | 100% | ||
| claude-opus-4-6 | ⚡ Ping | 2 | 1628ms | $0.170 | 100% | ||
| gpt-oss-120b | 🔧 Tool Use | 2 | 847ms | $0.019 | 100% | ||
| gpt-oss-120b | 🔍 Context Recall | 2 | 1556ms | $0.028 | 100% | ||
| gpt-oss-120b | 🚀 Throughput | 2 | 6060ms | $0.132 | 100% | ||
| gpt-oss-120b | 💻 Code Gen | 2 | 2756ms | $0.044 | 100% | ||
| gpt-oss-120b | { } JSON Output | 2 | — | — | 0% | ||
| gpt-oss-120b | 🧮 Reasoning | 2 | 1998ms | $0.027 | 100% | ||
| gpt-oss-120b | ⚡ Ping | 2 | 1833ms | <$0.01 | 100% | ||
| glm-5-turbo | 🔍 Context Recall | 2 | 8462ms | $2.15 | 100% | ||
| glm-5-turbo | 🚀 Throughput | 2 | 8734ms | $2.04 | 100% | ||
| glm-5-turbo | 💻 Code Gen | 2 | 9408ms | $2.04 | 100% | ||
| glm-5-turbo | { } JSON Output | 2 | 8817ms | $2.05 | 100% | ||
| glm-5-turbo | 🧮 Reasoning | 2 | 9824ms | $1.65 | 100% | ||
| glm-5-turbo | ⚡ Ping | 2 | 7598ms | $0.518 | 100% | ||
| glm-4.5-air | 🔍 Context Recall | 2 | 683ms | $0.322 | 100% | ||
| glm-4.5-air | 🚀 Throughput | 2 | 998ms | $0.430 | 100% | ||
| glm-4.5-air | 💻 Code Gen | 2 | — | — | 0% | ||
| glm-4.5-air | { } JSON Output | 2 | 1615ms | $0.214 | 100% | ||
| glm-4.5-air | 🧮 Reasoning | 2 | 745ms | $1.63 | 100% | ||
| glm-4.5-air | ⚡ Ping | 2 | 577ms | $0.119 | 100% | ||
| grok-4.20 | 🔍 Context Recall | 2 | 740ms | $0.503 | 100% | ||
| grok-4.20 | 🚀 Throughput | 2 | 564ms | $1.52 | 100% | ||
| grok-4.20 | 💻 Code Gen | 2 | 749ms | $0.529 | 100% | ||
| grok-4.20 | { } JSON Output | 2 | 712ms | $0.375 | 100% | ||
| grok-4.20 | 🧮 Reasoning | 2 | 673ms | $0.316 | 100% | ||
| grok-4.20 | ⚡ Ping | 2 | 797ms | $0.241 | 100% | ||
| hy3-preview | 🔍 Context Recall | 2 | 1842ms | $0.273 | 100% | ||
| hy3-preview | 🚀 Throughput | 2 | 2438ms | $0.308 | 100% | ||
| hy3-preview | 💻 Code Gen | 2 | 1922ms | $0.423 | 100% | ||
| hy3-preview | { } JSON Output | 2 | 2002ms | $0.200 | 100% | ||
| hy3-preview | 🧮 Reasoning | 2 | 1774ms | $0.127 | 100% | ||
| hy3-preview | ⚡ Ping | 2 | 2061ms | $0.044 | 100% | ||
| l3-lunaris-8b | 🔍 Context Recall | 2 | 817ms | <$0.01 | 100% | ||
| l3-lunaris-8b | 🚀 Throughput | 2 | 398ms | $0.027 | 100% | ||
| l3-lunaris-8b | 💻 Code Gen | 2 | 312ms | <$0.01 | 100% | ||
| l3-lunaris-8b | { } JSON Output | 2 | 921ms | <$0.01 | 100% | ||
| l3-lunaris-8b | 🧮 Reasoning | 2 | — | — | 0% | ||
| l3-lunaris-8b | ⚡ Ping | 2 | 507ms | <$0.01 | 100% | ||
| qwen3.7-max | 🔍 Context Recall | 2 | 1004ms | $2.10 | 100% | ||
| qwen3.7-max | 🚀 Throughput | 2 | 675ms | $2.27 | 100% | ||
| qwen3.7-max | 💻 Code Gen | 2 | 606ms | $7.61 | 100% | ||
| qwen3.7-max | { } JSON Output | 2 | 670ms | $2.36 | 100% | ||
| qwen3.7-max | 🧮 Reasoning | 2 | 965ms | $8.07 | 100% | ||
| qwen3.7-max | ⚡ Ping | 2 | 728ms | $0.707 | 100% | ||
| qwen3.5-plus-02-15 | 🔍 Context Recall | 2 | 509ms | $0.904 | 100% | ||
| qwen3.5-plus-02-15 | 🚀 Throughput | 2 | 509ms | $0.794 | 100% | ||
| qwen3.5-plus-02-15 | 💻 Code Gen | 2 | 481ms | $2.75 | 100% | ||
| qwen3.5-plus-02-15 | { } JSON Output | 2 | 508ms | $1.04 | 100% | ||
| qwen3.5-plus-02-15 | 🧮 Reasoning | 2 | 494ms | $3.29 | 100% | ||
| qwen3.5-plus-02-15 | ⚡ Ping | 2 | 466ms | $0.432 | 100% | ||
| qwen3-vl-8b-thinking | 🔍 Context Recall | 2 | 312ms | $1.29 | 100% | ||
| qwen3-vl-8b-thinking | 🚀 Throughput | 2 | 335ms | $2.25 | 100% | ||
| qwen3-vl-8b-thinking | 💻 Code Gen | 2 | 286ms | $0.705 | 100% | ||
| qwen3-vl-8b-thinking | { } JSON Output | 2 | 308ms | $0.448 | 100% | ||
| qwen3-vl-8b-thinking | 🧮 Reasoning | 2 | 366ms | $0.685 | 100% | ||
| qwen3-vl-8b-thinking | ⚡ Ping | 2 | 331ms | $0.499 | 100% | ||
| qwen3-next-80b-a3b-thinking | 🔍 Context Recall | 2 | 390ms | $0.562 | 100% | ||
| qwen3-next-80b-a3b-thinking | 🚀 Throughput | 2 | 506ms | $2.17 | 100% | ||
| qwen3-next-80b-a3b-thinking | 💻 Code Gen | 2 | 380ms | $1.21 | 100% | ||
| qwen3-next-80b-a3b-thinking | { } JSON Output | 2 | 400ms | $0.923 | 100% | ||
| qwen3-next-80b-a3b-thinking | 🧮 Reasoning | 2 | 907ms | $1.03 | 100% | ||
| qwen3-next-80b-a3b-thinking | ⚡ Ping | 2 | 619ms | $0.329 | 100% | ||
| qwen3-coder-30b-a3b-instruct | 🔍 Context Recall | 2 | 667ms | $0.026 | 100% | ||
| qwen3-coder-30b-a3b-instruct | 🚀 Throughput | 2 | 1012ms | $0.143 | 100% | ||
| qwen3-coder-30b-a3b-instruct | 💻 Code Gen | 2 | — | — | 0% | ||
| qwen3-coder-30b-a3b-instruct | { } JSON Output | 2 | 1256ms | $0.014 | 100% | ||
| qwen3-coder-30b-a3b-instruct | 🧮 Reasoning | 2 | 745ms | $0.019 | 100% | ||
| qwen3-coder-30b-a3b-instruct | ⚡ Ping | 2 | 1217ms | <$0.01 | 100% | ||
| qwen3-235b-a22b-thinking-2507 | 🔍 Context Recall | 2 | 384ms | $1.06 | 100% | ||
| qwen3-235b-a22b-thinking-2507 | 🚀 Throughput | 2 | 491ms | $2.64 | 100% | ||
| qwen3-235b-a22b-thinking-2507 | 💻 Code Gen | 2 | 1576ms | $7.78 | 100% | ||
| qwen3-235b-a22b-thinking-2507 | { } JSON Output | 2 | 310ms | $2.39 | 100% | ||
| qwen3-235b-a22b-thinking-2507 | 🧮 Reasoning | 2 | 1059ms | $0.102 | 100% | ||
| qwen3-235b-a22b-thinking-2507 | ⚡ Ping | 2 | 707ms | $0.015 | 100% | ||
| qwen-2.5-coder-32b-instruct | 🔍 Context Recall | 2 | 319ms | $0.177 | 100% | ||
| qwen-2.5-coder-32b-instruct | 🚀 Throughput | 2 | 355ms | $0.539 | 100% | ||
| qwen-2.5-coder-32b-instruct | 💻 Code Gen | 2 | — | — | 0% | ||
| qwen-2.5-coder-32b-instruct | { } JSON Output | 2 | 370ms | $0.076 | 100% | ||
| qwen-2.5-coder-32b-instruct | 🧮 Reasoning | 2 | — | — | 0% | ||
| qwen-2.5-coder-32b-instruct | ⚡ Ping | 2 | 823ms | $0.026 | 100% | ||
| sonar-pro | 🔍 Context Recall | 2 | 1170ms | $1.23 | 100% | ||
| sonar-pro | 🚀 Throughput | 2 | 1393ms | $8.05 | 100% | ||
| sonar-pro | 💻 Code Gen | 2 | 2601ms | $1.64 | 100% | ||
| sonar-pro | { } JSON Output | 2 | 3398ms | $0.450 | 100% | ||
| sonar-pro | 🧮 Reasoning | 2 | 2674ms | $0.489 | 100% | ||
| sonar-pro | ⚡ Ping | 2 | 2326ms | $0.036 | 100% | ||
| nemotron-3-nano-omni-30b-a3b-reasoning:free | 🔍 Context Recall | 2 | — | — | 0% | ||
| nemotron-3-nano-omni-30b-a3b-reasoning:free | 🚀 Throughput | 2 | 350ms | — | 100% | ||
| GLM-4.7 | 🔧 Tool Use | 2 | 48338ms | $0.324 | 100% | ||
| GLM-4.7 | 🔍 Context Recall | 2 | 56848ms | $0.781 | 100% | ||
| GLM-4.7 | 🚀 Throughput | 2 | — | — | 0% | ||
| GLM-4.7 | 💻 Code Gen | 2 | — | — | 0% | ||
| GLM-4.7 | { } JSON Output | 2 | 23265ms | $0.558 | 100% | ||
| GLM-4.7 | 🧮 Reasoning | 2 | — | — | 0% | ||
| GLM-4.7 | ⚡ Ping | 2 | 7063ms | $0.183 | 100% | ||
| Nemotron-3-Nano-30B-A3B | 🔧 Tool Use | 2 | 1866ms | $0.053 | 100% | ||
| Nemotron-3-Nano-30B-A3B | 🔍 Context Recall | 2 | 2678ms | $0.079 | 100% | ||
| Nemotron-3-Nano-30B-A3B | 🚀 Throughput | 2 | 4822ms | $0.153 | 100% | ||
| Nemotron-3-Nano-30B-A3B | 💻 Code Gen | 2 | 1684ms | $0.035 | 100% | ||
| Nemotron-3-Nano-30B-A3B | { } JSON Output | 2 | 2451ms | $0.059 | 100% | ||
| Nemotron-3-Nano-30B-A3B | 🧮 Reasoning | 2 | 2774ms | $0.073 | 100% | ||
| Nemotron-3-Nano-30B-A3B | ⚡ Ping | 2 | 1179ms | $0.013 | 100% | ||
| phi-4 | 🔧 Tool Use | 2 | — | — | 0% | ||
| phi-4 | 🔍 Context Recall | 2 | 1167ms | $0.018 | 100% | ||
| phi-4 | 🚀 Throughput | 2 | 10009ms | $0.108 | 100% | ||
| phi-4 | 💻 Code Gen | 2 | 2418ms | $0.020 | 100% | ||
| phi-4 | { } JSON Output | 2 | 1349ms | <$0.01 | 100% | ||
| phi-4 | 🧮 Reasoning | 2 | 2067ms | $0.017 | 100% | ||
| phi-4 | ⚡ Ping | 2 | 4231ms | $0.039 | 100% | ||
| DeepSeek-V3 | 🔧 Tool Use | 2 | 5631ms | $0.134 | 100% | ||
| DeepSeek-V3 | 🔍 Context Recall | 2 | 6374ms | $0.099 | 100% | ||
| DeepSeek-V3 | 🚀 Throughput | 2 | — | — | 0% | ||
| DeepSeek-V3 | 💻 Code Gen | 2 | 10597ms | $0.109 | 100% | ||
| DeepSeek-V3 | { } JSON Output | 2 | 7460ms | $0.046 | 100% | ||
| DeepSeek-V3 | 🧮 Reasoning | 2 | 5520ms | $0.054 | 100% | ||
| DeepSeek-V3 | ⚡ Ping | 2 | 7038ms | <$0.01 | 100% | ||
| Qwen3-VL-30B-A3B-Instruct | 🔧 Tool Use | 2 | 2533ms | $0.041 | 100% | ||
| Qwen3-VL-30B-A3B-Instruct | 🔍 Context Recall | 2 | 2217ms | $0.049 | 100% | ||
| Qwen3-VL-30B-A3B-Instruct | 🚀 Throughput | 2 | — | — | 0% | ||
| Qwen3-VL-30B-A3B-Instruct | 💻 Code Gen | 2 | 5639ms | $0.072 | 100% | ||
| Qwen3-VL-30B-A3B-Instruct | { } JSON Output | 2 | 2429ms | $0.027 | 100% | ||
| Qwen3-VL-30B-A3B-Instruct | 🧮 Reasoning | 2 | 3627ms | $0.030 | 100% | ||
| Qwen3-VL-30B-A3B-Instruct | ⚡ Ping | 2 | 873ms | <$0.01 | 100% | ||
| Qwen3-30B-A3B | 🔧 Tool Use | 2 | 3576ms | $0.101 | 100% | ||
| Qwen3-30B-A3B | 🔍 Context Recall | 2 | 3275ms | $0.199 | 100% | ||
| Qwen3-30B-A3B | 🚀 Throughput | 2 | 7315ms | $0.383 | 100% | ||
| Qwen3-30B-A3B | 💻 Code Gen | 2 | — | — | 0% | ||
| Qwen3-30B-A3B | { } JSON Output | 2 | — | — | 0% | ||
| Qwen3-30B-A3B | 🧮 Reasoning | 2 | 5722ms | $0.174 | 100% | ||
| Qwen3-30B-A3B | ⚡ Ping | 2 | 1771ms | $0.070 | 100% | ||
| MiniMax-M2.7-Turbo | 🔧 Tool Use | 2 | 2362ms | $0.197 | 100% | ||
| MiniMax-M2.7-Turbo | 🔍 Context Recall | 2 | — | — | 0% | ||
| MiniMax-M2.7-Turbo | 🚀 Throughput | 2 | 3901ms | $1.31 | 100% | ||
| MiniMax-M2.7-Turbo | 💻 Code Gen | 2 | 2645ms | $0.925 | 100% | ||
| MiniMax-M2.7-Turbo | { } JSON Output | 2 | 3662ms | $0.666 | 100% | ||
| MiniMax-M2.7-Turbo | 🧮 Reasoning | 2 | 3604ms | $0.628 | 100% | ||
| MiniMax-M2.7-Turbo | ⚡ Ping | 2 | 3102ms | $0.129 | 100% | ||
| gemma-2-27b-it | 🔍 Context Recall | 2 | 438ms | $0.176 | 100% | ||
| gemma-2-27b-it | 🚀 Throughput | 2 | 483ms | $0.350 | 100% | ||
| gemma-2-27b-it | 💻 Code Gen | 2 | 385ms | $0.109 | 100% | ||
| gemma-2-27b-it | { } JSON Output | 2 | 309ms | $0.064 | 100% | ||
| gemma-2-27b-it | 🧮 Reasoning | 2 | 380ms | $0.041 | 100% | ||
| gemma-2-27b-it | ⚡ Ping | 2 | 506ms | $0.013 | 100% | ||
| deepseek-r1 | 🔍 Context Recall | 2 | 958ms | $0.854 | 100% | ||
| deepseek-r1 | 🚀 Throughput | 2 | 972ms | $1.27 | 100% | ||
| deepseek-r1 | 💻 Code Gen | 2 | — | — | 0% | ||
| deepseek-r1 | { } JSON Output | 2 | 1180ms | $0.522 | 100% | ||
| deepseek-r1 | 🧮 Reasoning | 2 | 898ms | $1.40 | 100% | ||
| deepseek-r1 | ⚡ Ping | 2 | 870ms | $0.277 | 100% | ||
| command-r-08-2024 | 🔍 Context Recall | 2 | 408ms | $0.049 | 100% | ||
| command-r-08-2024 | 🚀 Throughput | 2 | 397ms | $0.304 | 100% | ||
| command-r-08-2024 | 💻 Code Gen | 2 | 379ms | $0.064 | 100% | ||
| command-r-08-2024 | { } JSON Output | 2 | 393ms | $0.030 | 100% | ||
| command-r-08-2024 | 🧮 Reasoning | 2 | 428ms | $0.030 | 100% | ||
| command-r-08-2024 | ⚡ Ping | 2 | 558ms | <$0.01 | 100% | ||
| seed-1.6 | 🔍 Context Recall | 2 | 721ms | $0.443 | 100% | ||
| seed-1.6 | 🚀 Throughput | 2 | 461ms | $1.03 | 100% | ||
| seed-1.6 | 💻 Code Gen | 2 | 620ms | $1.37 | 100% | ||
| seed-1.6 | { } JSON Output | 2 | 543ms | $0.301 | 100% | ||
| seed-1.6 | 🧮 Reasoning | 2 | 541ms | $0.588 | 100% | ||
| seed-1.6 | ⚡ Ping | 2 | 985ms | $0.120 | 100% | ||
| nova-lite-v1 | 🔍 Context Recall | 2 | 869ms | $0.018 | 100% | ||
| nova-lite-v1 | 🚀 Throughput | 2 | 1212ms | $0.122 | 100% | ||
| nova-lite-v1 | 💻 Code Gen | 2 | 907ms | $0.031 | 100% | ||
| nova-lite-v1 | { } JSON Output | 2 | 1080ms | <$0.01 | 100% | ||
| nova-lite-v1 | 🧮 Reasoning | 2 | 1098ms | <$0.01 | 100% | ||
| nova-lite-v1 | ⚡ Ping | 2 | 1438ms | <$0.01 | 100% | ||
| gpt-4o-mini | 🔧 Tool Use | 2 | 1186ms | $0.020 | 100% | ||
| gpt-4o-mini | 🔍 Context Recall | 2 | 772ms | $0.048 | 100% | ||
| gpt-4o-mini | 🚀 Throughput | 2 | 5384ms | $0.459 | 100% | ||
| gpt-4o-mini | 💻 Code Gen | 2 | 1484ms | $0.070 | 100% | ||
| gpt-4o-mini | { } JSON Output | 2 | 1011ms | $0.030 | 100% | ||
| gpt-4o-mini | 🧮 Reasoning | 2 | 911ms | $0.025 | 100% | ||
| gpt-4o-mini | ⚡ Ping | 2 | 701ms | <$0.01 | 100% | ||
| gpt-4.1-mini-2025-04-14 | 🔧 Tool Use | 2 | 784ms | $0.062 | 100% | ||
| gpt-4.1-mini-2025-04-14 | 🔍 Context Recall | 2 | 1229ms | $0.124 | 100% | ||
| gpt-4.1-mini-2025-04-14 | 🚀 Throughput | 2 | 7512ms | $1.22 | 100% | ||
| gpt-4.1-mini-2025-04-14 | 💻 Code Gen | 2 | 1560ms | $0.190 | 100% | ||
| gpt-4.1-mini-2025-04-14 | { } JSON Output | 2 | 1173ms | $0.060 | 100% | ||
| gpt-4.1-mini-2025-04-14 | 🧮 Reasoning | 2 | 986ms | $0.060 | 100% | ||
| gpt-4.1-mini-2025-04-14 | ⚡ Ping | 2 | 592ms | <$0.01 | 100% | ||
| gpt-4 | 🔧 Tool Use | 2 | 2834ms | — | 100% | ||
| gpt-4 | 🔍 Context Recall | 2 | 1780ms | — | 100% | ||
| gpt-4 | 🚀 Throughput | 2 | 12665ms | — | 100% | ||
| gpt-4 | 💻 Code Gen | 2 | 3370ms | — | 100% | ||
| gpt-4 | { } JSON Output | 2 | 2572ms | — | 100% | ||
| gpt-4 | 🧮 Reasoning | 2 | 1125ms | — | 100% | ||
| gpt-4 | ⚡ Ping | 2 | 3058ms | — | 100% | ||
| nemotron-3-super-120b-a12b | 🔍 Context Recall | 2 | 3764ms | free | 100% | ||
| nemotron-3-super-120b-a12b | 🚀 Throughput | 2 | — | — | 0% | ||
| nemotron-3-super-120b-a12b | 💻 Code Gen | 2 | — | — | 0% | ||
| nemotron-3-super-120b-a12b | { } JSON Output | 2 | 4185ms | free | 100% | ||
| nemotron-3-super-120b-a12b | 🧮 Reasoning | 2 | — | — | 0% | ||
| nemotron-3-super-120b-a12b | ⚡ Ping | 2 | — | — | 0% | ||
| compound | 🔧 Tool Use | 2 | — | — | 0% | ||
| compound | 🔍 Context Recall | 2 | 1685ms | free | 100% | ||
| compound | 🚀 Throughput | 2 | — | — | 0% | ||
| compound | 💻 Code Gen | 2 | 2956ms | free | 100% | ||
| compound | { } JSON Output | 2 | — | — | 0% | ||
| compound | 🧮 Reasoning | 2 | 2604ms | free | 100% | ||
| compound | ⚡ Ping | 2 | 741ms | free | 100% | ||
| kimi-k2.5 | 🔍 Context Recall | 2 | 923ms | $0.776 | 100% | ||
| kimi-k2.5 | 🚀 Throughput | 2 | 1481ms | $1.15 | 100% | ||
| kimi-k2.5 | 💻 Code Gen | 2 | 835ms | $2.08 | 100% | ||
| kimi-k2.5 | { } JSON Output | 2 | 713ms | $0.618 | 100% | ||
| kimi-k2.5 | 🧮 Reasoning | 2 | 1189ms | $2.82 | 100% | ||
| kimi-k2.5 | ⚡ Ping | 2 | 811ms | $0.196 | 100% | ||
| mistral-medium-3 | 🔍 Context Recall | 2 | 897ms | $0.115 | 100% | ||
| mistral-medium-3 | 🚀 Throughput | 2 | 1240ms | $1.02 | 100% | ||
| mistral-medium-3 | 💻 Code Gen | 2 | 505ms | $0.239 | 100% | ||
| mistral-medium-3 | { } JSON Output | 2 | 429ms | $0.088 | 100% | ||
| mistral-medium-3 | 🧮 Reasoning | 2 | 436ms | $0.162 | 100% | ||
| mistral-medium-3 | ⚡ Ping | 2 | 458ms | $0.013 | 100% | ||
| devstral-2512 | 🔍 Context Recall | 2 | 459ms | $0.115 | 100% | ||
| devstral-2512 | 🚀 Throughput | 2 | 515ms | $1.02 | 100% | ||
| devstral-2512 | 💻 Code Gen | 2 | 594ms | $0.235 | 100% | ||
| devstral-2512 | { } JSON Output | 2 | 445ms | $0.088 | 100% | ||
| devstral-2512 | 🧮 Reasoning | 2 | 474ms | $0.098 | 100% | ||
| devstral-2512 | ⚡ Ping | 2 | 964ms | $0.013 | 100% | ||
| minimax-m2 | 🔍 Context Recall | 2 | 1007ms | $0.382 | 100% | ||
| minimax-m2 | 🚀 Throughput | 2 | 585ms | $0.523 | 100% | ||
| minimax-m2 | 💻 Code Gen | 2 | 1067ms | $0.518 | 100% | ||
| minimax-m2 | { } JSON Output | 2 | 1361ms | $0.224 | 100% | ||
| minimax-m2 | 🧮 Reasoning | 2 | 1521ms | $0.383 | 100% | ||
| minimax-m2 | ⚡ Ping | 2 | 3057ms | $0.091 | 100% | ||
| llama-4-maverick | 🔍 Context Recall | 2 | 840ms | $0.086 | 100% | ||
| llama-4-maverick | 🚀 Throughput | 2 | 1199ms | $0.356 | 100% | ||
| llama-4-maverick | 💻 Code Gen | 2 | 556ms | $0.082 | 100% | ||
| llama-4-maverick | { } JSON Output | 2 | 778ms | $0.033 | 100% | ||
| llama-4-maverick | 🧮 Reasoning | 2 | 862ms | $0.030 | 100% | ||
| llama-4-maverick | ⚡ Ping | 2 | 847ms | <$0.01 | 100% | ||
| kimi-k2p6 | 🔧 Tool Use | 2 | 1738ms | $0.473 | 100% | ||
| kimi-k2p6 | 🔍 Context Recall | 2 | 3355ms | $1.39 | 100% | ||
| kimi-k2p6 | 🚀 Throughput | 2 | 10436ms | $3.06 | 100% | ||
| kimi-k2p6 | 💻 Code Gen | 2 | 13187ms | $5.15 | 100% | ||
| kimi-k2p6 | { } JSON Output | 2 | 2804ms | $0.579 | 100% | ||
| kimi-k2p6 | 🧮 Reasoning | 2 | 25796ms | $7.31 | 100% | ||
| kimi-k2p6 | ⚡ Ping | 2 | 862ms | $0.166 | 100% | ||
| deepseek-v3.2-exp | 🔍 Context Recall | 2 | 1460ms | $0.057 | 100% | ||
| deepseek-v3.2-exp | 🚀 Throughput | 2 | 2530ms | $0.214 | 100% | ||
| deepseek-v3.2-exp | 💻 Code Gen | 2 | 1468ms | $0.073 | 100% | ||
| deepseek-v3.2-exp | { } JSON Output | 2 | 1770ms | $0.027 | 100% | ||
| deepseek-v3.2-exp | 🧮 Reasoning | 2 | 1483ms | $0.020 | 100% | ||
| deepseek-v3.2-exp | ⚡ Ping | 2 | 1171ms | <$0.01 | 100% | ||
| deepseek-chat-v3-0324 | 🔍 Context Recall | 2 | 1113ms | $0.115 | 100% | ||
| deepseek-chat-v3-0324 | 🚀 Throughput | 2 | 5399ms | $0.580 | 100% | ||
| deepseek-chat-v3-0324 | 💻 Code Gen | 2 | 1536ms | $0.136 | 100% | ||
| deepseek-chat-v3-0324 | { } JSON Output | 2 | 2227ms | $0.048 | 100% | ||
| deepseek-chat-v3-0324 | 🧮 Reasoning | 2 | 1329ms | $0.039 | 100% | ||
| deepseek-chat-v3-0324 | ⚡ Ping | 2 | 2853ms | <$0.01 | 100% | ||
| trinity-large-thinking | 🔍 Context Recall | 2 | 472ms | $0.316 | 100% | ||
| trinity-large-thinking | 🚀 Throughput | 2 | 922ms | $0.410 | 100% | ||
| trinity-large-thinking | 💻 Code Gen | 2 | — | — | 0% | ||
| trinity-large-thinking | { } JSON Output | 2 | 960ms | $0.325 | 100% | ||
| trinity-large-thinking | 🧮 Reasoning | 2 | 404ms | $0.149 | 100% | ||
| trinity-large-thinking | ⚡ Ping | 2 | 1042ms | $0.045 | 100% | ||
| aion-rp-llama-3.1-8b | 🔍 Context Recall | 2 | — | — | 0% | ||
| aion-rp-llama-3.1-8b | 🚀 Throughput | 2 | 738ms | $0.760 | 100% | ||
| aion-rp-llama-3.1-8b | 💻 Code Gen | 2 | — | — | 0% | ||
| aion-rp-llama-3.1-8b | { } JSON Output | 2 | — | — | 0% | ||
| aion-rp-llama-3.1-8b | 🧮 Reasoning | 2 | 864ms | $0.204 | 100% | ||
| aion-rp-llama-3.1-8b | ⚡ Ping | 2 | 1167ms | $0.021 | 100% | ||
| gpt-4o-2024-08-06 | 🔧 Tool Use | 2 | 797ms | $0.338 | 100% | ||
| gpt-4o-2024-08-06 | 🔍 Context Recall | 2 | 916ms | $0.795 | 100% | ||
| gpt-4o-2024-08-06 | 🚀 Throughput | 2 | 6019ms | $7.65 | 100% | ||
| gpt-4o-2024-08-06 | 💻 Code Gen | 2 | 1628ms | $1.75 | 100% | ||
| gpt-4o-2024-08-06 | { } JSON Output | 2 | 737ms | $0.352 | 100% | ||
| gpt-4o-2024-08-06 | 🧮 Reasoning | 2 | 1138ms | $1.10 | 100% | ||
| gpt-4o-2024-08-06 | ⚡ Ping | 2 | 780ms | $0.045 | 100% | ||
| gpt-4.1-2025-04-14 | 🔧 Tool Use | 2 | 751ms | $0.270 | 100% | ||
| gpt-4.1-2025-04-14 | 🔍 Context Recall | 2 | 787ms | $0.764 | 100% | ||
| gpt-4.1-2025-04-14 | 🚀 Throughput | 2 | 6177ms | $6.12 | 100% | ||
| gpt-4.1-2025-04-14 | 💻 Code Gen | 2 | 1195ms | $1.24 | 100% | ||
| gpt-4.1-2025-04-14 | { } JSON Output | 2 | 807ms | $0.354 | 100% | ||
| gpt-4.1-2025-04-14 | 🧮 Reasoning | 2 | 853ms | $0.348 | 100% | ||
| gpt-4.1-2025-04-14 | ⚡ Ping | 2 | 867ms | $0.036 | 100% | ||
| gpt-3.5-turbo-1106 | 🔧 Tool Use | 2 | 1889ms | — | 100% | ||
| gpt-3.5-turbo-1106 | 🔍 Context Recall | 2 | 1903ms | — | 100% | ||
| gpt-3.5-turbo-1106 | 🚀 Throughput | 2 | 4604ms | — | 100% | ||
| gpt-3.5-turbo-1106 | 💻 Code Gen | 2 | 3704ms | — | 100% | ||
| gpt-3.5-turbo-1106 | { } JSON Output | 2 | 2584ms | — | 100% | ||
| gpt-3.5-turbo-1106 | 🧮 Reasoning | 2 | 3072ms | — | 100% | ||
| gpt-3.5-turbo-1106 | ⚡ Ping | 2 | 2717ms | — | 100% | ||
| Hermes-3-Llama-3.1-70B | 🚀 Throughput | 2 | — | — | 0% | ||
| Hermes-3-Llama-3.1-70B | 💻 Code Gen | 2 | 4436ms | $0.095 | 100% | ||
| Hermes-3-Llama-3.1-70B | { } JSON Output | 2 | 1944ms | $0.069 | 100% | ||
| Hermes-3-Llama-3.1-70B | 🧮 Reasoning | 2 | 1293ms | $0.036 | 100% | ||
| Hermes-3-Llama-3.1-70B | ⚡ Ping | 2 | 919ms | $0.013 | 100% | ||
| Seed-2.0-code | 🔧 Tool Use | 2 | 3857ms | $0.698 | 100% | ||
| Seed-2.0-code | 🔍 Context Recall | 2 | 4413ms | $0.725 | 100% | ||
| Seed-2.0-code | 🚀 Throughput | 2 | — | — | 0% | ||
| Seed-2.0-code | 💻 Code Gen | 2 | — | — | 0% | ||
| Seed-2.0-code | { } JSON Output | 2 | 4258ms | $0.683 | 100% | ||
| Seed-2.0-code | 🧮 Reasoning | 2 | — | — | 0% | ||
| Seed-2.0-code | ⚡ Ping | 2 | 2418ms | $0.153 | 100% | ||
| claude-opus-4-8 | 🔧 Tool Use | 2 | — | — | 0% | ||
| claude-opus-4-8 | 🔍 Context Recall | 2 | 1777ms | $3.74 | 100% | ||
| claude-opus-4-8 | 🚀 Throughput | 2 | 11349ms | $19.19 | 100% | ||
| claude-opus-4-8 | 💻 Code Gen | 2 | 4022ms | $7.82 | 100% | ||
| claude-opus-4-8 | { } JSON Output | 2 | 1516ms | $1.16 | 100% | ||
| claude-opus-4-8 | 🧮 Reasoning | 2 | 1258ms | $1.30 | 100% | ||
| claude-opus-4-8 | ⚡ Ping | 2 | 1095ms | $0.190 | 100% | ||
| gpt-oss-20b | 🔧 Tool Use | 2 | 2118ms | $0.030 | 100% | ||
| gpt-oss-20b | 🔍 Context Recall | 2 | 1956ms | $0.033 | 100% | ||
| gpt-oss-20b | 🚀 Throughput | 2 | 6864ms | $0.109 | 100% | ||
| gpt-oss-20b | 💻 Code Gen | 2 | 4593ms | $0.052 | 100% | ||
| gpt-oss-20b | { } JSON Output | 2 | 1538ms | $0.032 | 100% | ||
| gpt-oss-20b | 🧮 Reasoning | 2 | 2485ms | $0.045 | 100% | ||
| gpt-oss-20b | ⚡ Ping | 2 | 2095ms | $0.011 | 100% | ||
| MiniMax-M3 | 🔧 Tool Use | 2 | 1868ms | $0.262 | 100% | ||
| MiniMax-M3 | 🔍 Context Recall | 2 | 2062ms | $0.288 | 100% | ||
| MiniMax-M3 | 🚀 Throughput | 2 | — | — | 0% | ||
| MiniMax-M3 | 💻 Code Gen | 2 | 5396ms | $0.561 | 100% | ||
| MiniMax-M3 | { } JSON Output | 2 | 1634ms | $0.181 | 100% | ||
| MiniMax-M3 | 🧮 Reasoning | 2 | 1972ms | $0.217 | 100% | ||
| MiniMax-M3 | ⚡ Ping | 2 | 1334ms | $0.070 | 100% | ||
| glm-5.1 | 🔍 Context Recall | 2 | 2397ms | $1.56 | 100% | ||
| glm-5.1 | 🚀 Throughput | 2 | 1072ms | $1.55 | 100% | ||
| glm-5.1 | 💻 Code Gen | 2 | 777ms | $1.37 | 100% | ||
| glm-5.1 | { } JSON Output | 2 | 791ms | $0.974 | 100% | ||
| glm-5.1 | 🧮 Reasoning | 2 | 1355ms | $1.09 | 100% | ||
| glm-5.1 | ⚡ Ping | 2 | 4767ms | $0.476 | 100% | ||
| glm-4.5v | 🔍 Context Recall | 2 | 1712ms | $1.10 | 100% | ||
| glm-4.5v | 🚀 Throughput | 2 | 1498ms | $0.921 | 100% | ||
| glm-4.5v | 💻 Code Gen | 2 | 2227ms | $1.94 | 100% | ||
| glm-4.5v | { } JSON Output | 2 | 1925ms | $0.283 | 100% | ||
| glm-4.5v | 🧮 Reasoning | 2 | 2451ms | $0.917 | 100% | ||
| glm-4.5v | ⚡ Ping | 2 | 10042ms | $0.065 | 100% | ||
| grok-4.20-multi-agent | 🔍 Context Recall | 2 | 1021ms | $13.80 | 100% | ||
| grok-4.20-multi-agent | 🚀 Throughput | 2 | 796ms | $73.99 | 100% | ||
| grok-4.20-multi-agent | 💻 Code Gen | 2 | 804ms | $10.35 | 100% | ||
| grok-4.20-multi-agent | { } JSON Output | 2 | 973ms | $9.83 | 100% | ||
| grok-4.20-multi-agent | 🧮 Reasoning | 2 | 664ms | $12.36 | 100% | ||
| grok-4.20-multi-agent | ⚡ Ping | 2 | 708ms | $5.37 | 100% | ||
| l3.1-euryale-70b | 🔍 Context Recall | 2 | 586ms | $0.190 | 100% | ||
| l3.1-euryale-70b | 🚀 Throughput | 2 | 345ms | $0.459 | 100% | ||
| l3.1-euryale-70b | 💻 Code Gen | 2 | 313ms | $0.120 | 100% | ||
| l3.1-euryale-70b | { } JSON Output | 2 | 329ms | $0.076 | 100% | ||
| l3.1-euryale-70b | 🧮 Reasoning | 2 | 850ms | $0.047 | 100% | ||
| l3.1-euryale-70b | ⚡ Ping | 2 | 496ms | $0.016 | 100% | ||
| qwen3.7-plus | 🔍 Context Recall | 2 | 754ms | $0.911 | 100% | ||
| qwen3.7-plus | 🚀 Throughput | 2 | 663ms | $0.653 | 100% | ||
| qwen3.7-plus | 💻 Code Gen | 2 | 611ms | $1.46 | 100% | ||
| qwen3.7-plus | { } JSON Output | 2 | 1016ms | $0.661 | 100% | ||
| qwen3.7-plus | 🧮 Reasoning | 2 | 1022ms | $2.52 | 100% | ||
| qwen3.7-plus | ⚡ Ping | 2 | 662ms | $0.314 | 100% | ||
| qwen3.5-plus-20260420 | 🔍 Context Recall | 2 | 596ms | $1.22 | 100% | ||
| qwen3.5-plus-20260420 | 🚀 Throughput | 2 | 814ms | $0.916 | 100% | ||
| qwen3.5-plus-20260420 | 💻 Code Gen | 2 | 813ms | $5.74 | 100% | ||
| qwen3.5-plus-20260420 | { } JSON Output | 2 | 636ms | $1.22 | 100% | ||
| qwen3.5-plus-20260420 | 🧮 Reasoning | 2 | 1834ms | $2.30 | 100% | ||
| qwen3.5-plus-20260420 | ⚡ Ping | 2 | 558ms | $0.387 | 100% | ||
| qwen3.5-122b-a10b | 🔍 Context Recall | 2 | 773ms | $1.03 | 100% | ||
| qwen3.5-122b-a10b | 🚀 Throughput | 2 | 1294ms | $1.05 | 100% | ||
| qwen3.5-122b-a10b | 💻 Code Gen | 2 | 386ms | $3.40 | 100% | ||
| qwen3.5-122b-a10b | { } JSON Output | 2 | — | — | 0% | ||
| qwen3.5-122b-a10b | 🧮 Reasoning | 2 | 1723ms | $11.33 | 100% | ||
| qwen3.5-122b-a10b | ⚡ Ping | 2 | 296ms | $0.730 | 100% | ||
| qwen3-vl-235b-a22b-instruct | 🔍 Context Recall | 2 | 314ms | $0.109 | 100% | ||
| qwen3-vl-235b-a22b-instruct | 🚀 Throughput | 2 | 272ms | $0.958 | 100% | ||
| qwen3-vl-235b-a22b-instruct | 💻 Code Gen | 2 | 330ms | $0.208 | 100% | ||
| qwen3-vl-235b-a22b-instruct | { } JSON Output | 2 | 289ms | $0.072 | 100% | ||
| qwen3-vl-235b-a22b-instruct | 🧮 Reasoning | 2 | 623ms | $0.104 | 100% | ||
| qwen3-vl-235b-a22b-instruct | ⚡ Ping | 2 | 271ms | <$0.01 | 100% | ||
| qwen3-coder-flash | 🔍 Context Recall | 2 | 739ms | $0.080 | 100% | ||
| qwen3-coder-flash | 🚀 Throughput | 2 | 505ms | $0.495 | 100% | ||
| qwen3-coder-flash | 💻 Code Gen | 2 | 394ms | $0.174 | 100% | ||
| qwen3-coder-flash | { } JSON Output | 2 | 781ms | $0.046 | 100% | ||
| qwen3-coder-flash | 🧮 Reasoning | 2 | 627ms | $0.065 | 100% | ||
| qwen3-coder-flash | ⚡ Ping | 2 | 750ms | <$0.01 | 100% | ||
| qwen3-30b-a3b | 🔍 Context Recall | 2 | 475ms | $0.145 | 100% | ||
| qwen3-30b-a3b | 🚀 Throughput | 2 | 342ms | $0.255 | 100% | ||
| qwen3-30b-a3b | 💻 Code Gen | 2 | 645ms | $0.473 | 100% | ||
| qwen3-30b-a3b | { } JSON Output | 2 | 867ms | $0.125 | 100% | ||
| qwen3-30b-a3b | 🧮 Reasoning | 2 | 926ms | $0.169 | 100% | ||
| qwen3-30b-a3b | ⚡ Ping | 2 | 852ms | $0.081 | 100% | ||
| qwen-plus | 🔍 Context Recall | 2 | 440ms | $0.062 | 100% | ||
| qwen-plus | 🚀 Throughput | 2 | 237ms | $0.400 | 100% | ||
| qwen-plus | 💻 Code Gen | 2 | 319ms | $0.105 | 100% | ||
| qwen-plus | { } JSON Output | 2 | 253ms | $0.038 | 100% | ||
| qwen-plus | 🧮 Reasoning | 2 | 249ms | $0.067 | 100% | ||
| qwen-plus | ⚡ Ping | 2 | 295ms | <$0.01 | 100% | ||
| sonar-pro-search | 🔍 Context Recall | 2 | 825ms | $1.23 | 100% | ||
| sonar-pro-search | 🚀 Throughput | 2 | 3433ms | $7.44 | 100% | ||
| sonar-pro-search | 💻 Code Gen | 2 | 1239ms | $1.99 | 100% | ||
| sonar-pro-search | { } JSON Output | 2 | 889ms | $0.465 | 100% | ||
| sonar-pro-search | 🧮 Reasoning | 2 | 1225ms | $0.789 | 100% | ||
| sonar-pro-search | ⚡ Ping | 2 | 1049ms | $0.036 | 100% | ||
| gpt-oss-120b | 🔍 Context Recall | 2 | 969ms | $0.022 | 100% | ||
| gpt-oss-120b | 🚀 Throughput | 2 | 880ms | $0.088 | 100% | ||
| gpt-oss-120b | 💻 Code Gen | 2 | 1815ms | $0.055 | 100% | ||
| gpt-oss-120b | { } JSON Output | 2 | 2245ms | $0.031 | 100% | ||
| gpt-oss-120b | 🧮 Reasoning | 2 | 512ms | $0.035 | 100% | ||
| gpt-oss-120b | ⚡ Ping | 2 | 1606ms | $0.011 | 100% | ||
| nex-n2-pro | 🔍 Context Recall | 2 | 1410ms | — | 100% | ||
| nex-n2-pro | 🚀 Throughput | 2 | 1007ms | — | 100% | ||
| nex-n2-pro | 💻 Code Gen | 2 | 682ms | — | 100% | ||
| nex-n2-pro | { } JSON Output | 2 | 1352ms | — | 100% | ||
| nex-n2-pro | 🧮 Reasoning | 2 | 688ms | — | 100% | ||
| nex-n2-pro | ⚡ Ping | 2 | 5051ms | — | 100% | ||
| kimi-k2-0905 | 🔍 Context Recall | 2 | 717ms | $0.228 | 100% | ||
| kimi-k2-0905 | 🚀 Throughput | 2 | 870ms | $1.27 | 100% | ||
| kimi-k2-0905 | 💻 Code Gen | 2 | 750ms | $0.300 | 100% | ||
| kimi-k2-0905 | { } JSON Output | 2 | 737ms | $0.090 | 100% | ||
| kimi-k2-0905 | 🧮 Reasoning | 2 | 1327ms | $0.094 | 100% | ||
| kimi-k2-0905 | ⚡ Ping | 2 | 721ms | $0.015 | 100% | ||
| minimax-m3 | 🔍 Context Recall | 2 | 1185ms | $0.247 | 100% | ||
| minimax-m3 | 🚀 Throughput | 2 | 482ms | $0.662 | 100% | ||
| minimax-m3 | 💻 Code Gen | 2 | — | — | 0% | ||
| minimax-m3 | { } JSON Output | 2 | 866ms | $0.103 | 100% | ||
| minimax-m3 | 🧮 Reasoning | 2 | 960ms | $0.238 | 100% | ||
| minimax-m3 | ⚡ Ping | 2 | 1715ms | $0.081 | 100% | ||
| minimax-01 | 🔍 Context Recall | 2 | 1951ms | $0.310 | 100% | ||
| minimax-01 | 🚀 Throughput | 2 | 835ms | $0.698 | 100% | ||
| minimax-01 | 💻 Code Gen | 2 | 780ms | $0.270 | 100% | ||
| minimax-01 | { } JSON Output | 2 | 884ms | $0.176 | 100% | ||
| minimax-01 | 🧮 Reasoning | 2 | 786ms | $0.258 | 100% | ||
| minimax-01 | ⚡ Ping | 2 | 3892ms | $0.145 | 100% | ||
| llama-3.2-3b-instruct | 🔍 Context Recall | 2 | 500ms | $0.025 | 100% | ||
| llama-3.2-3b-instruct | 🚀 Throughput | 2 | 519ms | $0.167 | 100% | ||
| llama-3.2-3b-instruct | 💻 Code Gen | 2 | — | — | 0% | ||
| llama-3.2-3b-instruct | { } JSON Output | 2 | 524ms | $0.016 | 100% | ||
| llama-3.2-3b-instruct | 🧮 Reasoning | 2 | 531ms | $0.013 | 100% | ||
| llama-3.2-3b-instruct | ⚡ Ping | 2 | 336ms | <$0.01 | 100% | ||
| mercury-2 | 🔍 Context Recall | 2 | 634ms | $0.113 | 100% | ||
| mercury-2 | 🚀 Throughput | 2 | 368ms | $0.380 | 100% | ||
| mercury-2 | 💻 Code Gen | 2 | 367ms | $0.195 | 100% | ||
| mercury-2 | { } JSON Output | 2 | 402ms | $0.116 | 100% | ||
| mercury-2 | 🧮 Reasoning | 2 | 641ms | $0.168 | 100% | ||
| mercury-2 | ⚡ Ping | 2 | 699ms | $0.040 | 100% |