Loading benchmark data…
EyesInAI·Loading live benchmark data
The raw, unedited run log behind the leaderboard — every model, test, latency and pass/fail, straight from the database. This is the receipts: the leaderboard and methodology summarize it; this is the source. 200 total rows — showing the latest 200.
| Time | Provider | Model | Test | Status | Latency | Tokens |
|---|---|---|---|---|---|---|
| 9/9/2026, 7:27:38 PM | together | arize-ai/qwen-2-1.5b-instruct | tool_use | fail | 492ms | 35 / 46 |
| 9/9/2026, 7:27:37 PM | together | arize-ai/qwen-2-1.5b-instruct | context | fail | 449ms | 215 / 19 |
| 9/9/2026, 7:27:36 PM | together | arize-ai/qwen-2-1.5b-instruct | speed | pass | 1722ms | 49 / 504 |
| 9/9/2026, 7:27:34 PM | together | arize-ai/qwen-2-1.5b-instruct | code | pass | 618ms | 52 / 102 |
| 9/9/2026, 7:27:33 PM | together | arize-ai/qwen-2-1.5b-instruct | json | fail | 594ms | 71 / 40 |
| 9/9/2026, 7:27:33 PM | together | arize-ai/qwen-2-1.5b-instruct | reasoning | pass | 484ms | 44 / 12 |
| 9/9/2026, 7:27:32 PM | together | arize-ai/qwen-2-1.5b-instruct | ping | pass | 2816ms | 26 / 2 |
| 9/9/2026, 7:27:29 PM | openrouter | z-ai/glm-5v-turbo | context | pass | 5358ms | 189 / 355 |
| 9/9/2026, 7:27:20 PM | openrouter | z-ai/glm-5v-turbo | speed | pass | 2482ms | 35 / 500 |
| 9/9/2026, 7:27:08 PM | openrouter | z-ai/glm-5v-turbo | code | pass | 2181ms | 38 / 885 |
| 9/9/2026, 7:26:48 PM | openrouter | z-ai/glm-5v-turbo | json | pass | 2519ms | 55 / 162 |
| 9/9/2026, 7:26:44 PM | openrouter | z-ai/glm-5v-turbo | reasoning | pass | 4945ms | 28 / 500 |
| 9/9/2026, 7:26:32 PM | openrouter | z-ai/glm-5v-turbo | ping | pass | 2034ms | 12 / 37 |
| 9/9/2026, 7:26:29 PM | openrouter | z-ai/glm-4.6v | context | pass | 1076ms | 190 / 797 |
| 9/9/2026, 7:25:49 PM | openrouter | z-ai/glm-4.6v | speed | pass | 4081ms | 36 / 500 |
| 9/9/2026, 7:25:35 PM | openrouter | z-ai/glm-4.6v | code | pass | 3370ms | 39 / 775 |
| 9/9/2026, 7:24:58 PM | openrouter | z-ai/glm-4.6v | json | pass | 1013ms | 56 / 232 |
| 9/9/2026, 7:24:50 PM | openrouter | z-ai/glm-4.6v | reasoning | pass | 987ms | 29 / 245 |
| 9/9/2026, 7:24:41 PM | openrouter | z-ai/glm-4.6v | ping | pass | 3402ms | 13 / 62 |
| 9/9/2026, 7:24:37 PM | openrouter | x-ai/grok-build-0.1 | context | pass | 943ms | 364 / 429 |
| 9/9/2026, 7:24:33 PM | openrouter | x-ai/grok-build-0.1 | speed | pass | 1085ms | 216 / 1443 |
| 9/9/2026, 7:24:13 PM | openrouter | x-ai/grok-build-0.1 | code | pass | 1139ms | 219 / 671 |
| 9/9/2026, 7:24:05 PM | openrouter | x-ai/grok-build-0.1 | json | pass | 911ms | 236 / 588 |
| 9/9/2026, 7:23:58 PM | openrouter | x-ai/grok-build-0.1 | reasoning | pass | 871ms | 209 / 1113 |
| 9/9/2026, 7:23:48 PM | openrouter | x-ai/grok-build-0.1 | ping | pass | 914ms | 193 / 122 |
| 9/9/2026, 7:23:45 PM | openrouter | thedrummer/unslopnemo-12b | context | pass | 743ms | 214 / 13 |
| 9/9/2026, 7:23:44 PM | openrouter | thedrummer/unslopnemo-12b | speed | pass | 623ms | 36 / 500 |
| 9/9/2026, 7:23:39 PM | openrouter | thedrummer/unslopnemo-12b | code | pass | 642ms | 39 / 105 |
| 9/9/2026, 7:23:37 PM | openrouter | thedrummer/unslopnemo-12b | json | pass | 1891ms | 60 / 37 |
| 9/9/2026, 7:23:34 PM | openrouter | thedrummer/unslopnemo-12b | reasoning | pass | 628ms | 31 / 20 |
| 9/9/2026, 7:23:33 PM | openrouter | thedrummer/unslopnemo-12b | ping | pass | 637ms | 13 / 5 |
| 9/9/2026, 7:23:32 PM | openrouter | stepfun/step-3.5-flash | context | pass | 1551ms | 201 / 555 |
| 9/9/2026, 7:23:16 PM | openrouter | stepfun/step-3.5-flash | speed | pass | 1609ms | 42 / 500 |
| 9/9/2026, 7:23:07 PM | openrouter | stepfun/step-3.5-flash | code | pass | 1564ms | 46 / 2552 |
| 9/9/2026, 7:22:22 PM | openrouter | stepfun/step-3.5-flash | json | pass | 902ms | 65 / 401 |
| 9/9/2026, 7:22:04 PM | openrouter | stepfun/step-3.5-flash | reasoning | pass | 2697ms | 35 / 799 |
| 9/9/2026, 7:21:46 PM | openrouter | stepfun/step-3.5-flash | ping | pass | 1938ms | 19 / 126 |
| 9/9/2026, 7:21:42 PM | openrouter | qwen/qwen3.6-35b-a3b | context | pass | 1165ms | 230 / 950 |
| 9/9/2026, 7:20:51 PM | openrouter | qwen/qwen3.6-35b-a3b | speed | pass | 1045ms | 40 / 500 |
| 9/9/2026, 7:20:48 PM | openrouter | qwen/qwen3.6-35b-a3b | code | pass | 1814ms | 43 / 1613 |
| 9/9/2026, 7:20:30 PM | openrouter | qwen/qwen3.6-35b-a3b | json | pass | 3508ms | 62 / 1628 |
| 9/9/2026, 7:20:15 PM | openrouter | qwen/qwen3.6-35b-a3b | reasoning | pass | 1139ms | 35 / 1054 |
| 9/9/2026, 7:20:08 PM | openrouter | qwen/qwen3.6-35b-a3b | ping | pass | 1158ms | 17 / 272 |
| 9/9/2026, 7:20:05 PM | openrouter | qwen/qwen3.5-35b-a3b | context | pass | 1128ms | 230 / 864 |
| 9/9/2026, 7:19:41 PM | openrouter | qwen/qwen3.5-35b-a3b | speed | pass | 1205ms | 40 / 500 |
| 9/9/2026, 7:19:32 PM | openrouter | qwen/qwen3.5-35b-a3b | code | pass | 2287ms | 43 / 998 |
| 9/9/2026, 7:19:02 PM | openrouter | qwen/qwen3.5-35b-a3b | json | pass | 969ms | 62 / 758 |
| 9/9/2026, 7:18:27 PM | openrouter | qwen/qwen3.5-35b-a3b | reasoning | pass | 1806ms | 35 / 6707 |
| 9/9/2026, 7:16:45 PM | openrouter | qwen/qwen3.5-35b-a3b | ping | pass | 624ms | 17 / 148 |
| 9/9/2026, 7:16:40 PM | openrouter | qwen/qwen3-vl-30b-a3b-instruct | context | pass | 5835ms | 204 / 31 |
| 9/9/2026, 7:16:34 PM | openrouter | qwen/qwen3-vl-30b-a3b-instruct | speed | pass | 682ms | 38 / 500 |
| 9/9/2026, 7:16:29 PM | openrouter | qwen/qwen3-vl-30b-a3b-instruct | code | pass | 536ms | 41 / 113 |
| 9/9/2026, 7:16:27 PM | openrouter | qwen/qwen3-vl-30b-a3b-instruct | json | pass | 5618ms | 60 / 30 |
| 9/9/2026, 7:16:21 PM | openrouter | qwen/qwen3-vl-30b-a3b-instruct | reasoning | pass | 579ms | 33 / 43 |
| 9/9/2026, 7:16:20 PM | openrouter | qwen/qwen3-vl-30b-a3b-instruct | ping | pass | 10295ms | 15 / 2 |
| 9/9/2026, 7:16:09 PM | openrouter | qwen/qwen3-coder-plus | context | pass | 919ms | 204 / 34 |
| 9/9/2026, 7:16:07 PM | openrouter | qwen/qwen3-coder-plus | speed | pass | 1278ms | 38 / 500 |
| 9/9/2026, 7:15:58 PM | openrouter | qwen/qwen3-coder-plus | code | pass | 845ms | 41 / 101 |
| 9/9/2026, 7:15:56 PM | openrouter | qwen/qwen3-coder-plus | json | pass | 891ms | 60 / 36 |
| 9/9/2026, 7:15:54 PM | openrouter | qwen/qwen3-coder-plus | reasoning | pass | 2616ms | 33 / 48 |
| 9/9/2026, 7:15:51 PM | openrouter | qwen/qwen3-coder-plus | ping | pass | 873ms | 15 / 1 |
| 9/9/2026, 7:15:49 PM | openrouter | qwen/qwen3-30b-a3b-thinking-2507 | context | pass | 458ms | 204 / 389 |
| 9/9/2026, 7:15:46 PM | openrouter | qwen/qwen3-30b-a3b-thinking-2507 | speed | pass | 498ms | 38 / 1263 |
| 9/9/2026, 7:15:34 PM | openrouter | qwen/qwen3-30b-a3b-thinking-2507 | code | pass | 827ms | 41 / 891 |
| 9/9/2026, 7:15:27 PM | openrouter | qwen/qwen3-30b-a3b-thinking-2507 | json | pass | 485ms | 60 / 380 |
| 9/9/2026, 7:15:23 PM | openrouter | qwen/qwen3-30b-a3b-thinking-2507 | reasoning | pass | 463ms | 33 / 332 |
| 9/9/2026, 7:15:20 PM | openrouter | qwen/qwen3-30b-a3b-thinking-2507 | ping | pass | 455ms | 15 / 150 |
| 9/9/2026, 7:15:18 PM | openrouter | qwen/qwen2.5-vl-72b-instruct | context | pass | 869ms | 210 / 29 |
| 9/9/2026, 7:15:15 PM | openrouter | qwen/qwen2.5-vl-72b-instruct | speed | pass | 888ms | 44 / 500 |
| 9/9/2026, 7:15:03 PM | openrouter | qwen/qwen2.5-vl-72b-instruct | code | pass | 798ms | 47 / 71 |
| 9/9/2026, 7:15:00 PM | openrouter | qwen/qwen2.5-vl-72b-instruct | json | pass | 797ms | 66 / 38 |
| 9/9/2026, 7:14:58 PM | openrouter | qwen/qwen2.5-vl-72b-instruct | reasoning | pass | 717ms | 39 / 37 |
| 9/9/2026, 7:14:57 PM | openrouter | qwen/qwen2.5-vl-72b-instruct | ping | pass | 1171ms | 21 / 2 |
| 9/9/2026, 7:14:55 PM | openrouter | poolside/laguna-xs-2.1 | context | pass | 659ms | 280 / 308 |
| 9/9/2026, 7:14:53 PM | openrouter | poolside/laguna-xs-2.1 | speed | pass | 643ms | 72 / 500 |
| 9/9/2026, 7:14:49 PM | openrouter | poolside/laguna-xs-2.1 | code | pass | 652ms | 75 / 980 |
| 9/9/2026, 7:14:40 PM | openrouter | poolside/laguna-xs-2.1 | json | pass | 658ms | 95 / 295 |
| 9/9/2026, 7:14:37 PM | openrouter | poolside/laguna-xs-2.1 | reasoning | pass | 630ms | 67 / 506 |
| 9/9/2026, 7:14:31 PM | openrouter | poolside/laguna-xs-2.1 | ping | pass | 819ms | 51 / 124 |
| 9/9/2026, 7:14:29 PM | openrouter | nvidia/nemotron-3-ultra-550b-a55b | context | pass | 898ms | 225 / 154 |
| 9/9/2026, 7:14:27 PM | openrouter | nvidia/nemotron-3-ultra-550b-a55b | speed | pass | 2044ms | 46 / 500 |
| 9/9/2026, 7:14:16 PM | openrouter | nvidia/nemotron-3-ultra-550b-a55b | code | pass | 875ms | 50 / 298 |
| 9/9/2026, 7:14:12 PM | openrouter | nvidia/nemotron-3-ultra-550b-a55b | json | pass | 1047ms | 71 / 251 |
| 9/9/2026, 7:14:09 PM | openrouter | nvidia/nemotron-3-ultra-550b-a55b | reasoning | pass | 1522ms | 41 / 68 |
| 9/9/2026, 7:14:05 PM | openrouter | nvidia/nemotron-3-ultra-550b-a55b | ping | pass | 2235ms | 23 / 23 |
| 9/9/2026, 7:14:02 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | context | pass | 658ms | 194 / 28 |
| 9/9/2026, 7:14:00 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | speed | pass | 599ms | 40 / 500 |
| 9/9/2026, 7:13:38 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | code | pass | 614ms | 43 / 102 |
| 9/9/2026, 7:13:32 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | json | pass | 586ms | 60 / 28 |
| 9/9/2026, 7:13:29 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | reasoning | pass | 661ms | 33 / 30 |
| 9/9/2026, 7:13:27 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | ping | pass | 656ms | 17 / 1 |
| 9/9/2026, 7:13:26 PM | openrouter | moonshotai/kimi-k2 | context | pass | 1232ms | 201 / 43 |
| 9/9/2026, 7:13:23 PM | openrouter | moonshotai/kimi-k2 | speed | pass | 2396ms | 37 / 500 |
| 9/9/2026, 7:13:10 PM | openrouter | moonshotai/kimi-k2 | code | pass | 1398ms | 42 / 101 |
| 9/9/2026, 7:13:06 PM | openrouter | moonshotai/kimi-k2 | json | pass | 1946ms | 59 / 24 |
| 9/9/2026, 7:13:03 PM | openrouter | moonshotai/kimi-k2 | reasoning | pass | 1494ms | 32 / 27 |
| 9/9/2026, 7:13:01 PM | openrouter | moonshotai/kimi-k2 | ping | pass | 1177ms | 16 / 2 |
| 9/9/2026, 7:12:59 PM | openrouter | mistralai/mistral-saba | context | pass | 804ms | 223 / 13 |
| 9/9/2026, 7:12:58 PM | openrouter | mistralai/mistral-saba | speed | pass | 798ms | 45 / 500 |
| 9/9/2026, 7:12:54 PM | openrouter | mistralai/mistral-saba | code | pass | 825ms | 48 / 116 |
| 9/9/2026, 7:12:52 PM | openrouter | mistralai/mistral-saba | json | pass | 791ms | 69 / 32 |
| 9/9/2026, 7:12:51 PM | openrouter | mistralai/mistral-saba | reasoning | pass | 836ms | 40 / 82 |
| 9/9/2026, 7:12:49 PM | openrouter | mistralai/mistral-saba | ping | pass | 740ms | 22 / 3 |
| 9/9/2026, 7:12:48 PM | openrouter | mistralai/mistral-large | context | pass | 869ms | 211 / 37 |
| 9/9/2026, 7:12:47 PM | openrouter | mistralai/mistral-large | speed | pass | 976ms | 33 / 500 |
| 9/9/2026, 7:12:40 PM | openrouter | mistralai/mistral-large | code | pass | 925ms | 36 / 111 |
| 9/9/2026, 7:12:37 PM | openrouter | mistralai/mistral-large | json | pass | 1474ms | 57 / 41 |
| 9/9/2026, 7:12:34 PM | openrouter | mistralai/mistral-large | reasoning | pass | 827ms | 28 / 47 |
| 9/9/2026, 7:12:33 PM | openrouter | mistralai/mistral-large | ping | pass | 889ms | 10 / 3 |
| 9/9/2026, 7:12:32 PM | openrouter | minimax/minimax-m2.7 | context | pass | 2214ms | 219 / 172 |
| 9/9/2026, 7:12:26 PM | openrouter | minimax/minimax-m2.7 | speed | pass | 3901ms | 71 / 500 |
| 9/9/2026, 7:12:11 PM | openrouter | minimax/minimax-m2.7 | code | fail | 1583ms | 74 / 500 |
| 9/9/2026, 7:12:01 PM | openrouter | minimax/minimax-m2.7 | json | pass | 2753ms | 92 / 318 |
| 9/9/2026, 7:11:53 PM | openrouter | minimax/minimax-m2.7 | reasoning | pass | 1336ms | 64 / 302 |
| 9/9/2026, 7:11:46 PM | openrouter | minimax/minimax-m2.7 | ping | pass | 1436ms | 48 / 106 |
| 9/9/2026, 7:11:43 PM | openrouter | meta-llama/llama-3.2-1b-instruct | context | fail | 761ms | 195 / 21 |
| 9/9/2026, 7:11:42 PM | openrouter | meta-llama/llama-3.2-1b-instruct | speed | pass | 699ms | 41 / 500 |
| 9/9/2026, 7:11:35 PM | openrouter | meta-llama/llama-3.2-1b-instruct | code | pass | 674ms | 44 / 153 |
| 9/9/2026, 7:11:33 PM | openrouter | meta-llama/llama-3.2-1b-instruct | json | pass | 625ms | 61 / 40 |
| 9/9/2026, 7:11:31 PM | openrouter | meta-llama/llama-3.2-1b-instruct | reasoning | pass | 634ms | 34 / 21 |
| 9/9/2026, 7:11:30 PM | openrouter | meta-llama/llama-3.2-1b-instruct | ping | pass | 1014ms | 18 / 2 |
| 9/9/2026, 7:11:29 PM | openrouter | ibm-granite/granite-4.0-h-micro | context | pass | 642ms | 214 / 43 |
| 9/9/2026, 7:11:27 PM | openrouter | ibm-granite/granite-4.0-h-micro | speed | pass | 1862ms | 60 / 500 |
| 9/9/2026, 7:11:11 PM | openrouter | ibm-granite/granite-4.0-h-micro | code | pass | 458ms | 63 / 92 |
| 9/9/2026, 7:11:08 PM | openrouter | ibm-granite/granite-4.0-h-micro | json | pass | 840ms | 80 / 29 |
| 9/9/2026, 7:11:06 PM | openrouter | ibm-granite/granite-4.0-h-micro | reasoning | pass | 1066ms | 53 / 35 |
| 9/9/2026, 7:11:04 PM | openrouter | ibm-granite/granite-4.0-h-micro | ping | pass | 1138ms | 37 / 2 |
| 9/9/2026, 7:11:02 PM | openrouter | deepseek/deepseek-v3.1-terminus | context | pass | 1278ms | 196 / 13 |
| 9/9/2026, 7:11:01 PM | openrouter | deepseek/deepseek-v3.1-terminus | speed | pass | 1449ms | 37 / 500 |
| 9/9/2026, 7:10:36 PM | openrouter | deepseek/deepseek-v3.1-terminus | code | pass | 1439ms | 38 / 180 |
| 9/9/2026, 7:10:30 PM | openrouter | deepseek/deepseek-v3.1-terminus | json | pass | 3496ms | 60 / 32 |
| 9/9/2026, 7:10:26 PM | openrouter | deepseek/deepseek-v3.1-terminus | reasoning | pass | 1110ms | 30 / 61 |
| 9/9/2026, 7:10:22 PM | openrouter | deepseek/deepseek-v3.1-terminus | ping | pass | 1475ms | 14 / 2 |
| 9/9/2026, 7:10:20 PM | openrouter | cohere/north-mini-code:free | context | pass | 621ms | 174 / 81 |
| 9/9/2026, 7:10:19 PM | openrouter | cohere/north-mini-code:free | speed | pass | 627ms | 29 / 498 |
| 9/9/2026, 7:10:12 PM | openrouter | cohere/north-mini-code:free | code | fail | 964ms | 32 / 498 |
| 9/9/2026, 7:10:09 PM | openrouter | cohere/north-mini-code:free | json | pass | 701ms | 50 / 249 |
| 9/9/2026, 7:10:04 PM | openrouter | cohere/north-mini-code:free | reasoning | pass | 666ms | 23 / 160 |
| 9/9/2026, 7:10:02 PM | openrouter | cohere/north-mini-code:free | ping | pass | 670ms | 7 / 38 |
| 9/9/2026, 7:10:00 PM | openrouter | bytedance-seed/seed-2.0-mini | context | pass | 534ms | 274 / 91 |
| 9/9/2026, 7:09:59 PM | openrouter | bytedance-seed/seed-2.0-mini | speed | pass | 676ms | 78 / 500 |
| 9/9/2026, 7:09:54 PM | openrouter | bytedance-seed/seed-2.0-mini | code | pass | 671ms | 82 / 1306 |
| 9/9/2026, 7:09:38 PM | openrouter | bytedance-seed/seed-2.0-mini | json | pass | 537ms | 101 / 175 |
| 9/9/2026, 7:09:36 PM | openrouter | bytedance-seed/seed-2.0-mini | reasoning | pass | 797ms | 73 / 254 |
| 9/9/2026, 7:09:33 PM | openrouter | bytedance-seed/seed-2.0-mini | ping | pass | 852ms | 55 / 27 |
| 9/9/2026, 7:09:32 PM | openrouter | amazon/nova-pro-v1 | context | pass | 1158ms | 186 / 77 |
| 9/9/2026, 7:09:30 PM | openrouter | amazon/nova-pro-v1 | speed | pass | 1025ms | 30 / 500 |
| 9/9/2026, 7:09:24 PM | openrouter | amazon/nova-pro-v1 | code | pass | 968ms | 33 / 122 |
| 9/9/2026, 7:09:23 PM | openrouter | amazon/nova-pro-v1 | json | pass | 910ms | 54 / 30 |
| 9/9/2026, 7:09:21 PM | openrouter | amazon/nova-pro-v1 | reasoning | pass | 1418ms | 25 / 21 |
| 9/9/2026, 7:09:19 PM | openrouter | amazon/nova-pro-v1 | ping | pass | 988ms | 7 / 3 |
| 9/9/2026, 7:09:18 PM | openrouter | aion-labs/aion-3.0 | context | pass | 995ms | 190 / 166 |
| 9/9/2026, 7:09:09 PM | openrouter | aion-labs/aion-3.0 | speed | pass | 1467ms | 36 / 1000 |
| 9/9/2026, 7:08:40 PM | openrouter | aion-labs/aion-3.0 | code | fail | 1209ms | 39 / 500 |
| 9/9/2026, 7:08:21 PM | openrouter | aion-labs/aion-3.0 | json | pass | 1816ms | 56 / 97 |
| 9/9/2026, 7:08:15 PM | openrouter | aion-labs/aion-3.0 | reasoning | pass | 1718ms | 29 / 253 |
| 9/9/2026, 7:08:09 PM | openrouter | aion-labs/aion-3.0 | ping | pass | 1756ms | 14 / 63 |
| 9/9/2026, 7:08:06 PM | openai | gpt-4o | tool_use | pass | 949ms | 71 / 16 |
| 9/9/2026, 7:08:04 PM | openai | gpt-4o | context | pass | 1405ms | 190 / 32 |
| 9/9/2026, 7:08:03 PM | openai | gpt-4o | speed | pass | 9008ms | 37 / 756 |
| 9/9/2026, 7:07:53 PM | openai | gpt-4o | code | pass | 1998ms | 40 / 149 |
| 9/9/2026, 7:07:51 PM | openai | gpt-4o | json | pass | 1074ms | 57 / 23 |
| 9/9/2026, 7:07:50 PM | openai | gpt-4o | reasoning | pass | 1136ms | 30 / 55 |
| 9/9/2026, 7:07:48 PM | openai | gpt-4o | ping | pass | 998ms | 14 / 1 |
| 9/9/2026, 7:07:47 PM | openai | gpt-4-turbo-2024-04-09 | tool_use | pass | 4004ms | 73 / 21 |
| 9/9/2026, 7:07:43 PM | openai | gpt-4-turbo-2024-04-09 | context | pass | 1637ms | 191 / 28 |
| 9/9/2026, 7:07:41 PM | openai | gpt-4-turbo-2024-04-09 | speed | fail | 20028ms | — |
| 9/9/2026, 7:07:21 PM | openai | gpt-4-turbo-2024-04-09 | code | pass | 11249ms | 40 / 150 |
| 9/9/2026, 7:07:09 PM | openai | gpt-4-turbo-2024-04-09 | json | pass | 3604ms | 57 / 34 |
| 9/9/2026, 7:07:05 PM | openai | gpt-4-turbo-2024-04-09 | reasoning | pass | 4246ms | 30 / 70 |
| 9/9/2026, 7:07:01 PM | openai | gpt-4-turbo-2024-04-09 | ping | pass | 2187ms | 14 / 1 |
| 9/9/2026, 7:06:58 PM | openai | gpt-3.5-turbo | tool_use | pass | 2220ms | 73 / 16 |
| 9/9/2026, 7:06:56 PM | openai | gpt-3.5-turbo | context | pass | 1558ms | 191 / 12 |
| 9/9/2026, 7:06:54 PM | openai | gpt-3.5-turbo | speed | pass | 5615ms | 37 / 494 |
| 9/9/2026, 7:06:48 PM | openai | gpt-3.5-turbo | code | pass | 2206ms | 40 / 94 |
| 9/9/2026, 7:06:45 PM | openai | gpt-3.5-turbo | json | pass | 2500ms | 57 / 34 |
| 9/9/2026, 7:06:43 PM | openai | gpt-3.5-turbo | reasoning | pass | 2885ms | 30 / 8 |
| 9/9/2026, 7:06:40 PM | openai | gpt-3.5-turbo | ping | pass | 2061ms | 14 / 1 |
| 9/9/2026, 7:06:37 PM | groq | openai/gpt-oss-120b | tool_use | pass | 293ms | 146 / 55 |
| 9/9/2026, 7:06:37 PM | groq | openai/gpt-oss-120b | context | pass | 586ms | 254 / 98 |
| 9/9/2026, 7:06:36 PM | groq | openai/gpt-oss-120b | speed | pass | 1779ms | 101 / 756 |
| 9/9/2026, 7:06:34 PM | groq | openai/gpt-oss-120b | code | pass | 973ms | 104 / 377 |
| 9/9/2026, 7:06:32 PM | groq | openai/gpt-oss-120b | json | pass | 485ms | 121 / 145 |
| 9/9/2026, 7:06:32 PM | groq | openai/gpt-oss-120b | reasoning | pass | 418ms | 94 / 116 |
| 9/9/2026, 7:06:31 PM | groq | openai/gpt-oss-120b | ping | pass | 283ms | 78 / 44 |
| 9/9/2026, 7:06:30 PM | deepinfra | zai-org/GLM-5.1 | tool_use | pass | 1707ms | 184 / 41 |
| 9/9/2026, 7:06:28 PM | deepinfra | zai-org/GLM-5.1 | context | pass | 3068ms | 189 / 284 |
| 9/9/2026, 7:06:25 PM | deepinfra | zai-org/GLM-5.1 | speed | pass | 10881ms | 35 / 756 |
| 9/9/2026, 7:06:14 PM | deepinfra | zai-org/GLM-5.1 | code | pass | 40895ms | 38 / 2992 |
| 9/9/2026, 7:05:33 PM | deepinfra | zai-org/GLM-5.1 | json | pass | 4454ms | 55 / 324 |
| 9/9/2026, 7:05:28 PM | deepinfra | zai-org/GLM-5.1 | reasoning | pass | 7573ms | 28 / 468 |
| 9/9/2026, 7:05:20 PM | deepinfra | zai-org/GLM-5.1 | ping | pass | 2807ms | 12 / 119 |
| 9/9/2026, 7:05:17 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | tool_use | pass | 3039ms | 105 / 30 |
| 9/9/2026, 7:05:14 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | context | pass | 1321ms | 212 / 15 |
| 9/9/2026, 7:05:12 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | speed | fail | 20491ms | — |
| 9/9/2026, 7:04:51 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | code | fail | 9611ms | 37 / 261 |
| 9/9/2026, 7:04:41 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | json | pass | 2391ms | 58 / 38 |
| 9/9/2026, 7:04:39 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | reasoning | fail | 1446ms | 29 / 31 |
| 9/9/2026, 7:04:37 PM | deepinfra | mistralai/Mistral-Nemo-Instruct-2407 | ping | pass | 1407ms | 11 / 4 |
| 9/9/2026, 7:04:35 PM | deepinfra | google/gemma-4-26B-A4B-it | tool_use | pass | 1335ms | 99 / 17 |