Loading benchmark data…
EyesInAI·Loading live benchmark data
The raw, unedited run log behind the leaderboard — every model, test, latency and pass/fail, straight from the database. This is the receipts: the leaderboard and methodology summarize it; this is the source. 200 total rows — showing the latest 200.
| Time | Provider | Model | Test | Status | Latency | Tokens |
|---|---|---|---|---|---|---|
| 10/27/2026, 6:59:38 AM | openrouter | google/gemini-2.5-flash | context | pass | 910ms | 210 / 10 |
| 10/27/2026, 6:59:37 AM | openrouter | google/gemini-2.5-flash | speed | pass | 997ms | 31 / 501 |
| 10/27/2026, 6:59:33 AM | openrouter | google/gemini-2.5-flash | code | pass | 875ms | 34 / 164 |
| 10/27/2026, 6:59:31 AM | openrouter | google/gemini-2.5-flash | json | pass | 947ms | 53 / 29 |
| 10/27/2026, 6:59:30 AM | openrouter | google/gemini-2.5-flash | reasoning | pass | 866ms | 26 / 45 |
| 10/27/2026, 6:59:29 AM | openrouter | google/gemini-2.5-flash | ping | pass | 850ms | 8 / 1 |
| 10/27/2026, 6:59:27 AM | openrouter | anthropic/claude-opus-4.6-fast | context | fail | 128ms | — |
| 10/27/2026, 6:59:27 AM | openrouter | anthropic/claude-opus-4.6-fast | speed | fail | 117ms | — |
| 10/27/2026, 6:59:27 AM | openrouter | anthropic/claude-opus-4.6-fast | code | fail | 131ms | — |
| 10/27/2026, 6:59:26 AM | openrouter | anthropic/claude-opus-4.6-fast | json | fail | 148ms | — |
| 10/27/2026, 6:59:26 AM | openrouter | anthropic/claude-opus-4.6-fast | reasoning | fail | 134ms | — |
| 10/27/2026, 6:59:26 AM | openrouter | anthropic/claude-opus-4.6-fast | ping | fail | 125ms | — |
| 10/27/2026, 6:59:25 AM | openrouter | anthropic/claude-haiku-4.5 | context | pass | 1116ms | 222 / 54 |
| 10/27/2026, 6:59:24 AM | openrouter | anthropic/claude-haiku-4.5 | speed | pass | 1404ms | 38 / 500 |
| 10/27/2026, 6:59:18 AM | openrouter | anthropic/claude-haiku-4.5 | code | pass | 1087ms | 40 / 249 |
| 10/27/2026, 6:59:15 AM | openrouter | anthropic/claude-haiku-4.5 | json | pass | 1082ms | 59 / 47 |
| 10/27/2026, 6:59:14 AM | openrouter | anthropic/claude-haiku-4.5 | reasoning | pass | 1705ms | 32 / 41 |
| 10/27/2026, 6:59:12 AM | openrouter | anthropic/claude-haiku-4.5 | ping | pass | 1104ms | 14 / 4 |
| 10/27/2026, 6:59:10 AM | nvidia | meta/llama-4-maverick-17b-128e-instruct | context | fail | 274ms | — |
| 10/27/2026, 6:59:10 AM | nvidia | meta/llama-4-maverick-17b-128e-instruct | speed | fail | 279ms | — |
| 10/27/2026, 6:59:09 AM | nvidia | meta/llama-4-maverick-17b-128e-instruct | code | fail | 279ms | — |
| 10/27/2026, 6:59:09 AM | nvidia | meta/llama-4-maverick-17b-128e-instruct | json | fail | 284ms | — |
| 10/27/2026, 6:59:08 AM | nvidia | meta/llama-4-maverick-17b-128e-instruct | reasoning | fail | 274ms | — |
| 10/27/2026, 6:59:08 AM | nvidia | meta/llama-4-maverick-17b-128e-instruct | ping | fail | 286ms | — |
| 10/27/2026, 6:59:07 AM | nvidia | meta/llama-3.3-70b-instruct | context | fail | 273ms | — |
| 10/27/2026, 6:59:07 AM | nvidia | meta/llama-3.3-70b-instruct | speed | fail | 279ms | — |
| 10/27/2026, 6:59:06 AM | nvidia | meta/llama-3.3-70b-instruct | code | fail | 276ms | — |
| 10/27/2026, 6:59:06 AM | nvidia | meta/llama-3.3-70b-instruct | json | fail | 276ms | — |
| 10/27/2026, 6:59:05 AM | nvidia | meta/llama-3.3-70b-instruct | reasoning | fail | 274ms | — |
| 10/27/2026, 6:59:05 AM | nvidia | meta/llama-3.3-70b-instruct | ping | fail | 284ms | — |
| 10/27/2026, 6:59:04 AM | nvidia | meta/llama-3.1-405b-instruct | context | fail | 272ms | — |
| 10/27/2026, 6:59:04 AM | nvidia | meta/llama-3.1-405b-instruct | speed | fail | 273ms | — |
| 10/27/2026, 6:59:03 AM | nvidia | meta/llama-3.1-405b-instruct | code | fail | 276ms | — |
| 10/27/2026, 6:59:03 AM | nvidia | meta/llama-3.1-405b-instruct | json | fail | 278ms | — |
| 10/27/2026, 6:59:02 AM | nvidia | meta/llama-3.1-405b-instruct | reasoning | fail | 271ms | — |
| 10/27/2026, 6:59:02 AM | nvidia | meta/llama-3.1-405b-instruct | ping | fail | 276ms | — |
| 10/27/2026, 6:59:01 AM | nvidia | deepseek-ai/deepseek-r1-distill-qwen-32b | context | fail | 278ms | — |
| 10/27/2026, 6:59:01 AM | nvidia | deepseek-ai/deepseek-r1-distill-qwen-32b | speed | fail | 276ms | — |
| 10/27/2026, 6:59:00 AM | nvidia | deepseek-ai/deepseek-r1-distill-qwen-32b | code | fail | 277ms | — |
| 10/27/2026, 6:59:00 AM | nvidia | deepseek-ai/deepseek-r1-distill-qwen-32b | json | fail | 271ms | — |
| 10/27/2026, 6:58:59 AM | nvidia | deepseek-ai/deepseek-r1-distill-qwen-32b | reasoning | fail | 269ms | — |
| 10/27/2026, 6:58:58 AM | nvidia | deepseek-ai/deepseek-r1-distill-qwen-32b | ping | fail | 276ms | — |
| 10/27/2026, 6:58:58 AM | nvidia | deepseek-ai/deepseek-r1-distill-llama-8b | context | fail | 273ms | — |
| 10/27/2026, 6:58:57 AM | nvidia | deepseek-ai/deepseek-r1-distill-llama-8b | speed | fail | 277ms | — |
| 10/27/2026, 6:58:57 AM | nvidia | deepseek-ai/deepseek-r1-distill-llama-8b | code | fail | 278ms | — |
| 10/27/2026, 6:58:56 AM | nvidia | deepseek-ai/deepseek-r1-distill-llama-8b | json | fail | 281ms | — |
| 10/27/2026, 6:58:56 AM | nvidia | deepseek-ai/deepseek-r1-distill-llama-8b | reasoning | fail | 272ms | — |
| 10/27/2026, 6:58:55 AM | nvidia | deepseek-ai/deepseek-r1-distill-llama-8b | ping | fail | 268ms | — |
| 10/27/2026, 6:58:55 AM | gemini | gemma-3-27b-it | tool_use | fail | 397ms | — |
| 10/27/2026, 6:58:54 AM | gemini | gemma-3-27b-it | context | fail | 410ms | — |
| 10/27/2026, 6:58:54 AM | gemini | gemma-3-27b-it | speed | fail | 377ms | — |
| 10/27/2026, 6:58:53 AM | gemini | gemma-3-27b-it | code | fail | 406ms | — |
| 10/27/2026, 6:58:52 AM | gemini | gemma-3-27b-it | json | fail | 380ms | — |
| 10/27/2026, 6:58:52 AM | gemini | gemma-3-27b-it | reasoning | fail | 384ms | — |
| 10/27/2026, 6:58:51 AM | gemini | gemma-3-27b-it | ping | fail | 404ms | — |
| 10/27/2026, 6:58:50 AM | gemini | gemma-3-12b-it | tool_use | fail | 368ms | — |
| 10/27/2026, 6:58:50 AM | gemini | gemma-3-12b-it | context | fail | 394ms | — |
| 10/27/2026, 6:58:49 AM | gemini | gemma-3-12b-it | speed | fail | 419ms | — |
| 10/27/2026, 6:58:49 AM | gemini | gemma-3-12b-it | code | fail | 370ms | — |
| 10/27/2026, 6:58:48 AM | gemini | gemma-3-12b-it | json | fail | 482ms | — |
| 10/27/2026, 6:58:47 AM | gemini | gemma-3-12b-it | reasoning | fail | 373ms | — |
| 10/27/2026, 6:58:47 AM | gemini | gemma-3-12b-it | ping | fail | 561ms | — |
| 10/26/2026, 7:37:22 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | tool_use | pass | 613ms | 320 / 28 |
| 10/26/2026, 7:37:21 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | context | pass | 622ms | 225 / 24 |
| 10/26/2026, 7:37:20 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | speed | pass | 2537ms | 47 / 756 |
| 10/26/2026, 7:37:17 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | code | pass | 1822ms | 50 / 142 |
| 10/26/2026, 7:37:15 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | json | pass | 586ms | 71 / 30 |
| 10/26/2026, 7:37:14 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | reasoning | pass | 592ms | 42 / 35 |
| 10/26/2026, 7:37:13 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | ping | pass | 589ms | 24 / 2 |
| 10/26/2026, 7:37:13 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | tool_use | pass | 628ms | 320 / 28 |
| 10/26/2026, 7:37:12 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | context | pass | 620ms | 225 / 24 |
| 10/26/2026, 7:37:11 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | speed | pass | 2589ms | 47 / 756 |
| 10/26/2026, 7:37:08 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | code | pass | 820ms | 50 / 154 |
| 10/26/2026, 7:37:07 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | json | pass | 604ms | 71 / 35 |
| 10/26/2026, 7:37:06 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | reasoning | pass | 582ms | 42 / 33 |
| 10/26/2026, 7:37:05 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | ping | pass | 972ms | 24 / 2 |
| 10/26/2026, 7:37:04 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | tool_use | pass | 600ms | 320 / 28 |
| 10/26/2026, 7:37:03 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | context | pass | 1459ms | 225 / 13 |
| 10/26/2026, 7:37:02 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | speed | pass | 11602ms | 47 / 756 |
| 10/26/2026, 7:36:50 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | code | pass | 833ms | 50 / 151 |
| 10/26/2026, 7:36:49 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | json | pass | 612ms | 71 / 31 |
| 10/26/2026, 7:36:48 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | reasoning | pass | 2236ms | 42 / 43 |
| 10/26/2026, 7:36:45 PM | baseten | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B | ping | pass | 1114ms | 24 / 2 |
| 10/26/2026, 7:36:44 PM | openrouter | z-ai/glm-4.5 | context | pass | 9262ms | 189 / 320 |
| 10/26/2026, 7:36:32 PM | openrouter | z-ai/glm-4.5 | speed | fail | 9770ms | 35 / 500 |
| 10/26/2026, 7:36:11 PM | openrouter | z-ai/glm-4.5 | code | pass | 8962ms | 38 / 568 |
| 10/26/2026, 7:35:34 PM | openrouter | z-ai/glm-4.5 | json | pass | 9474ms | 55 / 377 |
| 10/26/2026, 7:35:20 PM | openrouter | z-ai/glm-4.5 | reasoning | pass | 9531ms | 28 / 456 |
| 10/26/2026, 7:34:53 PM | openrouter | z-ai/glm-4.5 | ping | pass | 8893ms | 12 / 146 |
| 10/26/2026, 7:34:44 PM | openrouter | x-ai/grok-4.3 | context | pass | 680ms | 370 / 357 |
| 10/26/2026, 7:34:40 PM | openrouter | x-ai/grok-4.3 | speed | pass | 636ms | 222 / 990 |
| 10/26/2026, 7:34:28 PM | openrouter | x-ai/grok-4.3 | code | fail | 607ms | 225 / 406 |
| 10/26/2026, 7:34:19 PM | openrouter | x-ai/grok-4.3 | json | pass | 541ms | 242 / 348 |
| 10/26/2026, 7:34:14 PM | openrouter | x-ai/grok-4.3 | reasoning | pass | 597ms | 215 / 346 |
| 10/26/2026, 7:34:08 PM | openrouter | x-ai/grok-4.3 | ping | pass | 664ms | 199 / 116 |
| 10/26/2026, 7:34:06 PM | openrouter | tencent/hy4-preview | context | pass | 1257ms | 221 / 103 |
| 10/26/2026, 7:34:02 PM | openrouter | tencent/hy4-preview | speed | fail | 1199ms | 51 / 500 |
| 10/26/2026, 7:33:51 PM | openrouter | tencent/hy4-preview | code | pass | 631ms | 54 / 641 |
| 10/26/2026, 7:33:39 PM | openrouter | tencent/hy4-preview | json | pass | 628ms | 73 / 185 |
| 10/26/2026, 7:33:33 PM | openrouter | tencent/hy4-preview | reasoning | pass | 1105ms | 44 / 1378 |
| 10/26/2026, 7:33:06 PM | openrouter | tencent/hy4-preview | ping | pass | 375ms | 28 / 46 |
| 10/26/2026, 7:32:47 PM | openrouter | tencent/hy-mt2-1.8b | context | pass | 398ms | 202 / 13 |
| 10/26/2026, 7:32:46 PM | openrouter | tencent/hy-mt2-1.8b | speed | pass | 432ms | 33 / 500 |
| 10/26/2026, 7:32:43 PM | openrouter | tencent/hy-mt2-1.8b | code | pass | 483ms | 36 / 157 |
| 10/26/2026, 7:32:42 PM | openrouter | tencent/hy-mt2-1.8b | json | pass | 418ms | 55 / 30 |
| 10/26/2026, 7:32:41 PM | openrouter | tencent/hy-mt2-1.8b | reasoning | pass | 466ms | 26 / 25 |
| 10/26/2026, 7:32:40 PM | openrouter | tencent/hy-mt2-1.8b | ping | pass | 417ms | 10 / 2 |
| 10/26/2026, 7:32:40 PM | openrouter | stepfun/step-5-preview | context | pass | 1304ms | 200 / 137 |
| 10/26/2026, 7:32:38 PM | openrouter | stepfun/step-5-preview | speed | fail | 1124ms | 41 / 500 |
| 10/26/2026, 7:32:33 PM | openrouter | stepfun/step-5-preview | code | pass | 445ms | 45 / 217 |
| 10/26/2026, 7:32:32 PM | openrouter | stepfun/step-5-preview | json | pass | 799ms | 64 / 248 |
| 10/26/2026, 7:32:30 PM | openrouter | stepfun/step-5-preview | reasoning | pass | 946ms | 34 / 228 |
| 10/26/2026, 7:32:28 PM | openrouter | stepfun/step-5-preview | ping | pass | 681ms | 18 / 25 |
| 10/26/2026, 7:32:27 PM | openrouter | scaledown/summarize | context | pass | 2157ms | 339 / 172 |
| 10/26/2026, 7:32:25 PM | openrouter | scaledown/summarize | speed | pass | 863ms | 149 / 77 |
| 10/26/2026, 7:32:23 PM | openrouter | scaledown/summarize | code | fail | 684ms | 152 / 41 |
| 10/26/2026, 7:32:22 PM | openrouter | scaledown/summarize | json | pass | 1549ms | 171 / 33 |
| 10/26/2026, 7:32:21 PM | openrouter | scaledown/summarize | reasoning | pass | 1268ms | 144 / 27 |
| 10/26/2026, 7:32:19 PM | openrouter | scaledown/summarize | ping | pass | 1079ms | 126 / 2 |
| 10/26/2026, 7:32:18 PM | openrouter | sakana/fugu-ultra | context | pass | 6336ms | 1515 / 34 |
| 10/26/2026, 7:32:11 PM | openrouter | sakana/fugu-ultra | speed | pass | 16352ms | 14721 / 7678 |
| 10/26/2026, 7:30:10 PM | openrouter | sakana/fugu-ultra | code | pass | 15577ms | 5909 / 1140 |
| 10/26/2026, 7:29:42 PM | openrouter | sakana/fugu-ultra | json | pass | 10263ms | 1382 / 248 |
| 10/26/2026, 7:29:31 PM | openrouter | sakana/fugu-ultra | reasoning | pass | 15583ms | 5364 / 881 |
| 10/26/2026, 7:29:09 PM | openrouter | sakana/fugu-ultra | ping | pass | 5264ms | 1339 / 61 |
| 10/26/2026, 7:29:03 PM | openrouter | qwen/qwen3.7-plus:batch | context | fail | 156ms | — |
| 10/26/2026, 7:29:03 PM | openrouter | qwen/qwen3.7-plus:batch | speed | fail | 126ms | — |
| 10/26/2026, 7:29:03 PM | openrouter | qwen/qwen3.7-plus:batch | code | fail | 116ms | — |
| 10/26/2026, 7:29:02 PM | openrouter | qwen/qwen3.7-plus:batch | json | fail | 133ms | — |
| 10/26/2026, 7:29:02 PM | openrouter | qwen/qwen3.7-plus:batch | reasoning | fail | 126ms | — |
| 10/26/2026, 7:29:01 PM | openrouter | qwen/qwen3.7-plus:batch | ping | fail | 119ms | — |
| 10/26/2026, 7:29:01 PM | openrouter | qwen/qwen3.7-flash | context | pass | 1624ms | 230 / 394 |
| 10/26/2026, 7:28:53 PM | openrouter | qwen/qwen3.7-flash | speed | fail | 999ms | 40 / 500 |
| 10/26/2026, 7:28:46 PM | openrouter | qwen/qwen3.7-flash | code | pass | 534ms | 43 / 1744 |
| 10/26/2026, 7:28:22 PM | openrouter | qwen/qwen3.7-flash | json | pass | 819ms | 62 / 799 |
| 10/26/2026, 7:28:10 PM | openrouter | qwen/qwen3.7-flash | reasoning | pass | 830ms | 35 / 1003 |
| 10/26/2026, 7:27:57 PM | openrouter | qwen/qwen3.7-flash | ping | pass | 509ms | 17 / 272 |
| 10/26/2026, 7:27:53 PM | openrouter | qwen/qwen3.5-27b | context | pass | 421ms | 230 / 739 |
| 10/26/2026, 7:27:32 PM | openrouter | qwen/qwen3.5-27b | speed | fail | 547ms | 40 / 500 |
| 10/26/2026, 7:27:23 PM | openrouter | qwen/qwen3.5-27b | code | pass | 554ms | 43 / 1564 |
| 10/26/2026, 7:27:03 PM | openrouter | qwen/qwen3.5-27b | json | pass | 892ms | 62 / 706 |
| 10/26/2026, 7:26:55 PM | openrouter | qwen/qwen3.5-27b | reasoning | pass | 471ms | 35 / 7118 |
| 10/26/2026, 7:23:57 PM | openrouter | qwen/qwen3.5-27b | ping | pass | 402ms | 17 / 251 |
| 10/26/2026, 7:23:51 PM | openrouter | qwen/qwen3-coder-flash | context | pass | 494ms | 204 / 41 |
| 10/26/2026, 7:23:50 PM | openrouter | qwen/qwen3-coder-flash | speed | pass | 688ms | 38 / 500 |
| 10/26/2026, 7:23:44 PM | openrouter | qwen/qwen3-coder-flash | code | pass | 700ms | 41 / 177 |
| 10/26/2026, 7:23:42 PM | openrouter | qwen/qwen3-coder-flash | json | pass | 806ms | 60 / 37 |
| 10/26/2026, 7:23:40 PM | openrouter | qwen/qwen3-coder-flash | reasoning | pass | 762ms | 33 / 60 |
| 10/26/2026, 7:23:39 PM | openrouter | qwen/qwen3-coder-flash | ping | pass | 838ms | 15 / 1 |
| 10/26/2026, 7:23:38 PM | openrouter | qwen/qwen3-235b-a22b-2507 | context | pass | 451ms | 204 / 31 |
| 10/26/2026, 7:23:34 PM | openrouter | qwen/qwen3-235b-a22b-2507 | speed | pass | 362ms | 38 / 500 |
| 10/26/2026, 7:22:56 PM | openrouter | qwen/qwen3-235b-a22b-2507 | code | pass | 384ms | 41 / 154 |
| 10/26/2026, 7:22:44 PM | openrouter | qwen/qwen3-235b-a22b-2507 | json | pass | 376ms | 60 / 30 |
| 10/26/2026, 7:22:41 PM | openrouter | qwen/qwen3-235b-a22b-2507 | reasoning | pass | 343ms | 33 / 55 |
| 10/26/2026, 7:22:36 PM | openrouter | qwen/qwen3-235b-a22b-2507 | ping | pass | 860ms | 15 / 2 |
| 10/26/2026, 7:22:35 PM | openrouter | qwen/qwen-2.5-coder-32b-instruct | context | pass | 340ms | 225 / 29 |
| 10/26/2026, 7:22:34 PM | openrouter | qwen/qwen-2.5-coder-32b-instruct | speed | pass | 348ms | 59 / 500 |
| 10/26/2026, 7:22:18 PM | openrouter | qwen/qwen-2.5-coder-32b-instruct | code | fail | 349ms | 62 / 102 |
| 10/26/2026, 7:22:14 PM | openrouter | qwen/qwen-2.5-coder-32b-instruct | json | pass | 349ms | 81 / 22 |
| 10/26/2026, 7:22:13 PM | openrouter | qwen/qwen-2.5-coder-32b-instruct | reasoning | pass | 328ms | 54 / 20 |
| 10/26/2026, 7:22:11 PM | openrouter | qwen/qwen-2.5-coder-32b-instruct | ping | pass | 634ms | 36 / 2 |
| 10/26/2026, 7:22:10 PM | openrouter | perplexity/sonar | context | pass | 3075ms | 184 / 28 |
| 10/26/2026, 7:22:06 PM | openrouter | perplexity/sonar | speed | pass | 1448ms | 30 / 500 |
| 10/26/2026, 7:21:58 PM | openrouter | perplexity/sonar | code | pass | 1152ms | 33 / 106 |
| 10/26/2026, 7:21:55 PM | openrouter | perplexity/sonar | json | pass | 2310ms | 50 / 21 |
| 10/26/2026, 7:21:52 PM | openrouter | perplexity/sonar | reasoning | pass | 1224ms | 23 / 50 |
| 10/26/2026, 7:21:50 PM | openrouter | perplexity/sonar | ping | pass | 1518ms | 7 / 1 |
| 10/26/2026, 7:21:48 PM | openrouter | openai/gpt-6-luna-pro | context | pass | 719ms | 2026 / 100 |
| 10/26/2026, 7:21:44 PM | openrouter | openai/gpt-6-luna-pro | speed | pass | 795ms | 2449 / 1335 |
| 10/26/2026, 7:21:32 PM | openrouter | openai/gpt-6-luna-pro | code | pass | 1072ms | 1826 / 440 |
| 10/26/2026, 7:21:26 PM | openrouter | openai/gpt-6-luna-pro | json | pass | 662ms | 1721 / 332 |
| 10/26/2026, 7:21:20 PM | openrouter | openai/gpt-6-luna-pro | reasoning | pass | 1189ms | 1615 / 226 |
| 10/26/2026, 7:21:14 PM | openrouter | openai/gpt-6-luna-pro | ping | pass | 575ms | 1402 / 41 |
| 10/26/2026, 7:21:11 PM | openrouter | openai/gpt-6-astra | context | pass | 1327ms | 189 / 16 |
| 10/26/2026, 7:21:09 PM | openrouter | openai/gpt-6-astra | speed | pass | 1130ms | 36 / 500 |
| 10/26/2026, 7:20:55 PM | openrouter | openai/gpt-6-astra | code | pass | 798ms | 39 / 181 |
| 10/26/2026, 7:20:48 PM | openrouter | openai/gpt-6-astra | json | pass | 1155ms | 56 / 24 |
| 10/26/2026, 7:20:45 PM | openrouter | openai/gpt-6-astra | reasoning | pass | 678ms | 29 / 65 |
| 10/26/2026, 7:20:42 PM | openrouter | openai/gpt-6-astra | ping | pass | 1335ms | 13 / 5 |
| 10/26/2026, 7:20:38 PM | openrouter | nvidia/nemotron-3.5-lightning | context | pass | 384ms | 224 / 513 |
| 10/26/2026, 7:20:33 PM | openrouter | nvidia/nemotron-3.5-lightning | speed | fail | 445ms | 46 / 500 |
| 10/26/2026, 7:20:31 PM | openrouter | nvidia/nemotron-3.5-lightning | code | pass | 451ms | 49 / 799 |
| 10/26/2026, 7:20:26 PM | openrouter | nvidia/nemotron-3.5-lightning | json | pass | 957ms | 70 / 612 |
| 10/26/2026, 7:20:21 PM | openrouter | nvidia/nemotron-3.5-lightning | reasoning | pass | 531ms | 41 / 874 |
| 10/26/2026, 7:20:16 PM | openrouter | nvidia/nemotron-3.5-lightning | ping | pass | 422ms | 23 / 217 |
| 10/26/2026, 7:20:14 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | context | pass | 366ms | 194 / 37 |
| 10/26/2026, 7:20:12 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | speed | pass | 366ms | 40 / 500 |
| 10/26/2026, 7:19:46 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | code | pass | 361ms | 43 / 97 |
| 10/26/2026, 7:19:38 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | json | pass | 375ms | 60 / 28 |
| 10/26/2026, 7:19:36 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | reasoning | pass | 388ms | 33 / 43 |
| 10/26/2026, 7:19:20 PM | openrouter | nousresearch/hermes-3-llama-3.1-405b | ping | pass | 362ms | 17 / 1 |
| 10/26/2026, 7:19:20 PM | openrouter | mistralai/mistral-nemo | context | pass | 439ms | 211 / 15 |
| 10/26/2026, 7:19:17 PM | openrouter | mistralai/mistral-nemo | speed | pass | 392ms | 33 / 500 |
| 10/26/2026, 7:18:31 PM | openrouter | mistralai/mistral-nemo | code | pass | 374ms | 36 / 90 |
| 10/26/2026, 7:18:26 PM | openrouter | mistralai/mistral-nemo | json | pass | 499ms | 57 / 38 |
| 10/26/2026, 7:18:22 PM | openrouter | mistralai/mistral-nemo | reasoning | pass | 479ms | 28 / 20 |
| 10/26/2026, 7:18:20 PM | openrouter | mistralai/mistral-nemo | ping | pass | 594ms | 10 / 2 |
| 10/26/2026, 7:18:19 PM | openrouter | mistralai/mistral-large-4-0 | context | pass | 877ms | 207 / 412 |
| 10/26/2026, 7:18:11 PM | openrouter | mistralai/mistral-large-4-0 | speed | fail | 963ms | 33 / 500 |
| 10/26/2026, 7:18:05 PM | openrouter | mistralai/mistral-large-4-0 | code | fail | 1293ms | 36 / 500 |