Loading benchmark data…EyesInAI·Loading live benchmark data Loading leaderboard…EyesInAI·Loading leaderboard… Leaderboard
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
Models tested
203
across 9 providers
Tasks completed
1227
of 1353 attempts
Avg cost / 1k runs
$0.829
across passing tasks
Best value
<$0.01
Mistral-Nemo-Instruct-2407
Average Latency by Test & Provider
anthropic92% pass
9 models · 58/63 passed3992ms avg
Avg cost / 1k: $3.75
baseten100% pass
1 models · 7/7 passed2327ms avg
Avg cost / 1k: $0.402
deepinfra79% pass
39 models · 217/273 passed5144ms avg
Avg cost / 1k: $0.394
fireworks95% pass
3 models · 20/21 passed4840ms avg
Avg cost / 1k: $1.30
4 models · 22/28 passed1577ms avg
nvidia42% pass
2 models · 5/12 passed11384ms avg
Avg cost / 1k: free
openai99% pass
18 models · 125/126 passed2390ms avg
Avg cost / 1k: $0.930
openrouter95% pass
129 models · 733/774 passed1151ms avg
Avg cost / 1k: $0.839
together82% pass
7 models · 40/49 passed4109ms avg
Avg cost / 1k: $0.458