Loading benchmark data…EyesInAI·Loading live benchmark data Loading leaderboard…EyesInAI·Loading leaderboard… Leaderboard
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
Models tested
231
across 10 providers
Tasks completed
1441
of 1543 attempts
Avg cost / 1k runs
$1.82
across passing tasks
Best value
<$0.01
mistral-nemo
Average Latency by Test & Provider
anthropic92% pass
9 models · 58/63 passed2663ms avg
Avg cost / 1k: $2.98
baseten100% pass
1 models · 7/7 passed1052ms avg
Avg cost / 1k: $0.415
deepinfra88% pass
24 models · 143/163 passed6848ms avg
Avg cost / 1k: $0.557
fireworks98% pass
9 models · 62/63 passed3429ms avg
Avg cost / 1k: $0.150
17 models · 113/118 passed3272ms avg
groq100% pass
3 models · 21/21 passed638ms avg
Avg cost / 1k: $0.116
minimax92% pass
2 models · 33/36 passed3675ms avg
openai96% pass
16 models · 107/112 passed2307ms avg
Avg cost / 1k: $1.84
openrouter93% pass
146 models · 818/876 passed1325ms avg
Avg cost / 1k: $2.58
together94% pass
12 models · 79/84 passed3198ms avg
Avg cost / 1k: $1.15