Loading benchmark data…EyesInAI·Loading live benchmark data Loading leaderboard…EyesInAI·Loading leaderboard… Leaderboard
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
Models tested
222
across 18 providers
Tasks completed
1339
of 1556 attempts
Avg cost / 1k runs
$0.643
across passing tasks
Best value
<$0.01
Mistral-Nemo-Instruct-2407
Average Latency by Test & Provider
anthropic89% pass
4 models · 25/28 passed4613ms avg
Avg cost / 1k: $5.29
baseten100% pass
1 models · 7/7 passed1008ms avg
Avg cost / 1k: $0.419
cerebras64% pass
2 models · 9/14 passed2396ms avg
Avg cost / 1k: $1.27
dashscope100% pass
1 models · 18/18 passed1717ms avg
38 models · 226/266 passed7475ms avg
deepseek100% pass
1 models · 18/18 passed172ms avg
fireworks95% pass
3 models · 20/21 passed4063ms avg
Avg cost / 1k: $1.05
gemini87% pass
11 models · 67/77 passed4472ms avg
Avg cost / 1k: $0.448
groq96% pass
4 models · 48/50 passed869ms avg
Avg cost / 1k: $0.069
mistral94% pass
1 models · 17/18 passed2413ms avg
moonshot94% pass
1 models · 17/18 passed7241ms avg
nvidia64% pass
18 models · 69/108 passed4737ms avg
Avg cost / 1k: $0.079
openai100% pass
12 models · 84/84 passed2820ms avg
Avg cost / 1k: $1.14
openrouter88% pass
122 models · 641/732 passed1114ms avg
Avg cost / 1k: $0.760
sambanova100% pass
1 models · 7/7 passed1721ms avg
Avg cost / 1k: $0.834
together84% pass
8 models · 47/56 passed3254ms avg
Avg cost / 1k: $0.399
xai94% pass
1 models · 15/16 passed3947ms avg
zhipu22% pass
1 models · 4/18 passed6150ms avg