Loading benchmark data…EyesInAI·Loading live benchmark data Loading leaderboard…EyesInAI·Loading leaderboard… Leaderboard
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
Models tested
227
across 11 providers
Tasks completed
1076
of 1536 attempts
Avg cost / 1k runs
$0.914
across passing tasks
Best value
<$0.01
mistral-nemo
Average Latency by Test & Provider
anthropic90% pass
6 models · 38/42 passed3941ms avg
Avg cost / 1k: $2.93
cerebras67% pass
3 models · 14/21 passed697ms avg
Avg cost / 1k: $0.700
deepinfra71% pass
35 models · 174/245 passed5463ms avg
Avg cost / 1k: $0.398
fireworks43% pass
2 models · 6/14 passed1491ms avg
Avg cost / 1k: $0.124
10 models · 49/69 passed4029ms avg
groq86% pass
3 models · 18/21 passed552ms avg
Avg cost / 1k: $0.075
nvidia46% pass
24 models · 66/144 passed5643ms avg
Avg cost / 1k: $0.025
openai100% pass
12 models · 84/84 passed2418ms avg
Avg cost / 1k: $4.71
openrouter79% pass
115 models · 541/686 passed984ms avg
Avg cost / 1k: $0.812
sambanova67% pass
3 models · 14/21 passed1496ms avg
Avg cost / 1k: $0.510
together38% pass
27 models · 72/189 passed3014ms avg
Avg cost / 1k: $0.513