Loading benchmark data…EyesInAI·Loading live benchmark data Loading leaderboard…EyesInAI·Loading leaderboard… Leaderboard
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
Models tested
291
across 11 providers
Tasks completed
1736
of 1902 attempts
Avg cost / 1k runs
$1.49
across passing tasks
Best value
<$0.01
mistral-nemo
Average Latency by Test & Provider
anthropic92% pass
12 models · 77/84 passed3282ms avg
Avg cost / 1k: $3.35
deepinfra90% pass
27 models · 171/189 passed4897ms avg
Avg cost / 1k: $0.466
fireworks89% pass
19 models · 116/130 passed3166ms avg
Avg cost / 1k: $0.144
gemini96% pass
20 models · 131/136 passed3506ms avg
Avg cost / 1k: $0.463
2 models · 14/14 passed562ms avg
mistral98% pass
8 models · 55/56 passed2220ms avg
Avg cost / 1k: $0.301
nvidia50% pass
5 models · 15/30 passed7986ms avg
Avg cost / 1k: free
openai93% pass
19 models · 124/133 passed2091ms avg
Avg cost / 1k: $1.19
openrouter91% pass
167 models · 912/997 passed5756ms avg
Avg cost / 1k: $2.11
together89% pass
14 models · 87/98 passed3539ms avg
Avg cost / 1k: $0.949
xai97% pass
5 models · 34/35 passed5149ms avg
Avg cost / 1k: $2.62