Loading benchmark data…
EyesInAI·Loading live benchmark data
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
| Expand row | Test | Status | |||||||
|---|---|---|---|---|---|---|---|---|---|
| openrouter | lfm-2.5-1.2b-thinking:free | 🚀Throughput | ok | free | 885ms | — | 0.00 | 0.00 | |
| openrouter | lfm-2.5-1.2b-thinking:free | ⚡Ping | ok | free | 874ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🚀Throughput | ok | free | 1116ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🧮Reasoning | ok | free | 973ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | ⚡Ping | ok | free | 1074ms | — | 0.00 | 0.00 | |
| nvidia | glm-5.2 | 🔍Context Recall | pass | free | 30185ms | — | 0.00 | 0.00 | |
| nvidia | qwen3.5-122b-a10b | 🔍Context Recall | pass | free | 5102ms | — | 0.00 | 0.00 | |
| nvidia | qwen3.5-122b-a10b | 💻Code Gen | ok | free | 3941ms | — | 0.00 | 0.00 | |
| nvidia | qwen3.5-122b-a10b | { }JSON Output | pass | free | 2210ms | — | 0.00 | 0.00 | |
| nvidia | qwen3.5-122b-a10b | 🧮Reasoning | ok | free | 1565ms | — | 0.00 | 0.00 | |
| nvidia | qwen3.5-122b-a10b | ⚡Ping | ok | free | 1023ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1.5 | 🚀Throughput | ok | free | 18317ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.3-nemotron-super-49b-v1.5 | ⚡Ping | ok | free | 1297ms | — | 0.00 | 0.00 | |
| nvidia | mixtral-8x7b-instruct-v0.1 | 🔍Context Recall | pass | free | 4622ms | — | 0.00 | 0.00 | |
| nvidia | mixtral-8x7b-instruct-v0.1 | 🚀Throughput | ok | free | 18929ms | — | 0.00 | 0.00 | |
| nvidia | mixtral-8x7b-instruct-v0.1 | 💻Code Gen | ok | free | 4366ms | — | 0.00 | 0.00 | |
| nvidia | mixtral-8x7b-instruct-v0.1 | { }JSON Output | pass | free | 1966ms | — | 0.00 | 0.00 | |
| nvidia | mixtral-8x7b-instruct-v0.1 | ⚡Ping | ok | free | 1116ms | — | 0.00 | 0.00 | |
| nvidia | minimax-m2.7 | ⚡Ping | ok | free | 9485ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-70b-instruct | 🔍Context Recall | pass | free | 4666ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-70b-instruct | 🧮Reasoning | ok | free | 4649ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-70b-instruct | ⚡Ping | ok | free | 618ms | — | 0.00 | 0.00 | |
| nvidia | deepseek-v4-flash | 🧮Reasoning | ok | free | 1294ms | — | 0.00 | 0.00 | |
| nvidia | deepseek-v4-flash | ⚡Ping | ok | free | 12520ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | 🔧Tool Use | pass | free | 3231ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | 🔍Context Recall | pass | free | 6131ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | 🧮Reasoning | ok | free | 19758ms | — | 0.00 | 0.00 | |
| gemini | gemma-4-31b-it | ⚡Ping | ok | free | 1913ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 🔍Context Recall | pass | free | 592ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 🚀Throughput | ok | free | 417ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 💻Code Gen | ok | free | 487ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | { }JSON Output | pass | free | 513ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | 🧮Reasoning | ok | free | 417ms | — | 0.00 | 0.00 | |
| openrouter | qwen3-next-80b-a3b-instruct | ⚡Ping | ok | free | 742ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b | 🔍Context Recall | pass | free | 411ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b | 🚀Throughput | ok | free | 298ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b | 💻Code Gen | ok | free | 351ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b | 🧮Reasoning | ok | free | 647ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b | ⚡Ping | ok | free | 532ms | — | 0.00 | 0.00 | |
| openrouter | kimi-k2.6 | 🔍Context Recall | pass | free | 458ms | — | 0.00 | 0.00 | |
| openrouter | kimi-k2.6 | 🚀Throughput | ok | free | 348ms | — | 0.00 | 0.00 | |
| openrouter | kimi-k2.6 | 💻Code Gen | ok | free | 1094ms | — | 0.00 | 0.00 | |
| openrouter | kimi-k2.6 | { }JSON Output | pass | free | 1308ms | — | 0.00 | 0.00 | |
| openrouter | kimi-k2.6 | 🧮Reasoning | ok | free | 639ms | — | 0.00 | 0.00 | |
| openrouter | kimi-k2.6 | ⚡Ping | ok | free | 423ms | — | 0.00 | 0.00 | |
| nvidia | stockmark-2-100b-instruct | 💻Code Gen | ok | free | 10242ms | — | 0.00 | 0.00 | |
| nvidia | stockmark-2-100b-instruct | { }JSON Output | pass | free | 2511ms | — | 0.00 | 0.00 | |
| nvidia | stockmark-2-100b-instruct | 🧮Reasoning | ok | free | 2987ms | — | 0.00 | 0.00 | |
| nvidia | stockmark-2-100b-instruct | ⚡Ping | ok | free | 1001ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-vl-8b-v1 | 🔍Context Recall | pass | free | 5537ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-vl-8b-v1 | 🚀Throughput | ok | free | 13315ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-vl-8b-v1 | 💻Code Gen | ok | free | 3048ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-vl-8b-v1 | { }JSON Output | pass | free | 1397ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-vl-8b-v1 | 🧮Reasoning | ok | free | 1523ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-vl-8b-v1 | ⚡Ping | ok | free | 509ms | — | 0.00 | 0.00 | |
| nvidia | mistral-nemotron | 🔍Context Recall | pass | free | 754ms | — | 0.00 | 0.00 | |
| nvidia | mistral-nemotron | 🚀Throughput | ok | free | 10302ms | — | 0.00 | 0.00 | |
| nvidia | mistral-nemotron | 💻Code Gen | ok | free | 2354ms | — | 0.00 | 0.00 | |
| nvidia | mistral-nemotron | { }JSON Output | pass | free | 1113ms | — | 0.00 | 0.00 | |
| nvidia | mistral-nemotron | 🧮Reasoning | ok | free | 3082ms | — | 0.00 | 0.00 | |
| nvidia | mistral-nemotron | ⚡Ping | ok | free | 475ms | — | 0.00 | 0.00 | |
| nvidia | llama-4-maverick-17b-128e-instruct | 🔍Context Recall | pass | free | 5545ms | — | 0.00 | 0.00 | |
| nvidia | llama-4-maverick-17b-128e-instruct | 🚀Throughput | ok | free | 14456ms | — | 0.00 | 0.00 | |
| nvidia | llama-4-maverick-17b-128e-instruct | 💻Code Gen | ok | free | 5017ms | — | 0.00 | 0.00 | |
| nvidia | llama-4-maverick-17b-128e-instruct | { }JSON Output | pass | free | 11395ms | — | 0.00 | 0.00 | |
| nvidia | llama-4-maverick-17b-128e-instruct | 🧮Reasoning | ok | free | 11434ms | — | 0.00 | 0.00 | |
| nvidia | llama-4-maverick-17b-128e-instruct | ⚡Ping | ok | free | 12787ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 🔍Context Recall | pass | free | 514ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 🚀Throughput | ok | free | 1318ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 💻Code Gen | ok | free | 891ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | { }JSON Output | pass | free | 381ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | 🧮Reasoning | ok | free | 363ms | — | 0.00 | 0.00 | |
| openrouter | glm-5.2 | ⚡Ping | ok | free | 1544ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | 🚀Throughput | ok | free | 1692ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | 💻Code Gen | ok | free | 1107ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | { }JSON Output | pass | free | 971ms | — | 0.00 | 0.00 | |
| openrouter | qwen3.5-397b-a17b | ⚡Ping | ok | free | 994ms | — | 0.00 | 0.00 | |
| openrouter | laguna-m.1:free | 🚀Throughput | ok | free | 578ms | — | 0.00 | 0.00 | |
| openrouter | laguna-m.1:free | ⚡Ping | ok | free | 472ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 🚀Throughput | ok | free | 2096ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 💻Code Gen | ok | free | 1973ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | 🧮Reasoning | ok | free | 757ms | — | 0.00 | 0.00 | |
| openrouter | gpt-oss-20b:free | ⚡Ping | ok | free | 3538ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-nano-9b-v2:free | 🚀Throughput | ok | free | 1140ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-nano-9b-v2:free | ⚡Ping | ok | free | 903ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | 🔍Context Recall | pass | free | 332ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | 🚀Throughput | ok | free | 350ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | 💻Code Gen | ok | free | 337ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | 🧮Reasoning | ok | free | 345ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | ⚡Ping | ok | free | 352ms | — | 0.00 | 0.00 | |
| nvidia | step-3.7-flash | 🚀Throughput | ok | free | 2904ms | — | 0.00 | 0.00 | |
| nvidia | step-3.7-flash | 🧮Reasoning | ok | free | 1220ms | — | 0.00 | 0.00 | |
| nvidia | step-3.7-flash | ⚡Ping | ok | free | 495ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 🔍Context Recall | pass | free | 1080ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 💻Code Gen | ok | free | 2118ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 🧮Reasoning | ok | free | 1093ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | ⚡Ping | ok | free | 649ms | — | 0.00 | 0.00 | |
| nvidia | llama-3.1-nemotron-nano-8b-v1 | 🧮Reasoning | ok | free | 3640ms | — | 0.00 | 0.00 | |
| nvidia | mistral-medium-3.5-128b | 🔍Context Recall | pass | free | 792ms | — | 0.00 | 0.00 | |
| nvidia | mistral-medium-3.5-128b | 🚀Throughput | ok | free | 12018ms | — | 0.00 | 0.00 | |
| nvidia | mistral-medium-3.5-128b | 💻Code Gen | ok | free | 2136ms | — | 0.00 | 0.00 | |
| nvidia | mistral-medium-3.5-128b | 🧮Reasoning | ok | free | 15070ms | — | 0.00 | 0.00 | |
| nvidia | mistral-medium-3.5-128b | ⚡Ping | ok | free | 541ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | 🔍Context Recall | pass | free | 8821ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | { }JSON Output | pass | free | 7253ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | 🧮Reasoning | ok | free | 4333ms | — | 0.00 | 0.00 | |
| nvidia | dracarys-llama-3.1-70b-instruct | ⚡Ping | ok | free | 3845ms | — | 0.00 | 0.00 | |
| together | Qwen3-235B-A22B-Instruct-2507-FP8 | 🔧Tool Use | pass | free | 1144ms | — | 0.00 | 0.00 | |
| together | Qwen3-235B-A22B-Instruct-2507-FP8 | 🔍Context Recall | pass | free | 2098ms | — | 0.00 | 0.00 | |
| together | Qwen3-235B-A22B-Instruct-2507-FP8 | 🚀Throughput | ok | free | 12195ms | — | 0.00 | 0.00 | |
| together | Qwen3-235B-A22B-Instruct-2507-FP8 | 💻Code Gen | ok | free | 12575ms | — | 0.00 | 0.00 | |
| together | Qwen3-235B-A22B-Instruct-2507-FP8 | { }JSON Output | pass | free | 1231ms | — | 0.00 | 0.00 | |
| together | Qwen3-235B-A22B-Instruct-2507-FP8 | ⚡Ping | ok | free | 1303ms | — | 0.00 | 0.00 | |
| openrouter | mistral-nemo | ⚡Ping | ok | <$0.01 | 418ms | — | 0.02 | 0.03 | |
| openrouter | ling-2.6-flash | ⚡Ping | ok | <$0.01 | 714ms | — | 0.01 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 809ms | — | 0.02 | 0.03 | |
| openrouter | llama-3.1-8b-instruct | ⚡Ping | ok | <$0.01 | 782ms | — | 0.02 | 0.03 | |
| openrouter | nova-micro-v1 | ⚡Ping | ok | <$0.01 | 1057ms | — | 0.04 | 0.14 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct | ⚡Ping | ok | <$0.01 | 2199ms | — | 0.03 | 0.05 | |
| openrouter | lfm-2-24b-a2b | ⚡Ping | ok | <$0.01 | 561ms | — | 0.03 | 0.12 | |
| openrouter | l3-lunaris-8b | ⚡Ping | ok | <$0.01 | 358ms | — | 0.04 | 0.05 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | ⚡Ping | ok | <$0.01 | 448ms | — | 0.05 | 0.19 | |
| openrouter | mistral-nemo | 🧮Reasoning | ok | <$0.01 | 2202ms | — | 0.02 | 0.03 | |
| openrouter | granite-4.1-8b | ⚡Ping | ok | <$0.01 | 337ms | — | 0.05 | 0.10 | |
| openrouter | gemma-3-12b-it | ⚡Ping | ok | <$0.01 | 379ms | — | 0.05 | 0.15 | |
| openrouter | phi-4 | ⚡Ping | ok | <$0.01 | 352ms | — | 0.07 | 0.14 | |
| deepinfra | phi-4 | ⚡Ping | ok | <$0.01 | 1401ms | — | 0.07 | 0.14 | |
| openrouter | qwen3-coder-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 1425ms | — | 0.07 | 0.27 | |
| openrouter | mistral-small-3.2-24b-instruct | ⚡Ping | ok | <$0.01 | 593ms | — | 0.07 | 0.20 | |
| deepinfra | DeepSeek-V4-Flash | ⚡Ping | ok | <$0.01 | 1329ms | — | 0.09 | 0.18 | |
| openrouter | qwen3-235b-a22b-2507 | ⚡Ping | ok | <$0.01 | 2676ms | — | 0.09 | 0.10 | |
| openrouter | laguna-xs-2.1 | ⚡Ping | ok | <$0.01 | 367ms | — | 0.06 | 0.12 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | ⚡Ping | ok | <$0.01 | 892ms | — | 0.09 | 0.10 | |
| openrouter | qwen-2.5-7b-instruct | ⚡Ping | ok | <$0.01 | 1342ms | — | 0.04 | 0.10 | |
| openrouter | ling-2.6-flash | { }JSON Output | pass | <$0.01 | 700ms | — | 0.01 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🧮Reasoning | ok | <$0.01 | 1308ms | — | 0.02 | 0.03 | |
| openai | gpt-4.1-nano-2025-04-14 | ⚡Ping | ok | <$0.01 | 829ms | — | 0.10 | 0.40 | |
| openrouter | llama-3.1-8b-instruct | 🧮Reasoning | ok | <$0.01 | 372ms | — | 0.02 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | { }JSON Output | pass | <$0.01 | 1048ms | — | 0.02 | 0.03 | |
| openrouter | gemma-4-26b-a4b-it | ⚡Ping | ok | <$0.01 | 433ms | — | 0.06 | 0.33 | |
| openrouter | voxtral-small-24b-2507 | ⚡Ping | ok | <$0.01 | 530ms | — | 0.10 | 0.30 | |
| openrouter | ministral-8b-2512 | ⚡Ping | ok | <$0.01 | 822ms | — | 0.15 | 0.15 | |
| openrouter | l3-lunaris-8b | 🧮Reasoning | ok | <$0.01 | 357ms | — | 0.04 | 0.05 | |
| openrouter | llama-3.1-8b-instruct | { }JSON Output | pass | <$0.01 | 405ms | — | 0.02 | 0.03 | |
| openrouter | command-r-08-2024 | ⚡Ping | ok | <$0.01 | 818ms | — | 0.15 | 0.60 | |
| groq | llama-3.1-8b-instant | ⚡Ping | ok | <$0.01 | 243ms | — | 0.05 | 0.08 | |
| openrouter | mistral-nemo | { }JSON Output | pass | <$0.01 | 967ms | — | 0.02 | 0.03 | |
| openrouter | ling-2.6-flash | 🧮Reasoning | ok | <$0.01 | 871ms | — | 0.01 | 0.03 | |
| openrouter | qwen3-vl-32b-instruct | ⚡Ping | ok | <$0.01 | 338ms | — | 0.10 | 0.42 | |
| openrouter | ministral-14b-2512 | ⚡Ping | ok | <$0.01 | 474ms | — | 0.20 | 0.20 | |
| openrouter | llama-4-scout | ⚡Ping | ok | <$0.01 | 280ms | — | 0.10 | 0.30 | |
| together | Meta-Llama-3-8B-Instruct-Lite | ⚡Ping | ok | <$0.01 | 3938ms | — | 0.14 | 0.14 | |
| openai | gpt-4o-mini | ⚡Ping | ok | <$0.01 | 746ms | — | 0.15 | 0.60 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct | 🧮Reasoning | ok | <$0.01 | 5787ms | — | 0.03 | 0.05 | |
| openrouter | ling-2.6-flash | 🔍Context Recall | pass | <$0.01 | 828ms | — | 0.01 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct | { }JSON Output | pass | <$0.01 | 3598ms | — | 0.03 | 0.05 | |
| openrouter | qwen3-vl-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 711ms | — | 0.13 | 0.52 | |
| openrouter | llama-3.2-3b-instruct | ⚡Ping | ok | <$0.01 | 517ms | — | 0.05 | 0.33 | |
| deepinfra | gemma-4-31B-it-turbo | ⚡Ping | ok | <$0.01 | 1060ms | — | 0.12 | 0.37 | |
| openrouter | hunyuan-a13b-instruct | ⚡Ping | ok | <$0.01 | 1269ms | — | 0.14 | 0.57 | |
| openrouter | qwen3-coder-next | ⚡Ping | ok | <$0.01 | 899ms | — | 0.11 | 0.80 | |
| deepinfra | gemma-4-31B-it | ⚡Ping | ok | <$0.01 | 791ms | — | 0.13 | 0.38 | |
| openrouter | mistral-nemo | 💻Code Gen | ok | <$0.01 | 1296ms | — | 0.02 | 0.03 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | ⚡Ping | ok | <$0.01 | 927ms | — | 0.09 | 1.10 | |
| deepinfra | DeepSeek-V3.2 | ⚡Ping | ok | <$0.01 | 1615ms | — | 0.26 | 0.38 | |
| openrouter | llama-4-maverick | ⚡Ping | ok | <$0.01 | 341ms | — | 0.15 | 0.60 | |
| openrouter | l3-lunaris-8b | { }JSON Output | pass | <$0.01 | 499ms | — | 0.04 | 0.05 | |
| openrouter | deepseek-v4-flash | ⚡Ping | ok | <$0.01 | 1363ms | — | 0.09 | 0.18 | |
| openrouter | deepseek-chat-v3.1 | ⚡Ping | ok | <$0.01 | 1960ms | — | 0.21 | 0.79 | |
| together | Qwen3.5-9B | ⚡Ping | ok | <$0.01 | 896ms | — | 0.10 | 0.15 | |
| openrouter | qwen3.5-9b | ⚡Ping | ok | <$0.01 | 1642ms | — | 0.10 | 0.15 | |
| deepinfra | Qwen3.5-9B | ⚡Ping | ok | <$0.01 | 4096ms | — | 0.10 | 0.15 | |
| openrouter | llama-3.1-8b-instruct | 💻Code Gen | ok | <$0.01 | 391ms | — | 0.02 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 💻Code Gen | ok | <$0.01 | 2876ms | — | 0.02 | 0.03 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | ⚡Ping | ok | <$0.01 | 1413ms | — | 0.20 | 0.60 | |
| openrouter | ling-2.6-flash | 💻Code Gen | ok | <$0.01 | 695ms | — | 0.01 | 0.03 | |
| nvidia | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 593ms | — | 0.03 | 0.14 | |
| together | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 715ms | — | 0.03 | 0.14 | |
| openrouter | reka-flash-3 | ⚡Ping | ok | <$0.01 | 1019ms | — | 0.10 | 0.20 | |
| openrouter | qwen-plus | ⚡Ping | ok | <$0.01 | 1012ms | — | 0.26 | 0.78 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | ⚡Ping | ok | <$0.01 | 913ms | — | 0.20 | 0.88 | |
| openrouter | mistral-nemo | 🔍Context Recall | pass | <$0.01 | 4311ms | — | 0.02 | 0.03 | |
| openrouter | nova-micro-v1 | { }JSON Output | pass | <$0.01 | 655ms | — | 0.04 | 0.14 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🔍Context Recall | pass | <$0.01 | 1181ms | — | 0.02 | 0.03 | |
| deepinfra | gpt-oss-120b | ⚡Ping | ok | <$0.01 | 2045ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-coder | ⚡Ping | ok | <$0.01 | 2218ms | — | 0.22 | 1.80 | |
| openrouter | lfm-2-24b-a2b | 🧮Reasoning | ok | <$0.01 | 452ms | — | 0.03 | 0.12 | |
| openrouter | mistral-small-3.1-24b-instruct | ⚡Ping | ok | <$0.01 | 363ms | — | 0.35 | 0.56 | |
| openrouter | hermes-4-70b | ⚡Ping | ok | <$0.01 | 418ms | — | 0.13 | 0.40 | |
| openrouter | llama-3.1-8b-instruct | 🔍Context Recall | pass | <$0.01 | 382ms | — | 0.02 | 0.03 | |
| openrouter | lfm-2-24b-a2b | { }JSON Output | pass | <$0.01 | 389ms | — | 0.03 | 0.12 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🔧Tool Use | pass | <$0.01 | 1107ms | — | 0.02 | 0.03 | |
| together | gpt-oss-120b | ⚡Ping | ok | <$0.01 | 716ms | — | 0.04 | 0.17 | |
| groq | llama-3.1-8b-instant | 🧮Reasoning | ok | <$0.01 | 331ms | — | 0.05 | 0.08 | |
| deepinfra | Qwen3-14B | ⚡Ping | ok | <$0.01 | 973ms | — | 0.12 | 0.24 | |
| openrouter | qwen-2.5-7b-instruct | { }JSON Output | pass | <$0.01 | 566ms | — | 0.04 | 0.10 | |
| groq | gpt-oss-120b | ⚡Ping | ok | <$0.01 | 627ms | — | 0.04 | 0.17 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct | 💻Code Gen | ok | <$0.01 | 19786ms | — | 0.03 | 0.05 | |
| openrouter | l3-lunaris-8b | 💻Code Gen | ok | <$0.01 | 415ms | — | 0.04 | 0.05 | |
| openrouter | granite-4.1-8b | { }JSON Output | pass | <$0.01 | 429ms | — | 0.05 | 0.10 | |
| deepinfra | Llama-3.2-11B-Vision-Instruct | ⚡Ping | ok | <$0.01 | 803ms | — | 0.34 | 0.34 | |
| groq | llama-3.1-8b-instant | { }JSON Output | pass | <$0.01 | 252ms | — | 0.05 | 0.08 | |
| openrouter | qwen-2.5-7b-instruct | 🧮Reasoning | ok | <$0.01 | 572ms | — | 0.04 | 0.10 | |
| openrouter | unslopnemo-12b | ⚡Ping | ok | <$0.01 | 595ms | — | 0.40 | 0.40 | |
| openrouter | llama-3.2-11b-vision-instruct | ⚡Ping | ok | <$0.01 | 375ms | — | 0.34 | 0.34 | |
| openrouter | kat-coder-pro-v2 | ⚡Ping | ok | <$0.01 | 1143ms | — | 0.30 | 1.20 | |
| deepinfra | GLM-4.7-Flash | ⚡Ping | ok | <$0.01 | 2658ms | — | 0.06 | 0.40 | |
| openai | gpt-4.1-mini-2025-04-14 | ⚡Ping | ok | <$0.01 | 657ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | ⚡Ping | ok | <$0.01 | 641ms | — | 0.40 | 1.60 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct | 🔍Context Recall | pass | <$0.01 | 4452ms | — | 0.03 | 0.05 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | { }JSON Output | pass | <$0.01 | 1737ms | — | 0.09 | 0.10 | |
| openrouter | mistral-medium-3 | ⚡Ping | ok | <$0.01 | 614ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | ⚡Ping | ok | <$0.01 | 580ms | — | 0.40 | 2.00 | |
| openrouter | lfm-2-24b-a2b | 🔍Context Recall | pass | <$0.01 | 652ms | — | 0.03 | 0.12 | |
| openrouter | granite-4.1-8b | 🧮Reasoning | ok | <$0.01 | 376ms | — | 0.05 | 0.10 | |
| openrouter | qwen3-235b-a22b-2507 | { }JSON Output | pass | <$0.01 | 637ms | — | 0.09 | 0.10 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | { }JSON Output | pass | <$0.01 | 269ms | — | 0.05 | 0.19 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct | 🔧Tool Use | pass | <$0.01 | 9573ms | — | 0.03 | 0.05 | |
| together | gemma-4-31B-it | ⚡Ping | ok | <$0.01 | 520ms | — | 0.13 | 0.38 | |
| openrouter | laguna-xs.2 | ⚡Ping | ok | <$0.01 | 511ms | — | 0.10 | 0.20 | |
| openrouter | l3-lunaris-8b | 🔍Context Recall | pass | <$0.01 | 374ms | — | 0.04 | 0.05 | |
| openrouter | deepseek-v4-flash | { }JSON Output | pass | <$0.01 | 969ms | — | 0.09 | 0.18 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🧮Reasoning | ok | <$0.01 | 406ms | — | 0.05 | 0.19 | |
| openrouter | qwen3-235b-a22b-2507 | 🧮Reasoning | ok | <$0.01 | 1120ms | — | 0.09 | 0.10 | |
| deepinfra | DeepSeek-V4-Flash | { }JSON Output | pass | <$0.01 | 2081ms | — | 0.09 | 0.18 | |
| openrouter | perceptron-mk1 | ⚡Ping | ok | <$0.01 | 866ms | — | 0.15 | 1.50 | |
| together | Meta-Llama-3-8B-Instruct-Lite | 🧮Reasoning | ok | <$0.01 | 2346ms | — | 0.14 | 0.14 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 🧮Reasoning | ok | <$0.01 | 6341ms | — | 0.09 | 0.10 | |
| openrouter | phi-4 | { }JSON Output | pass | <$0.01 | 439ms | — | 0.07 | 0.14 | |
| deepinfra | phi-4 | { }JSON Output | pass | <$0.01 | 1602ms | — | 0.07 | 0.14 | |
| openrouter | gemma-3-12b-it | 🧮Reasoning | ok | <$0.01 | 389ms | — | 0.05 | 0.15 | |
| openrouter | gemma-3-12b-it | { }JSON Output | pass | <$0.01 | 357ms | — | 0.05 | 0.15 | |
| openrouter | sonar | ⚡Ping | ok | $0.010 | 1250ms | — | 1.00 | 1.00 | |
| deepinfra | phi-4 | 🧮Reasoning | ok | $0.010 | 1377ms | — | 0.07 | 0.14 | |
| openrouter | ministral-8b-2512 | 🧮Reasoning | ok | $0.010 | 574ms | — | 0.15 | 0.15 | |
| deepinfra | DeepSeek-V4-Flash | 🧮Reasoning | ok | $0.010 | 2373ms | — | 0.09 | 0.18 | |
| openrouter | phi-4 | 🧮Reasoning | ok | $0.011 | 385ms | — | 0.07 | 0.14 | |
| openrouter | gpt-oss-safeguard-20b | ⚡Ping | ok | $0.011 | 376ms | — | 0.07 | 0.30 | |
| deepinfra | MythoMax-L2-13b | ⚡Ping | ok | $0.011 | 979ms | — | 0.40 | 0.40 | |
| openrouter | ling-2.6-flash | 🚀Throughput | ok | $0.011 | 665ms | — | 0.01 | 0.03 | |
| groq | llama-3.1-8b-instant | 💻Code Gen | ok | $0.011 | 334ms | — | 0.05 | 0.08 | |
| openrouter | qwen-2.5-7b-instruct | 🔍Context Recall | pass | $0.012 | 1132ms | — | 0.04 | 0.10 | |
| nvidia | gpt-oss-20b | 🔍Context Recall | pass | $0.012 | 881ms | — | 0.03 | 0.14 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🔍Context Recall | pass | $0.012 | 483ms | — | 0.05 | 0.19 | |
| openrouter | mistral-small-3.2-24b-instruct | { }JSON Output | pass | $0.012 | 378ms | — | 0.07 | 0.20 | |
| openrouter | granite-4.1-8b | 💻Code Gen | ok | $0.013 | 327ms | — | 0.05 | 0.10 | |
| together | Meta-Llama-3-8B-Instruct-Lite | { }JSON Output | pass | $0.013 | 1638ms | — | 0.14 | 0.14 | |
| openrouter | nova-micro-v1 | 🧮Reasoning | ok | $0.013 | 1014ms | — | 0.04 | 0.14 | |
| openrouter | l3.3-euryale-70b | ⚡Ping | ok | $0.013 | 2947ms | — | 0.65 | 0.75 | |
| openai | gpt-4.1-nano-2025-04-14 | 🔧Tool Use | pass | $0.013 | 1186ms | — | 0.10 | 0.40 | |
| openrouter | qwen3-coder-30b-a3b-instruct | { }JSON Output | pass | $0.014 | 1725ms | — | 0.07 | 0.27 | |
| openrouter | gemma-4-26b-a4b-it | { }JSON Output | pass | $0.014 | 642ms | — | 0.06 | 0.33 | |
| groq | llama-3.1-8b-instant | 🔧Tool Use | pass | $0.014 | 260ms | — | 0.05 | 0.08 | |
| openrouter | qwen-2.5-7b-instruct | 💻Code Gen | ok | $0.014 | 554ms | — | 0.04 | 0.10 | |
| openrouter | granite-4.1-8b | 🔍Context Recall | pass | $0.014 | 380ms | — | 0.05 | 0.10 | |
| groq | llama-3.1-8b-instant | 🔍Context Recall | pass | $0.014 | 265ms | — | 0.05 | 0.08 | |
| openrouter | llama-4-scout | 🧮Reasoning | ok | $0.014 | 259ms | — | 0.10 | 0.30 | |
| openrouter | ministral-8b-2512 | { }JSON Output | pass | $0.015 | 490ms | — | 0.15 | 0.15 | |
| groq | gpt-oss-120b | 🔧Tool Use | pass | $0.015 | 401ms | — | 0.04 | 0.17 | |
| openrouter | lfm-2-24b-a2b | 💻Code Gen | ok | $0.015 | 493ms | — | 0.03 | 0.12 | |
| openrouter | llama-4-scout | { }JSON Output | pass | $0.015 | 381ms | — | 0.10 | 0.30 | |
| openrouter | qwen3-vl-32b-instruct | { }JSON Output | pass | $0.015 | 305ms | — | 0.10 | 0.42 | |
| openrouter | qwen3-max-thinking | ⚡Ping | ok | $0.016 | 1535ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | ⚡Ping | ok | $0.016 | 1728ms | — | 0.78 | 3.90 | |
| deepinfra | gpt-oss-120b | 🔧Tool Use | pass | $0.016 | 2096ms | — | 0.04 | 0.17 | |
| openrouter | mistral-nemo | 🚀Throughput | ok | $0.016 | 5418ms | — | 0.02 | 0.03 | |
| openrouter | rocinante-12b | ⚡Ping | ok | $0.016 | 906ms | — | 0.25 | 0.50 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🚀Throughput | ok | $0.016 | 7239ms | — | 0.02 | 0.03 | |
| openrouter | llama-3.1-8b-instruct | 🚀Throughput | ok | $0.016 | 792ms | — | 0.02 | 0.03 | |
| openrouter | llama-3.2-3b-instruct | { }JSON Output | pass | $0.016 | 616ms | — | 0.05 | 0.33 | |
| openrouter | minimax-m2.5 | ⚡Ping | ok | $0.016 | 939ms | — | 0.12 | 0.48 | |
| openrouter | ministral-14b-2512 | 🧮Reasoning | ok | $0.016 | 850ms | — | 0.20 | 0.20 | |
| openrouter | mistral-small-3.2-24b-instruct | 🧮Reasoning | ok | $0.017 | 803ms | — | 0.07 | 0.20 | |
| nvidia | gpt-oss-20b | 🧮Reasoning | ok | $0.017 | 8832ms | — | 0.03 | 0.14 | |
| openrouter | seed-2.0-mini | ⚡Ping | ok | $0.017 | 338ms | — | 0.10 | 0.40 | |
| openrouter | voxtral-small-24b-2507 | { }JSON Output | pass | $0.017 | 489ms | — | 0.10 | 0.30 | |
| deepinfra | Llama-3.3-Nemotron-Super-49B-v1.5 | ⚡Ping | ok | $0.017 | 1066ms | — | 0.40 | 0.40 | |
| openrouter | deepseek-v4-flash | 🧮Reasoning | ok | $0.017 | 993ms | — | 0.09 | 0.18 | |
| openrouter | gemma-4-26b-a4b-it | 🧮Reasoning | ok | $0.017 | 392ms | — | 0.06 | 0.33 | |
| openrouter | gemma-4-26b-a4b-it | 🔍Context Recall | pass | $0.017 | 482ms | — | 0.06 | 0.33 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🧮Reasoning | ok | $0.018 | 1432ms | — | 0.07 | 0.27 | |
| deepinfra | phi-4 | 🔍Context Recall | pass | $0.018 | 1109ms | — | 0.07 | 0.14 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 💻Code Gen | ok | $0.018 | 16157ms | — | 0.09 | 0.10 | |
| deepinfra | gemma-4-31B-it-turbo | 🔧Tool Use | pass | $0.018 | 1393ms | — | 0.12 | 0.37 | |
| openrouter | nova-micro-v1 | 💻Code Gen | ok | $0.018 | 861ms | — | 0.04 | 0.14 | |
| openrouter | phi-4 | 🔍Context Recall | pass | $0.018 | 541ms | — | 0.07 | 0.14 | |
| openrouter | glm-4.6v | ⚡Ping | ok | $0.018 | 1166ms | — | 0.30 | 0.90 | |
| openrouter | qwen3.6-35b-a3b | ⚡Ping | ok | $0.018 | 571ms | — | 0.14 | 1.00 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 🔧Tool Use | pass | $0.019 | 1740ms | — | 0.09 | 0.10 | |
| openrouter | gemma-3-12b-it | 🔍Context Recall | pass | $0.019 | 354ms | — | 0.05 | 0.15 | |
| openrouter | deepseek-v4-pro | ⚡Ping | ok | $0.019 | 1526ms | — | 0.43 | 0.87 | |
| deepinfra | gpt-oss-120b-Turbo | ⚡Ping | ok | $0.019 | 833ms | — | 0.15 | 0.60 | |
| gemini | gemini-2.5-pro | ⚡Ping | ok | $0.019 | 2560ms | — | 1.25 | 10.00 | |
| deepinfra | gemma-4-31B-it-turbo | { }JSON Output | pass | $0.019 | 2629ms | — | 0.12 | 0.37 | |
| deepinfra | gemma-4-31B-it | 🔧Tool Use | pass | $0.019 | 1222ms | — | 0.13 | 0.38 | |
| openrouter | voxtral-small-24b-2507 | 🧮Reasoning | ok | $0.020 | 512ms | — | 0.10 | 0.30 | |
| openrouter | ministral-14b-2512 | { }JSON Output | pass | $0.020 | 475ms | — | 0.20 | 0.20 | |
| deepinfra | gpt-oss-120b | 🧮Reasoning | ok | $0.020 | 3443ms | — | 0.04 | 0.17 | |
| openai | gpt-4.1-nano-2025-04-14 | { }JSON Output | pass | $0.020 | 877ms | — | 0.10 | 0.40 | |
| deepinfra | gemma-4-31B-it-turbo | 🧮Reasoning | ok | $0.020 | 6120ms | — | 0.12 | 0.37 | |
| openrouter | phi-4 | 💻Code Gen | ok | $0.020 | 357ms | — | 0.07 | 0.14 | |
| deepinfra | gemma-4-31B-it | { }JSON Output | pass | $0.020 | 2176ms | — | 0.13 | 0.38 | |
| deepinfra | phi-4 | 💻Code Gen | ok | $0.020 | 2153ms | — | 0.07 | 0.14 | |
| openrouter | nova-micro-v1 | 🔍Context Recall | pass | $0.020 | 1193ms | — | 0.04 | 0.14 | |
| openai | gpt-4o-mini | 🔧Tool Use | pass | $0.020 | 1007ms | — | 0.15 | 0.60 | |
| openrouter | rocinante-12b | 🧮Reasoning | ok | $0.021 | 5951ms | — | 0.25 | 0.50 | |
| together | gpt-oss-120b | 🧮Reasoning | ok | $0.021 | 877ms | — | 0.04 | 0.17 | |
| openrouter | deepseek-r1-distill-llama-70b | ⚡Ping | ok | $0.021 | 861ms | — | 0.80 | 0.80 | |
| openrouter | aion-rp-llama-3.1-8b | ⚡Ping | ok | $0.021 | 1590ms | — | 0.80 | 1.60 | |
| openrouter | relace-search | ⚡Ping | ok | $0.021 | 2387ms | — | 1.00 | 3.00 | |
| together | gpt-oss-20b | 🔍Context Recall | pass | $0.021 | 1743ms | — | 0.03 | 0.14 | |
| openai | gpt-4.1-nano-2025-04-14 | 🧮Reasoning | ok | $0.021 | 1412ms | — | 0.10 | 0.40 | |
| fireworks | gpt-oss-120b | ⚡Ping | ok | $0.021 | 858ms | — | 0.15 | 0.60 | |
| openrouter | hermes-3-llama-3.1-70b | ⚡Ping | ok | $0.022 | 369ms | — | 0.70 | 0.70 | |
| openrouter | llama-3.2-11b-vision-instruct | 🧮Reasoning | ok | $0.022 | 379ms | — | 0.34 | 0.34 | |
| together | gpt-oss-120b | 🔍Context Recall | pass | $0.022 | 954ms | — | 0.04 | 0.17 | |
| deepinfra | Qwen3-235B-A22B-Instruct-2507 | 🔍Context Recall | pass | $0.022 | 3153ms | — | 0.09 | 0.10 | |
| openrouter | qwen3-235b-a22b-2507 | 🔍Context Recall | pass | $0.022 | 828ms | — | 0.09 | 0.10 | |
| deepinfra | gemma-4-31B-it | 🧮Reasoning | ok | $0.022 | 1673ms | — | 0.13 | 0.38 | |
| openrouter | ministral-8b-2512 | 💻Code Gen | ok | $0.022 | 475ms | — | 0.15 | 0.15 | |
| openrouter | step-3.7-flash | ⚡Ping | ok | $0.022 | 6878ms | — | 0.20 | 1.15 | |
| openai | gpt-4o-mini | 🧮Reasoning | ok | $0.023 | 794ms | — | 0.15 | 0.60 | |
| nvidia | gpt-oss-20b | { }JSON Output | pass | $0.023 | 4343ms | — | 0.03 | 0.14 | |
| openrouter | qwen3-235b-a22b-2507 | 💻Code Gen | ok | $0.023 | 510ms | — | 0.09 | 0.10 | |
| openrouter | qwen3-vl-30b-a3b-instruct | { }JSON Output | pass | $0.023 | 1462ms | — | 0.13 | 0.52 | |
| openai | gpt-4.1-nano-2025-04-14 | 🔍Context Recall | pass | $0.024 | 731ms | — | 0.10 | 0.40 | |
| openrouter | mistral-small-3.2-24b-instruct | 💻Code Gen | ok | $0.024 | 652ms | — | 0.07 | 0.20 | |
| deepinfra | DeepSeek-V4-Flash | 💻Code Gen | ok | $0.024 | 7797ms | — | 0.09 | 0.18 | |
| deepinfra | Qwen3-Max-Thinking | ⚡Ping | ok | $0.024 | 2401ms | — | 1.20 | 6.00 | |
| openrouter | hermes-4-70b | { }JSON Output | pass | $0.024 | 598ms | — | 0.13 | 0.40 | |
| deepinfra | Llama-3.2-11B-Vision-Instruct | 🧮Reasoning | ok | $0.025 | 1645ms | — | 0.34 | 0.34 | |
| deepinfra | MiniMax-M2.5 | ⚡Ping | ok | $0.025 | 1206ms | — | 0.15 | 1.15 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | { }JSON Output | pass | $0.025 | 664ms | — | 0.20 | 0.60 | |
| openrouter | mistral-small-3.2-24b-instruct | 🔍Context Recall | pass | $0.025 | 737ms | — | 0.07 | 0.20 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🔍Context Recall | pass | $0.025 | 1402ms | — | 0.07 | 0.27 | |
| openrouter | llama-4-maverick | 🧮Reasoning | ok | $0.025 | 779ms | — | 0.15 | 0.60 | |
| together | gpt-oss-20b | 🔧Tool Use | pass | $0.025 | 1875ms | — | 0.03 | 0.14 | |
| openrouter | llama-3.2-3b-instruct | 🔍Context Recall | pass | $0.025 | 502ms | — | 0.05 | 0.33 | |
| cerebras | gpt-oss-120b | ⚡Ping | ok | $0.026 | 463ms | — | 0.14 | 0.95 | |
| openrouter | gemma-3-12b-it | 💻Code Gen | ok | $0.026 | 383ms | — | 0.05 | 0.15 | |
| deepinfra | DeepSeek-V4-Flash | 🔍Context Recall | pass | $0.026 | 2240ms | — | 0.09 | 0.18 | |
| openrouter | deepseek-v4-flash | 🔍Context Recall | pass | $0.026 | 1386ms | — | 0.09 | 0.18 | |
| together | Meta-Llama-3-8B-Instruct-Lite | 💻Code Gen | ok | $0.026 | 3858ms | — | 0.14 | 0.14 | |
| openrouter | qwen-2.5-coder-32b-instruct | ⚡Ping | ok | $0.026 | 854ms | — | 0.66 | 1.00 | |
| deepinfra | DeepSeek-V4-Pro | ⚡Ping | ok | $0.026 | 1116ms | — | 1.74 | 3.48 | |
| deepinfra | DeepSeek-V3.2 | { }JSON Output | pass | $0.026 | 4779ms | — | 0.26 | 0.38 | |
| openrouter | qwen3-vl-32b-instruct | 🧮Reasoning | ok | $0.026 | 384ms | — | 0.10 | 0.42 | |
| groq | llama-3.3-70b-versatile | ⚡Ping | ok | $0.026 | 345ms | — | 0.59 | 0.79 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | ⚡Ping | ok | $0.026 | 909ms | — | 0.60 | 1.20 | |
| openrouter | l3-lunaris-8b | 🚀Throughput | ok | $0.027 | 490ms | — | 0.04 | 0.05 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🧮Reasoning | ok | $0.027 | 698ms | — | 0.13 | 0.52 | |
| deepinfra | gpt-oss-120b | { }JSON Output | pass | $0.027 | 3765ms | — | 0.04 | 0.17 | |
| openrouter | llama-4-maverick | { }JSON Output | pass | $0.027 | 1801ms | — | 0.15 | 0.60 | |
| deepinfra | MiniMax-M2.7 | ⚡Ping | ok | $0.027 | 1427ms | — | 0.25 | 1.00 | |
| together | MiniMax-M2.7 | ⚡Ping | ok | $0.027 | 560ms | — | 0.25 | 1.00 | |
| openrouter | seed-1.6-flash | ⚡Ping | ok | $0.027 | 352ms | — | 0.07 | 0.30 | |
| deepinfra | DeepSeek-V3.2 | 🧮Reasoning | ok | $0.028 | 4428ms | — | 0.26 | 0.38 | |
| together | gpt-oss-120b | { }JSON Output | pass | $0.028 | 1003ms | — | 0.04 | 0.17 | |
| openrouter | minimax-m2 | ⚡Ping | ok | $0.028 | 1846ms | — | 0.26 | 1.02 | |
| openrouter | llama-3.2-11b-vision-instruct | { }JSON Output | pass | $0.029 | 365ms | — | 0.34 | 0.34 | |
| nvidia | gpt-oss-20b | 💻Code Gen | ok | $0.029 | 16141ms | — | 0.03 | 0.14 | |
| openrouter | deepseek-chat-v3.1 | 🧮Reasoning | ok | $0.029 | 4430ms | — | 0.21 | 0.79 | |
| openai | gpt-4o-mini | { }JSON Output | pass | $0.030 | 2430ms | — | 0.15 | 0.60 | |
| openrouter | voxtral-small-24b-2507 | 🔍Context Recall | pass | $0.030 | 467ms | — | 0.10 | 0.30 | |
| openrouter | command-r-08-2024 | { }JSON Output | pass | $0.030 | 787ms | — | 0.15 | 0.60 | |
| openrouter | command-r-08-2024 | 🧮Reasoning | ok | $0.031 | 759ms | — | 0.15 | 0.60 | |
| deepinfra | Llama-3.2-11B-Vision-Instruct | { }JSON Output | pass | $0.031 | 1484ms | — | 0.34 | 0.34 | |
| deepinfra | gemma-4-31B-it-turbo | 🔍Context Recall | pass | $0.031 | 9505ms | — | 0.12 | 0.37 | |
| openrouter | hunyuan-a13b-instruct | { }JSON Output | pass | $0.031 | 1786ms | — | 0.14 | 0.57 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 💻Code Gen | ok | $0.031 | 456ms | — | 0.05 | 0.19 | |
| together | gpt-oss-120b | 🔧Tool Use | pass | $0.031 | 1169ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-coder-next | { }JSON Output | pass | $0.031 | 947ms | — | 0.11 | 0.80 | |
| openrouter | qwen3-coder-next | 🔍Context Recall | pass | $0.033 | 544ms | — | 0.11 | 0.80 | |
| deepinfra | gemma-4-31B-it | 🔍Context Recall | pass | $0.033 | 1061ms | — | 0.13 | 0.38 | |
| together | Meta-Llama-3-8B-Instruct-Lite | 🔍Context Recall | pass | $0.034 | 1283ms | — | 0.14 | 0.14 | |
| anthropic | claude-haiku-4-5-20251001 | ⚡Ping | ok | $0.034 | 1069ms | — | 1.00 | 5.00 | |
| openrouter | hermes-4-70b | 🧮Reasoning | ok | $0.035 | 383ms | — | 0.13 | 0.40 | |
| openrouter | voxtral-small-24b-2507 | 💻Code Gen | ok | $0.035 | 490ms | — | 0.10 | 0.30 | |
| openrouter | llama-4-scout | 🔍Context Recall | pass | $0.035 | 365ms | — | 0.10 | 0.30 | |
| openrouter | ministral-8b-2512 | 🔍Context Recall | pass | $0.036 | 887ms | — | 0.15 | 0.15 | |
| openrouter | deepseek-chat-v3.1 | { }JSON Output | pass | $0.036 | 1128ms | — | 0.21 | 0.79 | |
| openrouter | hunyuan-a13b-instruct | 🧮Reasoning | ok | $0.037 | 1291ms | — | 0.14 | 0.57 | |
| openrouter | glm-4.5v | ⚡Ping | ok | $0.037 | 907ms | — | 0.60 | 1.80 | |
| together | gemma-4-31B-it | 🔧Tool Use | pass | $0.037 | 1570ms | — | 0.13 | 0.38 | |
| openrouter | command-r-plus-08-2024 | ⚡Ping | ok | $0.037 | 805ms | — | 2.50 | 10.00 | |
| sambanova | DeepSeek-V3.2 | ⚡Ping | ok | $0.037 | 1580ms | — | 3.00 | 4.50 | |
| openrouter | kimi-k2.5 | ⚡Ping | ok | $0.038 | 744ms | — | 0.38 | 2.02 | |
| openrouter | qwen-plus | { }JSON Output | pass | $0.038 | 326ms | — | 0.26 | 0.78 | |
| openrouter | hermes-4-70b | 🔍Context Recall | pass | $0.039 | 400ms | — | 0.13 | 0.40 | |
| openrouter | qwen3-vl-32b-instruct | 🔍Context Recall | pass | $0.039 | 379ms | — | 0.10 | 0.42 | |
| openrouter | unslopnemo-12b | { }JSON Output | pass | $0.039 | 571ms | — | 0.40 | 0.40 | |
| openrouter | sonar-pro | ⚡Ping | ok | $0.039 | 1580ms | — | 3.00 | 15.00 | |
| deepinfra | DeepSeek-R1-0528 | ⚡Ping | ok | $0.039 | 1384ms | — | 0.50 | 2.15 | |
| deepinfra | DeepSeek-V4-Flash | 🔧Tool Use | pass | $0.040 | 3308ms | — | 0.09 | 0.18 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🔧Tool Use | pass | $0.040 | 996ms | — | 0.09 | 1.10 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | ⚡Ping | ok | $0.040 | 1333ms | — | 0.23 | 2.30 | |
| deepinfra | GLM-5 | ⚡Ping | ok | $0.040 | 1825ms | — | 0.60 | 2.08 | |
| openrouter | rocinante-12b | { }JSON Output | pass | $0.041 | 853ms | — | 0.25 | 0.50 | |
| openrouter | gpt-oss-safeguard-20b | 🔍Context Recall | pass | $0.043 | 403ms | — | 0.07 | 0.30 | |
| openrouter | kat-coder-pro-v2 | { }JSON Output | pass | $0.043 | 552ms | — | 0.30 | 1.20 | |
| groq | llama-3.1-8b-instant | 🚀Throughput | ok | $0.043 | 969ms | — | 0.05 | 0.08 | |
| deepinfra | Qwen3.5-9B | 🔧Tool Use | pass | $0.043 | 12154ms | — | 0.10 | 0.15 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🔍Context Recall | pass | $0.044 | 1739ms | — | 0.13 | 0.52 | |
| deepinfra | MiMo-V2.5 | ⚡Ping | ok | $0.044 | 988ms | — | 0.40 | 2.00 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | { }JSON Output | pass | $0.045 | 1386ms | — | 0.20 | 0.88 | |
| openai | gpt-4o-2024-11-20 | ⚡Ping | ok | $0.045 | 573ms | — | 2.50 | 10.00 | |
| openrouter | hermes-4-70b | 💻Code Gen | ok | $0.045 | 390ms | — | 0.13 | 0.40 | |
| together | gpt-oss-120b | 💻Code Gen | ok | $0.046 | 1888ms | — | 0.04 | 0.17 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | { }JSON Output | pass | $0.046 | 1803ms | — | 0.09 | 1.10 | |
| together | cogito-v2-1-671b | ⚡Ping | ok | $0.046 | 573ms | — | 1.25 | 1.25 | |
| openrouter | gemma-4-26b-a4b-it | 💻Code Gen | ok | $0.047 | 1281ms | — | 0.06 | 0.33 | |
| deepinfra | MythoMax-L2-13b | { }JSON Output | pass | $0.047 | 1631ms | — | 0.40 | 0.40 | |
| deepinfra | gpt-oss-120b-Turbo | 🔧Tool Use | pass | $0.047 | 952ms | — | 0.15 | 0.60 | |
| openrouter | l3.3-euryale-70b | 🧮Reasoning | ok | $0.048 | 825ms | — | 0.65 | 0.75 | |
| openai | gpt-4o-mini | 🔍Context Recall | pass | $0.048 | 1059ms | — | 0.15 | 0.60 | |
| openrouter | hunyuan-a13b-instruct | 🔍Context Recall | pass | $0.048 | 1339ms | — | 0.14 | 0.57 | |
| openrouter | mistral-medium-3-5 | ⚡Ping | ok | $0.048 | 601ms | — | 1.50 | 7.50 | |
| groq | gpt-oss-120b | 💻Code Gen | ok | $0.048 | 785ms | — | 0.04 | 0.17 | |
| openrouter | ministral-14b-2512 | 💻Code Gen | ok | $0.048 | 672ms | — | 0.20 | 0.20 | |
| openrouter | ministral-14b-2512 | 🔍Context Recall | pass | $0.049 | 484ms | — | 0.20 | 0.20 | |
| openrouter | llama-4-scout | 💻Code Gen | ok | $0.050 | 371ms | — | 0.10 | 0.30 | |
| deepinfra | MiniMax-M2.7-Turbo | ⚡Ping | ok | $0.050 | 1674ms | — | 0.40 | 2.00 | |
| deepinfra | GLM-4.7-Flash | 🔧Tool Use | pass | $0.050 | 2407ms | — | 0.06 | 0.40 | |
| openrouter | qwen3-vl-32b-instruct | 💻Code Gen | ok | $0.050 | 368ms | — | 0.10 | 0.42 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🧮Reasoning | ok | $0.051 | 1560ms | — | 0.20 | 0.88 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | 🔧Tool Use | pass | $0.051 | 858ms | — | 0.20 | 0.60 | |
| openrouter | qwen3-coder-next | 🧮Reasoning | ok | $0.051 | 662ms | — | 0.11 | 0.80 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 💻Code Gen | ok | $0.051 | 1460ms | — | 0.07 | 0.27 | |
| deepinfra | Llama-3.2-11B-Vision-Instruct | 💻Code Gen | ok | $0.051 | 3410ms | — | 0.34 | 0.34 | |
| openrouter | unslopnemo-12b | 💻Code Gen | ok | $0.052 | 544ms | — | 0.40 | 0.40 | |
| openai | gpt-4.1-nano-2025-04-14 | 💻Code Gen | ok | $0.052 | 1246ms | — | 0.10 | 0.40 | |
| openrouter | granite-4.1-8b | 🚀Throughput | ok | $0.052 | 307ms | — | 0.05 | 0.10 | |
| fireworks | gpt-oss-120b | 🔧Tool Use | pass | $0.052 | 845ms | — | 0.15 | 0.60 | |
| openrouter | qwen-2.5-7b-instruct | 🚀Throughput | ok | $0.052 | 954ms | — | 0.04 | 0.10 | |
| openrouter | llama-3.2-11b-vision-instruct | 💻Code Gen | ok | $0.053 | 483ms | — | 0.34 | 0.34 | |
| openrouter | qwen3-235b-a22b-2507 | 🚀Throughput | ok | $0.053 | 1544ms | — | 0.09 | 0.10 | |
| deepinfra | gemma-4-31B-it | 💻Code Gen | ok | $0.054 | 3750ms | — | 0.13 | 0.38 | |
| openrouter | magnum-v4-72b | ⚡Ping | ok | $0.055 | 858ms | — | 3.00 | 5.00 | |
| deepinfra | gemma-4-31B-it-turbo | 💻Code Gen | ok | $0.055 | 6046ms | — | 0.12 | 0.37 | |
| deepinfra | DeepSeek-V3.2 | 🔍Context Recall | pass | $0.055 | 1914ms | — | 0.26 | 0.38 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | 🧮Reasoning | ok | $0.055 | 1408ms | — | 0.20 | 0.60 | |
| deepinfra | Qwen3.5-397B-A17B | ⚡Ping | ok | $0.056 | 1027ms | — | 0.45 | 3.00 | |
| openai | gpt-4.1-mini-2025-04-14 | { }JSON Output | pass | $0.056 | 789ms | — | 0.40 | 1.60 | |
| together | gpt-oss-20b | 💻Code Gen | ok | $0.057 | 3363ms | — | 0.03 | 0.14 | |
| deepinfra | Qwen3.6-27B | ⚡Ping | ok | $0.057 | 1147ms | — | 0.32 | 3.20 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🔍Context Recall | pass | $0.057 | 1112ms | — | 0.09 | 1.10 | |
| openrouter | seed-1.6-flash | { }JSON Output | pass | $0.057 | 390ms | — | 0.07 | 0.30 | |
| openai | gpt-4.1-mini | { }JSON Output | pass | $0.058 | 819ms | — | 0.40 | 1.60 | |
| openrouter | llama-4-maverick | 🔍Context Recall | pass | $0.058 | 1591ms | — | 0.15 | 0.60 | |
| openrouter | command-r-08-2024 | 🔍Context Recall | pass | $0.059 | 789ms | — | 0.15 | 0.60 | |
| together | MiniMax-M3 | ⚡Ping | ok | $0.059 | 1366ms | — | 0.30 | 1.20 | |
| deepinfra | gpt-oss-120b | 💻Code Gen | ok | $0.059 | 8650ms | — | 0.04 | 0.17 | |
| openai | gpt-4.1-mini-2025-04-14 | 🧮Reasoning | ok | $0.060 | 912ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🧮Reasoning | ok | $0.060 | 939ms | — | 0.40 | 1.60 | |
| openrouter | glm-5.1 | ⚡Ping | ok | $0.060 | 4660ms | — | 0.97 | 3.04 | |
| openrouter | minimax-m2-her | ⚡Ping | ok | $0.061 | 1719ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2.5 | { }JSON Output | pass | $0.061 | 388ms | — | 0.12 | 0.48 | |
| groq | llama-3.3-70b-versatile | 🧮Reasoning | ok | $0.061 | 418ms | — | 0.59 | 0.79 | |
| openrouter | lfm-2-24b-a2b | 🚀Throughput | ok | $0.061 | 414ms | — | 0.03 | 0.12 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | 🔍Context Recall | pass | $0.062 | 1143ms | — | 0.20 | 0.60 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔧Tool Use | pass | $0.062 | 940ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🔧Tool Use | pass | $0.062 | 849ms | — | 0.40 | 1.60 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🔧Tool Use | pass | $0.062 | 1354ms | — | 0.20 | 0.88 | |
| openrouter | l3.3-euryale-70b | { }JSON Output | pass | $0.062 | 1189ms | — | 0.65 | 0.75 | |
| openrouter | hunyuan-a13b-instruct | 💻Code Gen | ok | $0.062 | 1326ms | — | 0.14 | 0.57 | |
| openrouter | qwen-plus | 🔍Context Recall | pass | $0.062 | 370ms | — | 0.26 | 0.78 | |
| openrouter | laguna-xs-2.1 | 🚀Throughput | ok | $0.063 | 379ms | — | 0.06 | 0.12 | |
| fireworks | gpt-oss-120b | 🔍Context Recall | pass | $0.063 | 1262ms | — | 0.15 | 0.60 | |
| openrouter | perceptron-mk1 | 🧮Reasoning | ok | $0.065 | 786ms | — | 0.15 | 1.50 | |
| openrouter | deepseek-chat-v3.1 | 🔍Context Recall | pass | $0.065 | 1382ms | — | 0.21 | 0.79 | |
| openrouter | kat-coder-pro-v2 | 🧮Reasoning | ok | $0.065 | 1048ms | — | 0.30 | 1.20 | |
| deepinfra | Seed-1.8 | ⚡Ping | ok | $0.066 | 2736ms | — | 0.25 | 2.00 | |
| openrouter | command-r-08-2024 | 💻Code Gen | ok | $0.066 | 755ms | — | 0.15 | 0.60 | |
| together | GLM-5.2 | ⚡Ping | ok | $0.066 | 1614ms | — | 0.93 | 3.00 | |
| openrouter | qwen-plus | 🧮Reasoning | ok | $0.067 | 417ms | — | 0.26 | 0.78 | |
| together | Kimi-K2.6 | ⚡Ping | ok | $0.067 | 805ms | — | 0.75 | 3.50 | |
| deepinfra | Kimi-K2.6 | ⚡Ping | ok | $0.067 | 1160ms | — | 0.75 | 3.50 | |
| deepinfra | GLM-5.1 | ⚡Ping | ok | $0.069 | 1619ms | — | 1.05 | 3.50 | |
| together | GLM-5.1 | ⚡Ping | ok | $0.069 | 1114ms | — | 1.05 | 3.50 | |
| openrouter | sonar | 🧮Reasoning | ok | $0.070 | 1566ms | — | 1.00 | 1.00 | |
| openrouter | llama-4-maverick | 💻Code Gen | ok | $0.070 | 514ms | — | 0.15 | 0.60 | |
| openrouter | hermes-3-llama-3.1-70b | 🧮Reasoning | ok | $0.071 | 366ms | — | 0.70 | 0.70 | |
| cerebras | zai-glm-4.7 | ⚡Ping | ok | $0.071 | 707ms | — | 2.25 | 2.75 | |
| openrouter | nova-micro-v1 | 🚀Throughput | ok | $0.071 | 986ms | — | 0.04 | 0.14 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🔍Context Recall | pass | $0.072 | 1438ms | — | 0.20 | 0.88 | |
| openrouter | phi-4 | 🚀Throughput | ok | $0.073 | 367ms | — | 0.07 | 0.14 | |
| deepinfra | phi-4 | 🚀Throughput | ok | $0.073 | 6404ms | — | 0.07 | 0.14 | |
| nvidia | gpt-oss-20b | 🚀Throughput | ok | $0.073 | 4083ms | — | 0.03 | 0.14 | |
| together | gpt-oss-20b | 🚀Throughput | ok | $0.073 | 4777ms | — | 0.03 | 0.14 | |
| groq | llama-3.3-70b-versatile | { }JSON Output | pass | $0.074 | 303ms | — | 0.59 | 0.79 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | 🧮Reasoning | ok | $0.074 | 885ms | — | 0.60 | 1.20 | |
| openrouter | rocinante-12b | 🔍Context Recall | pass | $0.074 | 929ms | — | 0.25 | 0.50 | |
| openrouter | qwen-2.5-coder-32b-instruct | { }JSON Output | pass | $0.075 | 368ms | — | 0.66 | 1.00 | |
| together | Meta-Llama-3-8B-Instruct-Lite | 🚀Throughput | ok | $0.076 | 4796ms | — | 0.14 | 0.14 | |
| openrouter | qwen3-coder | { }JSON Output | pass | $0.076 | 371ms | — | 0.22 | 1.80 | |
| openrouter | perceptron-mk1 | { }JSON Output | pass | $0.076 | 826ms | — | 0.15 | 1.50 | |
| openrouter | gemma-3-12b-it | 🚀Throughput | ok | $0.077 | 360ms | — | 0.05 | 0.15 | |
| openrouter | seed-1.6-flash | 🧮Reasoning | ok | $0.078 | 398ms | — | 0.07 | 0.30 | |
| openrouter | qwen3-next-80b-a3b-thinking | ⚡Ping | ok | $0.078 | 524ms | — | 0.10 | 0.78 | |
| openrouter | seed-2.0-mini | 🔍Context Recall | pass | $0.078 | 286ms | — | 0.10 | 0.40 | |
| openrouter | glm-5v-turbo | ⚡Ping | ok | $0.078 | 1506ms | — | 1.20 | 4.00 | |
| openrouter | morph-v3-fast | ⚡Ping | ok | $0.078 | 754ms | — | 0.80 | 1.20 | |
| together | Qwen3.5-9B | 🚀Throughput | ok | $0.079 | 13954ms | — | 0.10 | 0.15 | |
| openrouter | qwen3.5-9b | 🚀Throughput | ok | $0.079 | 722ms | — | 0.10 | 0.15 | |
| openrouter | ministral-8b-2512 | 🚀Throughput | ok | $0.080 | 517ms | — | 0.15 | 0.15 | |
| openrouter | llama-3.2-11b-vision-instruct | 🔍Context Recall | pass | $0.080 | 361ms | — | 0.34 | 0.34 | |
| openai | gpt-4o-mini | 💻Code Gen | ok | $0.081 | 2105ms | — | 0.15 | 0.60 | |
| deepinfra | Llama-3.2-11B-Vision-Instruct | 🔍Context Recall | pass | $0.081 | 1766ms | — | 0.34 | 0.34 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🧮Reasoning | ok | $0.083 | 1274ms | — | 0.09 | 1.10 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 💻Code Gen | ok | $0.084 | 5750ms | — | 0.13 | 0.52 | |
| openrouter | kat-coder-pro-v2 | 🔍Context Recall | pass | $0.084 | 538ms | — | 0.30 | 1.20 | |
| openai | o3-mini-2025-01-31 | ⚡Ping | ok | $0.085 | 607ms | — | 1.10 | 4.40 | |
| openrouter | seed-2.0-mini | { }JSON Output | pass | $0.085 | 303ms | — | 0.10 | 0.40 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | { }JSON Output | pass | $0.086 | 1271ms | — | 0.60 | 1.20 | |
| openrouter | qwen3-coder-next | 💻Code Gen | ok | $0.087 | 631ms | — | 0.11 | 0.80 | |
| deepinfra | gpt-oss-120b | 🚀Throughput | ok | $0.088 | 9194ms | — | 0.04 | 0.17 | |
| together | gpt-oss-120b | 🚀Throughput | ok | $0.089 | 2841ms | — | 0.04 | 0.17 | |
| groq | gpt-oss-120b | 🚀Throughput | ok | $0.089 | 1323ms | — | 0.04 | 0.17 | |
| openrouter | sonar | { }JSON Output | pass | $0.090 | 2671ms | — | 1.00 | 1.00 | |
| openrouter | deepseek-v4-flash | 💻Code Gen | ok | $0.090 | 1051ms | — | 0.09 | 0.18 | |
| fireworks | gpt-oss-120b | { }JSON Output | pass | $0.090 | 1019ms | — | 0.15 | 0.60 | |
| openrouter | seed-1.6-flash | 🔍Context Recall | pass | $0.091 | 243ms | — | 0.07 | 0.30 | |
| openrouter | mercury-2 | ⚡Ping | ok | $0.092 | 457ms | — | 0.25 | 0.75 | |
| deepinfra | DeepSeek-V4-Flash | 🚀Throughput | ok | $0.093 | 11133ms | — | 0.09 | 0.18 | |
| openrouter | deepseek-v4-flash | 🚀Throughput | ok | $0.093 | 1008ms | — | 0.09 | 0.18 | |
| openrouter | deepseek-chat-v3.1 | 💻Code Gen | ok | $0.094 | 739ms | — | 0.21 | 0.79 | |
| openrouter | mistral-medium-3 | { }JSON Output | pass | $0.095 | 520ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-coder | 🧮Reasoning | ok | $0.095 | 4907ms | — | 0.22 | 1.80 | |
| deepinfra | Nemotron-Content-Safety-3.5 | ⚡Ping | ok | $0.096 | 756ms | — | 0.20 | 0.20 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🚀Throughput | ok | $0.098 | 427ms | — | 0.05 | 0.19 | |
| deepinfra | MiMo-V2.5 | { }JSON Output | pass | $0.098 | 1393ms | — | 0.40 | 2.00 | |
| openrouter | glm-4.6v | 🧮Reasoning | ok | $0.099 | 901ms | — | 0.30 | 0.90 | |
| deepinfra | Nemotron-Content-Safety-3.5 | 🚀Throughput | ok | $0.100 | 1297ms | — | 0.20 | 0.20 | |
| openrouter | minimax-m2-her | 🧮Reasoning | ok | $0.101 | 1684ms | — | 0.30 | 1.20 | |
| openrouter | perceptron-mk1 | 🔍Context Recall | pass | $0.101 | 773ms | — | 0.15 | 1.50 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 💻Code Gen | ok | $0.101 | 2403ms | — | 0.20 | 0.88 | |
| anthropic | claude-sonnet-4-6 | ⚡Ping | ok | $0.102 | 1220ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | ⚡Ping | ok | $0.102 | 1231ms | — | 3.00 | 15.00 | |
| openrouter | mistral-small-3.2-24b-instruct | 🚀Throughput | ok | $0.102 | 737ms | — | 0.07 | 0.20 | |
| openrouter | skyfall-36b-v2 | ⚡Ping | ok | $0.103 | 494ms | — | 0.55 | 0.80 | |
| openrouter | deepseek-v4-pro | 🔍Context Recall | pass | $0.103 | 2120ms | — | 0.43 | 0.87 | |
| openrouter | reka-flash-3 | 🚀Throughput | ok | $0.104 | 1181ms | — | 0.10 | 0.20 | |
| openrouter | morph-v3-fast | 🧮Reasoning | ok | $0.105 | 753ms | — | 0.80 | 1.20 | |
| openrouter | devstral-2512 | { }JSON Output | pass | $0.105 | 546ms | — | 0.40 | 2.00 | |
| together | cogito-v2-1-671b | 🧮Reasoning | ok | $0.105 | 1149ms | — | 1.25 | 1.25 | |
| openrouter | qwen-plus | 💻Code Gen | ok | $0.105 | 586ms | — | 0.26 | 0.78 | |
| openrouter | unslopnemo-12b | 🔍Context Recall | pass | $0.105 | 814ms | — | 0.40 | 0.40 | |
| openrouter | seed-1.6 | ⚡Ping | ok | $0.106 | 833ms | — | 0.25 | 2.00 | |
| openrouter | ministral-14b-2512 | 🚀Throughput | ok | $0.107 | 1379ms | — | 0.20 | 0.20 | |
| cerebras | gpt-oss-120b | 🧮Reasoning | ok | $0.108 | 604ms | — | 0.14 | 0.95 | |
| openrouter | laguna-xs.2 | 🚀Throughput | ok | $0.108 | 415ms | — | 0.10 | 0.20 | |
| openrouter | mistral-medium-3 | 🔍Context Recall | pass | $0.110 | 544ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🔍Context Recall | pass | $0.110 | 509ms | — | 0.40 | 2.00 | |
| openrouter | nemotron-3-ultra-550b-a55b | ⚡Ping | ok | $0.112 | 919ms | — | 0.60 | 3.60 | |
| deepinfra | MiniMax-M2.7 | 🧮Reasoning | ok | $0.115 | 7140ms | — | 0.25 | 1.00 | |
| openrouter | deepseek-r1-distill-llama-70b | { }JSON Output | pass | $0.117 | 1199ms | — | 0.80 | 0.80 | |
| deepinfra | DeepSeek-V3.2 | 🔧Tool Use | pass | $0.118 | 6026ms | — | 0.26 | 0.38 | |
| together | MiniMax-M2.7 | 🔧Tool Use | pass | $0.118 | 1187ms | — | 0.25 | 1.00 | |
| openrouter | qwen3-coder | 🔍Context Recall | pass | $0.119 | 754ms | — | 0.22 | 1.80 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔍Context Recall | pass | $0.121 | 993ms | — | 0.40 | 1.60 | |
| openrouter | gpt-oss-safeguard-20b | 💻Code Gen | ok | $0.121 | 853ms | — | 0.07 | 0.30 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | 💻Code Gen | ok | $0.122 | 5435ms | — | 0.20 | 0.60 | |
| openai | gpt-4.1-mini | 🔍Context Recall | pass | $0.124 | 939ms | — | 0.40 | 1.60 | |
| deepinfra | Qwen3-14B | 🚀Throughput | ok | $0.125 | 7997ms | — | 0.12 | 0.24 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 💻Code Gen | ok | $0.125 | 1617ms | — | 0.09 | 1.10 | |
| deepinfra | MythoMax-L2-13b | 🔍Context Recall | pass | $0.126 | 1505ms | — | 0.40 | 0.40 | |
| openrouter | nova-premier-v1 | ⚡Ping | ok | $0.128 | 694ms | — | 2.50 | 12.50 | |
| openrouter | minimax-m2-her | { }JSON Output | pass | $0.129 | 1654ms | — | 0.30 | 1.20 | |
| together | MiniMax-M3 | 🧮Reasoning | ok | $0.131 | 1568ms | — | 0.30 | 1.20 | |
| openrouter | qwen3.6-flash | ⚡Ping | ok | $0.133 | 491ms | — | 0.19 | 1.13 | |
| deepinfra | GLM-4.7-Flash | 🔍Context Recall | pass | $0.135 | 4592ms | — | 0.06 | 0.40 | |
| openrouter | minimax-m2-her | 💻Code Gen | ok | $0.136 | 1644ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-v4-pro | { }JSON Output | pass | $0.137 | 780ms | — | 0.43 | 0.87 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🚀Throughput | ok | $0.138 | 1484ms | — | 0.07 | 0.27 | |
| openrouter | mistral-medium-3 | 🧮Reasoning | ok | $0.141 | 507ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-8b | { }JSON Output | pass | $0.142 | 536ms | — | 0.12 | 0.46 | |
| openrouter | devstral-2512 | 🧮Reasoning | ok | $0.145 | 506ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-8b | ⚡Ping | ok | $0.149 | 628ms | — | 0.12 | 0.46 | |
| together | cogito-v2-1-671b | { }JSON Output | pass | $0.149 | 766ms | — | 1.25 | 1.25 | |
| deepinfra | GLM-4.7-Flash | { }JSON Output | pass | $0.150 | 6630ms | — | 0.06 | 0.40 | |
| openrouter | voxtral-small-24b-2507 | 🚀Throughput | ok | $0.153 | 563ms | — | 0.10 | 0.30 | |
| openrouter | llama-4-scout | 🚀Throughput | ok | $0.154 | 521ms | — | 0.10 | 0.30 | |
| openrouter | step-3.5-flash | 🚀Throughput | ok | $0.154 | 2673ms | — | 0.10 | 0.30 | |
| openrouter | skyfall-36b-v2 | { }JSON Output | pass | $0.156 | 489ms | — | 0.55 | 0.80 | |
| openrouter | gpt-oss-safeguard-20b | 🚀Throughput | ok | $0.158 | 266ms | — | 0.07 | 0.30 | |
| openrouter | l3.3-euryale-70b | 🔍Context Recall | pass | $0.158 | 929ms | — | 0.65 | 0.75 | |
| openrouter | qwen3-max-thinking | { }JSON Output | pass | $0.160 | 814ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | { }JSON Output | pass | $0.160 | 1907ms | — | 0.78 | 3.90 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | 🔧Tool Use | pass | $0.161 | 1029ms | — | 0.60 | 1.20 | |
| groq | llama-3.3-70b-versatile | 🔧Tool Use | pass | $0.161 | 301ms | — | 0.59 | 0.79 | |
| openrouter | morph-v3-fast | { }JSON Output | pass | $0.161 | 823ms | — | 0.80 | 1.20 | |
| together | gemma-4-31B-it | 💻Code Gen | ok | $0.163 | 5663ms | — | 0.13 | 0.38 | |
| deepinfra | GLM-4.7-Flash | 🧮Reasoning | ok | $0.165 | 6683ms | — | 0.06 | 0.40 | |
| openrouter | minimax-m2-her | 🔍Context Recall | pass | $0.166 | 1677ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-v4-pro | 💻Code Gen | ok | $0.166 | 425ms | — | 0.43 | 0.87 | |
| groq | llama-3.3-70b-versatile | 🔍Context Recall | pass | $0.166 | 345ms | — | 0.59 | 0.79 | |
| openrouter | qwen-plus-2025-07-28:thinking | ⚡Ping | ok | $0.167 | 344ms | — | 0.26 | 0.78 | |
| openrouter | gemma-4-26b-a4b-it | 🚀Throughput | ok | $0.168 | 1687ms | — | 0.06 | 0.33 | |
| openrouter | relace-search | { }JSON Output | pass | $0.168 | 1565ms | — | 1.00 | 3.00 | |
| openrouter | llama-3.2-3b-instruct | 🚀Throughput | ok | $0.168 | 429ms | — | 0.05 | 0.33 | |
| openai | gpt-4-turbo | ⚡Ping | ok | $0.170 | 2859ms | — | 10.00 | 30.00 | |
| openai | gpt-4.1-mini-2025-04-14 | 💻Code Gen | ok | $0.173 | 1788ms | — | 0.40 | 1.60 | |
| openrouter | perceptron-mk1 | 💻Code Gen | ok | $0.174 | 1220ms | — | 0.15 | 1.50 | |
| deepinfra | MiMo-V2.5 | 🧮Reasoning | ok | $0.176 | 1313ms | — | 0.40 | 2.00 | |
| together | MiniMax-M3 | { }JSON Output | pass | $0.177 | 1231ms | — | 0.30 | 1.20 | |
| openrouter | skyfall-36b-v2 | 🧮Reasoning | ok | $0.177 | 776ms | — | 0.55 | 0.80 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🔍Context Recall | pass | $0.177 | 363ms | — | 0.66 | 1.00 | |
| openai | gpt-4.1-mini | 💻Code Gen | ok | $0.179 | 1973ms | — | 0.40 | 1.60 | |
| groq | llama-3.3-70b-versatile | 💻Code Gen | ok | $0.180 | 586ms | — | 0.59 | 0.79 | |
| deepinfra | MiMo-V2.5 | 🔍Context Recall | pass | $0.180 | 1176ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-8b | 🔍Context Recall | pass | $0.181 | 592ms | — | 0.12 | 0.46 | |
| openrouter | seed-2.0-mini | 🧮Reasoning | ok | $0.184 | 337ms | — | 0.10 | 0.40 | |
| deepinfra | Llama-3.2-11B-Vision-Instruct | 🚀Throughput | ok | $0.186 | 14651ms | — | 0.34 | 0.34 | |
| openrouter | llama-3.2-11b-vision-instruct | 🚀Throughput | ok | $0.186 | 368ms | — | 0.34 | 0.34 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | 🔍Context Recall | pass | $0.187 | 896ms | — | 0.60 | 1.20 | |
| openrouter | l3.3-euryale-70b | 💻Code Gen | ok | $0.187 | 1542ms | — | 0.65 | 0.75 | |
| anthropic | claude-opus-4-8 | ⚡Ping | ok | $0.190 | 1873ms | — | 5.00 | 25.00 | |
| openrouter | sonar | 💻Code Gen | ok | $0.191 | 1598ms | — | 1.00 | 1.00 | |
| deepinfra | gemma-4-31B-it | 🚀Throughput | ok | $0.196 | 16816ms | — | 0.13 | 0.38 | |
| together | gemma-4-31B-it | 🚀Throughput | ok | $0.196 | 5978ms | — | 0.13 | 0.38 | |
| openrouter | glm-4.5v | 🧮Reasoning | ok | $0.197 | 1403ms | — | 0.60 | 1.80 | |
| openrouter | qwen3.5-35b-a3b | ⚡Ping | ok | $0.198 | 343ms | — | 0.14 | 1.00 | |
| deepinfra | GLM-4.7-Flash | 🚀Throughput | ok | $0.202 | 8106ms | — | 0.06 | 0.40 | |
| fireworks | gpt-oss-120b | 💻Code Gen | ok | $0.202 | 1746ms | — | 0.15 | 0.60 | |
| openai | gpt-4.1-nano-2025-04-14 | 🚀Throughput | ok | $0.204 | 3231ms | — | 0.10 | 0.40 | |
| openrouter | hermes-3-llama-3.1-70b | 🔍Context Recall | pass | $0.204 | 412ms | — | 0.70 | 0.70 | |
| openrouter | hermes-4-70b | 🚀Throughput | ok | $0.207 | 383ms | — | 0.13 | 0.40 | |
| deepinfra | DeepSeek-V4-Pro | 🧮Reasoning | ok | $0.207 | 3070ms | — | 1.74 | 3.48 | |
| openrouter | laguna-m.1 | 🚀Throughput | ok | $0.209 | 1229ms | — | 0.20 | 0.40 | |
| openrouter | qwen3-vl-32b-instruct | 🚀Throughput | ok | $0.212 | 378ms | — | 0.10 | 0.42 | |
| openrouter | unslopnemo-12b | 🚀Throughput | ok | $0.214 | 497ms | — | 0.40 | 0.40 | |
| openrouter | glm-4.6 | ⚡Ping | ok | $0.216 | 1956ms | — | 0.43 | 1.74 | |
| together | cogito-v2-1-671b | 💻Code Gen | ok | $0.216 | 1604ms | — | 1.25 | 1.25 | |
| openrouter | qwen-plus-2025-07-28:thinking | { }JSON Output | pass | $0.218 | 330ms | — | 0.26 | 0.78 | |
| openrouter | relace-search | 🧮Reasoning | ok | $0.219 | 1704ms | — | 1.00 | 3.00 | |
| deepinfra | Llama-3.3-Nemotron-Super-49B-v1.5 | 🚀Throughput | ok | $0.220 | 13498ms | — | 0.40 | 0.40 | |
| deepinfra | MythoMax-L2-13b | 🚀Throughput | ok | $0.220 | 10706ms | — | 0.40 | 0.40 | |
| openrouter | sonar | 🔍Context Recall | pass | $0.221 | 1613ms | — | 1.00 | 1.00 | |
| openrouter | kat-coder-pro-v2 | 💻Code Gen | ok | $0.222 | 505ms | — | 0.30 | 1.20 | |
| deepinfra | MiniMax-M2.7-Turbo | 🧮Reasoning | ok | $0.224 | 1667ms | — | 0.40 | 2.00 | |
| deepinfra | MiniMax-M2.7-Turbo | 🔧Tool Use | pass | $0.225 | 1749ms | — | 0.40 | 2.00 | |
| deepinfra | gpt-oss-120b-Turbo | 💻Code Gen | ok | $0.227 | 2237ms | — | 0.15 | 0.60 | |
| deepinfra | MiMo-V2.5 | 🔧Tool Use | pass | $0.228 | 2029ms | — | 0.40 | 2.00 | |
| openrouter | skyfall-36b-v2 | 🔍Context Recall | pass | $0.235 | 536ms | — | 0.55 | 0.80 | |
| openrouter | qwen3-8b | 🧮Reasoning | ok | $0.236 | 596ms | — | 0.12 | 0.46 | |
| openrouter | mistral-medium-3 | 💻Code Gen | ok | $0.238 | 528ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 💻Code Gen | ok | $0.238 | 508ms | — | 0.40 | 2.00 | |
| openrouter | glm-5.1 | 🧮Reasoning | ok | $0.240 | 1526ms | — | 0.97 | 3.04 | |
| openrouter | aion-rp-llama-3.1-8b | 🔍Context Recall | pass | $0.245 | 1105ms | — | 0.80 | 1.60 | |
| deepinfra | Qwen3-Max-Thinking | { }JSON Output | pass | $0.246 | 2977ms | — | 1.20 | 6.00 | |
| openrouter | qwen3-vl-8b-thinking | { }JSON Output | pass | $0.246 | 375ms | — | 0.12 | 1.36 | |
| openrouter | minimax-m2.5 | 🚀Throughput | ok | $0.248 | 1250ms | — | 0.12 | 0.48 | |
| openrouter | seed-1.6 | { }JSON Output | pass | $0.249 | 569ms | — | 0.25 | 2.00 | |
| deepinfra | DeepSeek-V4-Pro | { }JSON Output | pass | $0.259 | 1739ms | — | 1.74 | 3.48 | |
| openrouter | rocinante-12b | 🚀Throughput | ok | $0.263 | 907ms | — | 0.25 | 0.50 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🚀Throughput | ok | $0.265 | 310ms | — | 0.13 | 0.52 | |
| anthropic | claude-opus-4-7 | ⚡Ping | ok | $0.265 | 1488ms | — | 5.00 | 25.00 | |
| sambanova | DeepSeek-V3.2 | { }JSON Output | pass | $0.266 | 1425ms | — | 3.00 | 4.50 | |
| deepinfra | GLM-4.7-Flash | 💻Code Gen | ok | $0.269 | 16714ms | — | 0.06 | 0.40 | |
| gemini | gemini-2.5-pro | 🔧Tool Use | pass | $0.269 | 3845ms | — | 1.25 | 10.00 | |
| nvidia | nemotron-3-ultra-550b-a55b | 🧮Reasoning | ok | $0.269 | 7324ms | — | 0.60 | 3.60 | |
| anthropic | claude-haiku-4-5-20251001 | 🧮Reasoning | ok | $0.272 | 1694ms | — | 1.00 | 5.00 | |
| openrouter | qwen3-vl-8b-thinking | ⚡Ping | ok | $0.272 | 278ms | — | 0.12 | 1.36 | |
| openrouter | qwen3.5-plus-02-15 | ⚡Ping | ok | $0.274 | 782ms | — | 0.26 | 1.56 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | 💻Code Gen | ok | $0.275 | 1199ms | — | 0.60 | 1.20 | |
| openrouter | qwen-plus-2025-07-28:thinking | 🧮Reasoning | ok | $0.276 | 349ms | — | 0.26 | 0.78 | |
| openrouter | qwen3-max-thinking | 🔍Context Recall | pass | $0.276 | 1600ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | 🔍Context Recall | pass | $0.276 | 1262ms | — | 0.78 | 3.90 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🧮Reasoning | ok | $0.280 | 1667ms | — | 0.60 | 3.60 | |
| deepinfra | MiniMax-M2.7-Turbo | 🔍Context Recall | pass | $0.286 | 1828ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-235b-a22b | ⚡Ping | ok | $0.287 | 343ms | — | 0.46 | 1.82 | |
| sambanova | DeepSeek-V3.2 | 🧮Reasoning | ok | $0.288 | 1393ms | — | 3.00 | 4.50 | |
| openrouter | hunyuan-a13b-instruct | 🚀Throughput | ok | $0.289 | 1339ms | — | 0.14 | 0.57 | |
| openrouter | mistral-medium-3-5 | 🧮Reasoning | ok | $0.292 | 494ms | — | 1.50 | 7.50 | |
| anthropic | claude-haiku-4-5-20251001 | { }JSON Output | pass | $0.294 | 1565ms | — | 1.00 | 5.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🧮Reasoning | ok | $0.295 | 372ms | — | 0.15 | 1.50 | |
| openrouter | qwen3-vl-30b-a3b-thinking | { }JSON Output | pass | $0.297 | 351ms | — | 0.13 | 1.56 | |
| openrouter | command-r-08-2024 | 🚀Throughput | ok | $0.304 | 763ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | 🚀Throughput | ok | $0.306 | 6729ms | — | 0.15 | 0.60 | |
| deepinfra | MiMo-V2.5-Pro | ⚡Ping | ok | $0.306 | 978ms | — | 1.00 | 3.00 | |
| openrouter | llama-4-maverick | 🚀Throughput | ok | $0.306 | 358ms | — | 0.15 | 0.60 | |
| together | Qwen3-235B-A22B-Instruct-2507-tput | 🚀Throughput | ok | $0.308 | 11455ms | — | 0.20 | 0.60 | |
| openrouter | seed-1.6 | 🔍Context Recall | pass | $0.308 | 1528ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | ⚡Ping | ok | $0.312 | 336ms | — | 0.15 | 1.50 | |
| deepinfra | gpt-oss-120b-Turbo | 🚀Throughput | ok | $0.313 | 3453ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-max-thinking | 🧮Reasoning | ok | $0.314 | 905ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | 🧮Reasoning | ok | $0.314 | 1082ms | — | 0.78 | 3.90 | |
| together | cogito-v2-1-671b | 🔍Context Recall | pass | $0.315 | 1154ms | — | 1.25 | 1.25 | |
| fireworks | gpt-oss-120b | 🚀Throughput | ok | $0.315 | 3218ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | { }JSON Output | pass | $0.321 | 342ms | — | 0.15 | 1.50 | |
| openrouter | qwen-plus-2025-07-28:thinking | 🔍Context Recall | pass | $0.326 | 376ms | — | 0.26 | 0.78 | |
| openrouter | mistral-medium-3-5 | { }JSON Output | pass | $0.329 | 983ms | — | 1.50 | 7.50 | |
| openrouter | relace-search | 🔍Context Recall | pass | $0.330 | 1620ms | — | 1.00 | 3.00 | |
| deepinfra | Seed-1.8 | 🔍Context Recall | pass | $0.330 | 3977ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-vl-8b-thinking | 🧮Reasoning | ok | $0.332 | 366ms | — | 0.12 | 1.36 | |
| together | GLM-5.1 | 🔧Tool Use | pass | $0.335 | 1474ms | — | 1.05 | 3.50 | |
| openrouter | morph-v3-fast | 💻Code Gen | ok | $0.337 | 872ms | — | 0.80 | 1.20 | |
| openai | gpt-4o-2024-11-20 | 🔧Tool Use | pass | $0.338 | 541ms | — | 2.50 | 10.00 | |
| deepinfra | GLM-5.1 | 🔧Tool Use | pass | $0.344 | 1594ms | — | 1.05 | 3.50 | |
| openrouter | qwen3-coder | 💻Code Gen | ok | $0.347 | 729ms | — | 0.22 | 1.80 | |
| openrouter | command-r-plus-08-2024 | { }JSON Output | pass | $0.347 | 10105ms | — | 2.50 | 10.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | ⚡Ping | ok | $0.361 | 3237ms | — | 0.13 | 1.56 | |
| openrouter | mercury-2 | 💻Code Gen | ok | $0.376 | 542ms | — | 0.25 | 0.75 | |
| openrouter | hermes-3-llama-3.1-70b | 🚀Throughput | ok | $0.377 | 430ms | — | 0.70 | 0.70 | |
| cerebras | gpt-oss-120b | 💻Code Gen | ok | $0.377 | 528ms | — | 0.14 | 0.95 | |
| openrouter | deepseek-r1 | ⚡Ping | ok | $0.381 | 1226ms | — | 0.70 | 2.50 | |
| together | GLM-5.2 | 🔧Tool Use | pass | $0.388 | 1003ms | — | 0.93 | 3.00 | |
| openrouter | magnum-v4-72b | { }JSON Output | pass | $0.390 | 941ms | — | 3.00 | 5.00 | |
| openrouter | magnum-v4-72b | 🧮Reasoning | ok | $0.394 | 948ms | — | 3.00 | 5.00 | |
| openrouter | qwen-plus | 🚀Throughput | ok | $0.400 | 418ms | — | 0.26 | 0.78 | |
| openrouter | l3.3-euryale-70b | 🚀Throughput | ok | $0.402 | 1571ms | — | 0.65 | 0.75 | |
| deepinfra | DeepSeek-V4-Pro | 🔍Context Recall | pass | $0.402 | 1481ms | — | 1.74 | 3.48 | |
| openrouter | deepseek-chat-v3.1 | 🚀Throughput | ok | $0.403 | 1148ms | — | 0.21 | 0.79 | |
| openrouter | qwen3-coder-next | 🚀Throughput | ok | $0.404 | 896ms | — | 0.11 | 0.80 | |
| openrouter | seed-1.6-flash | 💻Code Gen | ok | $0.416 | 345ms | — | 0.07 | 0.30 | |
| deepinfra | Qwen3.5-397B-A17B | 🔧Tool Use | pass | $0.422 | 2832ms | — | 0.45 | 3.00 | |
| deepinfra | Kimi-K2.6 | 🔧Tool Use | pass | $0.423 | 2593ms | — | 0.75 | 3.50 | |
| openrouter | deepseek-r1-distill-llama-70b | 🚀Throughput | ok | $0.426 | 1001ms | — | 0.80 | 0.80 | |
| deepinfra | MiMo-V2.5 | 💻Code Gen | ok | $0.427 | 2425ms | — | 0.40 | 2.00 | |
| deepinfra | GLM-5 | 🔧Tool Use | pass | $0.428 | 9302ms | — | 0.60 | 2.08 | |
| openrouter | qwen3-235b-a22b | { }JSON Output | pass | $0.431 | 401ms | — | 0.46 | 1.82 | |
| openrouter | mistral-medium-3-5 | 🔍Context Recall | pass | $0.432 | 672ms | — | 1.50 | 7.50 | |
| groq | llama-3.3-70b-versatile | 🚀Throughput | ok | $0.433 | 1842ms | — | 0.59 | 0.79 | |
| deepinfra | DeepSeek-V4-Pro | 💻Code Gen | ok | $0.435 | 9873ms | — | 1.74 | 3.48 | |
| anthropic | claude-haiku-4-5-20251001 | 🔍Context Recall | pass | $0.447 | 957ms | — | 1.00 | 5.00 | |
| deepinfra | Qwen3-VL-235B-A22B-Instruct | 🚀Throughput | ok | $0.448 | 10230ms | — | 0.20 | 0.88 | |
| deepinfra | Qwen3-Max-Thinking | 🔍Context Recall | pass | $0.449 | 2596ms | — | 1.20 | 6.00 | |
| openrouter | deepseek-v4-pro | 🚀Throughput | ok | $0.450 | 870ms | — | 0.43 | 0.87 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🧮Reasoning | ok | $0.451 | 312ms | — | 0.13 | 1.56 | |
| deepinfra | Seed-1.8 | 🧮Reasoning | ok | $0.454 | 5697ms | — | 0.25 | 2.00 | |
| openrouter | grok-build-0.1 | ⚡Ping | ok | $0.457 | 714ms | — | 1.00 | 2.00 | |
| openrouter | mercury-2 | 🚀Throughput | ok | $0.460 | 330ms | — | 0.25 | 0.75 | |
| openrouter | glm-4.6v | 🚀Throughput | ok | $0.461 | 934ms | — | 0.30 | 0.90 | |
| together | MiniMax-M3 | 💻Code Gen | ok | $0.474 | 2259ms | — | 0.30 | 1.20 | |
| deepinfra | Qwen3-Max-Thinking | 🧮Reasoning | ok | $0.484 | 3425ms | — | 1.20 | 6.00 | |
| cerebras | gpt-oss-120b | 🚀Throughput | ok | $0.489 | 733ms | — | 0.14 | 0.95 | |
| gemini | gemini-2.5-pro | 🧮Reasoning | ok | $0.491 | 6675ms | — | 1.25 | 10.00 | |
| openai | gpt-4o-2024-11-20 | { }JSON Output | pass | $0.492 | 890ms | — | 2.50 | 10.00 | |
| openrouter | deepseek-r1-distill-llama-70b | 🔍Context Recall | pass | $0.497 | 775ms | — | 0.80 | 0.80 | |
| together | Kimi-K2.6 | 🔧Tool Use | pass | $0.499 | 888ms | — | 0.75 | 3.50 | |
| deepinfra | MiMo-V2.5-Pro | 🧮Reasoning | ok | $0.504 | 1491ms | — | 1.00 | 3.00 | |
| openrouter | seed-2.0-mini | 💻Code Gen | ok | $0.505 | 357ms | — | 0.10 | 0.40 | |
| openrouter | qwen3.6-35b-a3b | 🚀Throughput | ok | $0.506 | 506ms | — | 0.14 | 1.00 | |
| openrouter | seed-1.6 | 🧮Reasoning | ok | $0.510 | 501ms | — | 0.25 | 2.00 | |
| openrouter | skyfall-36b-v2 | 🚀Throughput | ok | $0.514 | 539ms | — | 0.55 | 0.80 | |
| gemini | gemini-2.5-pro | { }JSON Output | pass | $0.515 | 6247ms | — | 1.25 | 10.00 | |
| openrouter | sonar | 🚀Throughput | ok | $0.516 | 1670ms | — | 1.00 | 1.00 | |
| together | MiniMax-M2.7 | 🚀Throughput | ok | $0.517 | 3059ms | — | 0.25 | 1.00 | |
| deepinfra | Seed-1.8 | { }JSON Output | pass | $0.519 | 6794ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-8b | 💻Code Gen | ok | $0.523 | 890ms | — | 0.12 | 0.46 | |
| openrouter | minimax-m2 | 🚀Throughput | ok | $0.528 | 1334ms | — | 0.26 | 1.02 | |
| openrouter | qwen3-vl-8b-thinking | 🔍Context Recall | pass | $0.533 | 287ms | — | 0.12 | 1.36 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🚀Throughput | ok | $0.539 | 370ms | — | 0.66 | 1.00 | |
| deepinfra | Qwen3-Max-Thinking | 🔧Tool Use | pass | $0.552 | 2582ms | — | 1.20 | 6.00 | |
| openrouter | magnum-v4-72b | 💻Code Gen | ok | $0.553 | 1255ms | — | 3.00 | 5.00 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🚀Throughput | ok | $0.553 | 4674ms | — | 0.09 | 1.10 | |
| openrouter | relace-search | 💻Code Gen | ok | $0.554 | 1637ms | — | 1.00 | 3.00 | |
| deepinfra | GLM-5 | { }JSON Output | pass | $0.565 | 12283ms | — | 0.60 | 2.08 | |
| openrouter | glm-5v-turbo | { }JSON Output | pass | $0.578 | 2381ms | — | 1.20 | 4.00 | |
| openrouter | step-3.7-flash | 🚀Throughput | ok | $0.583 | 1955ms | — | 0.20 | 1.15 | |
| deepinfra | MiniMax-M2.5 | 🚀Throughput | ok | $0.585 | 16276ms | — | 0.15 | 1.15 | |
| openrouter | qwen3-next-80b-a3b-thinking | { }JSON Output | pass | $0.601 | 468ms | — | 0.10 | 0.78 | |
| openrouter | sonar-pro | { }JSON Output | pass | $0.603 | 2373ms | — | 3.00 | 15.00 | |
| openrouter | kat-coder-pro-v2 | 🚀Throughput | ok | $0.611 | 1066ms | — | 0.30 | 1.20 | |
| openrouter | nova-premier-v1 | { }JSON Output | pass | $0.620 | 680ms | — | 2.50 | 12.50 | |
| openrouter | deepseek-r1 | { }JSON Output | pass | $0.626 | 1082ms | — | 0.70 | 2.50 | |
| together | Kimi-K2.6 | { }JSON Output | pass | $0.628 | 1694ms | — | 0.75 | 3.50 | |
| sambanova | DeepSeek-V3.2 | 🔍Context Recall | pass | $0.633 | 846ms | — | 3.00 | 4.50 | |
| openrouter | qwen3-next-80b-a3b-thinking | 🔍Context Recall | pass | $0.635 | 473ms | — | 0.10 | 0.78 | |
| sambanova | Meta-Llama-3.3-70B-Instruct | 🚀Throughput | ok | $0.639 | 2368ms | — | 0.60 | 1.20 | |
| together | MiniMax-M3 | 🚀Throughput | ok | $0.647 | 3155ms | — | 0.30 | 1.20 | |
| anthropic | claude-sonnet-4-6 | { }JSON Output | pass | $0.657 | 1631ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | { }JSON Output | pass | $0.657 | 1478ms | — | 3.00 | 15.00 | |
| deepinfra | MiMo-V2.5-Pro | { }JSON Output | pass | $0.663 | 3718ms | — | 1.00 | 3.00 | |
| openai | gpt-4o-2024-11-20 | 🧮Reasoning | ok | $0.665 | 923ms | — | 2.50 | 10.00 | |
| openrouter | minimax-m2-her | 🚀Throughput | ok | $0.666 | 1631ms | — | 0.30 | 1.20 | |
| openai | o3-mini-2025-01-31 | 🔍Context Recall | pass | $0.670 | 1445ms | — | 1.10 | 4.40 | |
| cerebras | zai-glm-4.7 | { }JSON Output | pass | $0.671 | 678ms | — | 2.25 | 2.75 | |
| deepinfra | MiMo-V2.5-Pro | 🔧Tool Use | pass | $0.672 | 1219ms | — | 1.00 | 3.00 | |
| deepinfra | Seed-1.8 | 🔧Tool Use | pass | $0.676 | 10322ms | — | 0.25 | 2.00 | |
| openrouter | seed-1.6-flash | 🚀Throughput | ok | $0.680 | 332ms | — | 0.07 | 0.30 | |
| openrouter | qwen3-235b-a22b | 🔍Context Recall | pass | $0.692 | 984ms | — | 0.46 | 1.82 | |
| openrouter | kimi-k2.5 | 🔍Context Recall | pass | $0.697 | 1010ms | — | 0.38 | 2.02 | |
| together | cogito-v2-1-671b | 🚀Throughput | ok | $0.698 | 5551ms | — | 1.25 | 1.25 | |
| gemini | gemini-2.5-pro | 🔍Context Recall | pass | $0.711 | 4673ms | — | 1.25 | 10.00 | |
| deepinfra | DeepSeek-V4-Pro | 🔧Tool Use | pass | $0.717 | 1830ms | — | 1.74 | 3.48 | |
| openrouter | qwen3-max | 💻Code Gen | ok | $0.718 | 1108ms | — | 0.78 | 3.90 | |
| openrouter | nova-premier-v1 | 🧮Reasoning | ok | $0.748 | 734ms | — | 2.50 | 12.50 | |
| openrouter | perceptron-mk1 | 🚀Throughput | ok | $0.755 | 838ms | — | 0.15 | 1.50 | |
| openrouter | magnum-v4-72b | 🔍Context Recall | pass | $0.757 | 1070ms | — | 3.00 | 5.00 | |
| openai | o3-2025-04-16 | ⚡Ping | ok | $0.770 | 817ms | — | 10.00 | 40.00 | |
| openai | o3 | ⚡Ping | ok | $0.770 | 1375ms | — | 10.00 | 40.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🧮Reasoning | ok | $0.771 | 1602ms | — | 3.00 | 15.00 | |
| deepinfra | Kimi-K2.6 | { }JSON Output | pass | $0.785 | 3307ms | — | 0.75 | 3.50 | |
| deepinfra | MiniMax-M2.7-Turbo | 💻Code Gen | ok | $0.794 | 2429ms | — | 0.40 | 2.00 | |
| openrouter | kimi-k2.5 | { }JSON Output | pass | $0.803 | 1227ms | — | 0.38 | 2.02 | |
| openrouter | command-r-plus-08-2024 | 🔍Context Recall | pass | $0.805 | 915ms | — | 2.50 | 10.00 | |
| openrouter | sonar-pro | 🧮Reasoning | ok | $0.807 | 2063ms | — | 3.00 | 15.00 | |
| openai | o3-mini-2025-01-31 | 🔧Tool Use | pass | $0.808 | 2267ms | — | 1.10 | 4.40 | |
| openai | gpt-4.1-mini-2025-04-14 | 🚀Throughput | ok | $0.815 | 6418ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🚀Throughput | ok | $0.815 | 4980ms | — | 0.40 | 1.60 | |
| anthropic | claude-sonnet-4-6 | 🧮Reasoning | ok | $0.816 | 1881ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-8b | 🚀Throughput | ok | $0.817 | 571ms | — | 0.12 | 0.46 | |
| openrouter | aion-rp-llama-3.1-8b | 🚀Throughput | ok | $0.830 | 958ms | — | 0.80 | 1.60 | |
| openrouter | qwen3-max-thinking | 💻Code Gen | ok | $0.839 | 1014ms | — | 0.78 | 3.90 | |
| openrouter | sonar-pro | 🔍Context Recall | pass | $0.840 | 1947ms | — | 3.00 | 15.00 | |
| sambanova | DeepSeek-V3.2 | 💻Code Gen | ok | $0.843 | 1862ms | — | 3.00 | 4.50 | |
| openrouter | qwen3-235b-a22b | 🧮Reasoning | ok | $0.850 | 332ms | — | 0.46 | 1.82 | |
| anthropic | claude-haiku-4-5-20251001 | 🔧Tool Use | pass | $0.874 | 1207ms | — | 1.00 | 5.00 | |
| openai | gpt-4o-2024-11-20 | 🔍Context Recall | pass | $0.885 | 1083ms | — | 2.50 | 10.00 | |
| openrouter | morph-v3-fast | 🔍Context Recall | pass | $0.888 | 508ms | — | 0.80 | 1.20 | |
| openrouter | qwen3.7-max | ⚡Ping | ok | $0.906 | 904ms | — | 1.25 | 3.75 | |
| deepinfra | Qwen3-Max-Thinking | 💻Code Gen | ok | $0.907 | 4562ms | — | 1.20 | 6.00 | |
| openrouter | qwen3-coder | 🚀Throughput | ok | $0.908 | 383ms | — | 0.22 | 1.80 | |
| openrouter | grok-4.3 | { }JSON Output | pass | $0.912 | 1093ms | — | 1.25 | 2.50 | |
| openrouter | qwen-plus-2025-07-28:thinking | 🚀Throughput | ok | $0.916 | 362ms | — | 0.26 | 0.78 | |
| openrouter | glm-4.5v | 🚀Throughput | ok | $0.922 | 4477ms | — | 0.60 | 1.80 | |
| openrouter | mistral-medium-3-5 | 💻Code Gen | ok | $0.927 | 563ms | — | 1.50 | 7.50 | |
| openrouter | qwen3.5-plus-02-15 | 🔍Context Recall | pass | $0.929 | 800ms | — | 0.26 | 1.56 | |
| anthropic | claude-haiku-4-5-20251001 | 💻Code Gen | ok | $0.945 | 1830ms | — | 1.00 | 5.00 | |
| openrouter | morph-v3-fast | 🚀Throughput | ok | $0.960 | 536ms | — | 0.80 | 1.20 | |
| deepinfra | MiMo-V2.5-Pro | 💻Code Gen | ok | $0.989 | 6300ms | — | 1.00 | 3.00 | |
| openrouter | glm-4.6 | { }JSON Output | pass | $0.991 | 1654ms | — | 0.43 | 1.74 | |
| deepinfra | GLM-5 | 🔍Context Recall | pass | $1.00 | 16121ms | — | 0.60 | 2.08 | |
| openrouter | qwen3.6-max-preview | ⚡Ping | ok | $1.00 | 1182ms | — | 1.04 | 6.24 | |
| openrouter | glm-5v-turbo | 🧮Reasoning | ok | $1.01 | 1710ms | — | 1.20 | 4.00 | |
| openrouter | mistral-medium-3 | 🚀Throughput | ok | $1.01 | 575ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🚀Throughput | ok | $1.01 | 650ms | — | 0.40 | 2.00 | |
| openrouter | grok-4.3 | ⚡Ping | ok | $1.02 | 707ms | — | 1.25 | 2.50 | |
| openrouter | kimi-k2.5 | 🚀Throughput | ok | $1.02 | 385ms | — | 0.38 | 2.02 | |
| deepinfra | MiMo-V2.5 | 🚀Throughput | ok | $1.02 | 4658ms | — | 0.40 | 2.00 | |
| deepinfra | MiniMax-M2.7-Turbo | 🚀Throughput | ok | $1.03 | 2601ms | — | 0.40 | 2.00 | |
| openrouter | grok-4.3 | 💻Code Gen | ok | $1.05 | 663ms | — | 1.25 | 2.50 | |
| openrouter | qwen3.5-plus-02-15 | { }JSON Output | pass | $1.06 | 1103ms | — | 0.26 | 1.56 | |
| deepinfra | GLM-5 | 🚀Throughput | ok | $1.06 | 18062ms | — | 0.60 | 2.08 | |
| openrouter | qwen3.6-flash | 🧮Reasoning | ok | $1.06 | 479ms | — | 0.19 | 1.13 | |
| openrouter | glm-5.1 | { }JSON Output | pass | $1.07 | 1169ms | — | 0.97 | 3.04 | |
| openrouter | nova-premier-v1 | 🔍Context Recall | pass | $1.07 | 1256ms | — | 2.50 | 12.50 | |
| cerebras | zai-glm-4.7 | 💻Code Gen | ok | $1.08 | 807ms | — | 2.25 | 2.75 | |
| deepinfra | DeepSeek-R1-0528 | 🚀Throughput | ok | $1.09 | 18400ms | — | 0.50 | 2.15 | |
| together | GLM-5.1 | { }JSON Output | pass | $1.09 | 2973ms | — | 1.05 | 3.50 | |
| openai | o3-mini-2025-01-31 | { }JSON Output | pass | $1.10 | 2147ms | — | 1.10 | 4.40 | |
| openrouter | qwen3.6-flash | 🔍Context Recall | pass | $1.10 | 493ms | — | 0.19 | 1.13 | |
| together | GLM-5.2 | { }JSON Output | pass | $1.11 | 2480ms | — | 0.93 | 3.00 | |
| deepinfra | DeepSeek-R1-0528 | 🔍Context Recall | pass | $1.12 | 14701ms | — | 0.50 | 2.15 | |
| openrouter | grok-build-0.1 | 💻Code Gen | ok | $1.13 | 759ms | — | 1.00 | 2.00 | |
| anthropic | claude-opus-4-8 | 🧮Reasoning | ok | $1.15 | 2055ms | — | 5.00 | 25.00 | |
| together | Kimi-K2.6 | 🔍Context Recall | pass | $1.15 | 1110ms | — | 0.75 | 3.50 | |
| openai | o1 | ⚡Ping | ok | $1.16 | 878ms | — | 15.00 | 60.00 | |
| deepinfra | Qwen3-235B-A22B-Thinking-2507 | 🚀Throughput | ok | $1.16 | 13346ms | — | 0.23 | 2.30 | |
| openrouter | grok-4.3 | 🧮Reasoning | ok | $1.17 | 710ms | — | 1.25 | 2.50 | |
| anthropic | claude-opus-4-8 | { }JSON Output | pass | $1.19 | 1912ms | — | 5.00 | 25.00 | |
| together | GLM-5.2 | 💻Code Gen | ok | $1.21 | 3863ms | — | 0.93 | 3.00 | |
| openai | o3-mini-2025-01-31 | 🧮Reasoning | ok | $1.22 | 2404ms | — | 1.10 | 4.40 | |
| deepinfra | GLM-5.1 | 🔍Context Recall | pass | $1.23 | 7630ms | — | 1.05 | 3.50 | |
| together | GLM-5.1 | 🧮Reasoning | ok | $1.23 | 4047ms | — | 1.05 | 3.50 | |
| nvidia | nemotron-3-ultra-550b-a55b | 💻Code Gen | ok | $1.25 | 13601ms | — | 0.60 | 3.60 | |
| openrouter | grok-4.3 | 🔍Context Recall | pass | $1.26 | 621ms | — | 1.25 | 2.50 | |
| openrouter | glm-5v-turbo | 💻Code Gen | ok | $1.26 | 1966ms | — | 1.20 | 4.00 | |
| anthropic | claude-opus-4-7 | { }JSON Output | pass | $1.26 | 2173ms | — | 5.00 | 25.00 | |
| sambanova | DeepSeek-V3.2 | 🔧Tool Use | pass | $1.27 | 2542ms | — | 3.00 | 4.50 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🔍Context Recall | pass | $1.27 | 1634ms | — | 0.13 | 1.56 | |
| openrouter | qwen3.6-flash | { }JSON Output | pass | $1.29 | 460ms | — | 0.19 | 1.13 | |
| anthropic | claude-opus-4-7 | 🧮Reasoning | ok | $1.30 | 1978ms | — | 5.00 | 25.00 | |
| deepinfra | Kimi-K2.6 | 🔍Context Recall | pass | $1.30 | 4039ms | — | 0.75 | 3.50 | |
| deepinfra | GLM-5 | 💻Code Gen | ok | $1.33 | 18118ms | — | 0.60 | 2.08 | |
| openrouter | gpt-chat-latest | { }JSON Output | pass | $1.33 | 547ms | — | 5.00 | 30.00 | |
| openrouter | glm-4.6 | 🔍Context Recall | pass | $1.34 | 2563ms | — | 0.43 | 1.74 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 💻Code Gen | ok | $1.35 | 338ms | — | 0.15 | 1.50 | |
| openai | gpt-4-turbo | 🔧Tool Use | pass | $1.36 | 1190ms | — | 10.00 | 30.00 | |
| openrouter | grok-build-0.1 | 🔍Context Recall | pass | $1.37 | 709ms | — | 1.00 | 2.00 | |
| openai | o3-mini-2025-01-31 | 💻Code Gen | ok | $1.40 | 2382ms | — | 1.10 | 4.40 | |
| openrouter | gpt-chat-latest | 🧮Reasoning | ok | $1.41 | 522ms | — | 5.00 | 30.00 | |
| openrouter | qwen3-vl-8b-thinking | 🚀Throughput | ok | $1.44 | 334ms | — | 0.12 | 1.36 | |
| openrouter | grok-build-0.1 | 🧮Reasoning | ok | $1.45 | 688ms | — | 1.00 | 2.00 | |
| cerebras | zai-glm-4.7 | 🚀Throughput | ok | $1.45 | 1391ms | — | 2.25 | 2.75 | |
| deepinfra | GLM-5.1 | { }JSON Output | pass | $1.46 | 14704ms | — | 1.05 | 3.50 | |
| openrouter | deepseek-r1 | 🔍Context Recall | pass | $1.47 | 1106ms | — | 0.70 | 2.50 | |
| openrouter | qwen3.6-flash | 💻Code Gen | ok | $1.48 | 509ms | — | 0.19 | 1.13 | |
| together | GLM-5.2 | 🧮Reasoning | ok | $1.49 | 7979ms | — | 0.93 | 3.00 | |
| openrouter | glm-5.1 | 🔍Context Recall | pass | $1.49 | 597ms | — | 0.97 | 3.04 | |
| deepinfra | Qwen3.5-397B-A17B | 🚀Throughput | ok | $1.52 | 10056ms | — | 0.45 | 3.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🔍Context Recall | pass | $1.52 | 1952ms | — | 3.00 | 15.00 | |
| openrouter | relace-search | 🚀Throughput | ok | $1.54 | 1679ms | — | 1.00 | 3.00 | |
| together | GLM-5.2 | 🚀Throughput | ok | $1.54 | 5476ms | — | 0.93 | 3.00 | |
| openai | gpt-4o-2024-11-20 | 💻Code Gen | ok | $1.58 | 964ms | — | 2.50 | 10.00 | |
| openai | gpt-4-turbo | { }JSON Output | pass | $1.59 | 2097ms | — | 10.00 | 30.00 | |
| together | GLM-5.2 | 🔍Context Recall | pass | $1.61 | 2186ms | — | 0.93 | 3.00 | |
| deepinfra | Qwen3.6-27B | 🚀Throughput | ok | $1.61 | 11778ms | — | 0.32 | 3.20 | |
| openrouter | deepseek-r1-distill-llama-70b | 🧮Reasoning | ok | $1.62 | 1495ms | — | 0.80 | 0.80 | |
| deepinfra | Seed-1.8 | 💻Code Gen | ok | $1.64 | 14688ms | — | 0.25 | 2.00 | |
| openrouter | glm-5v-turbo | 🔍Context Recall | pass | $1.64 | 1756ms | — | 1.20 | 4.00 | |
| openai | gpt-4-turbo | 🧮Reasoning | ok | $1.65 | 3518ms | — | 10.00 | 30.00 | |
| openai | o3 | 🔧Tool Use | pass | $1.71 | 952ms | — | 10.00 | 40.00 | |
| openrouter | qwen-plus-2025-07-28:thinking | 💻Code Gen | ok | $1.74 | 389ms | — | 0.26 | 0.78 | |
| deepinfra | GLM-5.1 | 🧮Reasoning | ok | $1.76 | 10227ms | — | 1.05 | 3.50 | |
| openrouter | glm-4.6 | 🚀Throughput | ok | $1.76 | 670ms | — | 0.43 | 1.74 | |
| together | Kimi-K2.6 | 🚀Throughput | ok | $1.78 | 3413ms | — | 0.75 | 3.50 | |
| deepinfra | Kimi-K2.6 | 🚀Throughput | ok | $1.78 | 6206ms | — | 0.75 | 3.50 | |
| deepinfra | GLM-5 | 🧮Reasoning | ok | $1.78 | 35547ms | — | 0.60 | 2.08 | |
| deepinfra | MiMo-V2.5-Pro | 🚀Throughput | ok | $1.78 | 7866ms | — | 1.00 | 3.00 | |
| deepinfra | GLM-5.1 | 🚀Throughput | ok | $1.79 | 9153ms | — | 1.05 | 3.50 | |
| together | GLM-5.1 | 🚀Throughput | ok | $1.79 | 4688ms | — | 1.05 | 3.50 | |
| together | GLM-5.1 | 🔍Context Recall | pass | $1.80 | 3877ms | — | 1.05 | 3.50 | |
| deepinfra | DeepSeek-V4-Pro | 🚀Throughput | ok | $1.80 | 20272ms | — | 1.74 | 3.48 | |
| openrouter | glm-4.6 | 🧮Reasoning | ok | $1.82 | 8300ms | — | 0.43 | 1.74 | |
| openrouter | seed-1.6 | 💻Code Gen | ok | $1.82 | 1072ms | — | 0.25 | 2.00 | |
| openrouter | grok-build-0.1 | { }JSON Output | pass | $1.83 | 729ms | — | 1.00 | 2.00 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🚀Throughput | ok | $1.83 | 727ms | — | 0.60 | 3.60 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🚀Throughput | ok | $1.84 | 301ms | — | 0.13 | 1.56 | |
| anthropic | claude-sonnet-4-6 | 🔍Context Recall | pass | $1.85 | 2996ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.5-35b-a3b | 🚀Throughput | ok | $1.86 | 1040ms | — | 0.14 | 1.00 | |
| openrouter | kimi-k2.5 | 🧮Reasoning | ok | $1.87 | 1075ms | — | 0.38 | 2.02 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🚀Throughput | ok | $1.88 | 347ms | — | 0.15 | 1.50 | |
| openrouter | qwen3-next-80b-a3b-thinking | 🚀Throughput | ok | $1.91 | 505ms | — | 0.10 | 0.78 | |
| openrouter | nova-premier-v1 | 💻Code Gen | ok | $1.96 | 712ms | — | 2.50 | 12.50 | |
| openrouter | qwen3-max-thinking | 🚀Throughput | ok | $1.98 | 899ms | — | 0.78 | 3.90 | |
| openrouter | qwen3-max | 🚀Throughput | ok | $1.98 | 1206ms | — | 0.78 | 3.90 | |
| together | GLM-5.1 | 💻Code Gen | ok | $1.99 | 8395ms | — | 1.05 | 3.50 | |
| cerebras | zai-glm-4.7 | 🧮Reasoning | ok | $2.02 | 1397ms | — | 2.25 | 2.75 | |
| openrouter | qwen3.7-max | { }JSON Output | pass | $2.04 | 876ms | — | 1.25 | 3.75 | |
| openrouter | glm-5v-turbo | 🚀Throughput | ok | $2.04 | 1655ms | — | 1.20 | 4.00 | |
| deepinfra | GLM-5.1 | 💻Code Gen | ok | $2.10 | 32027ms | — | 1.05 | 3.50 | |
| openai | o3-mini-2025-01-31 | 🚀Throughput | ok | $2.24 | 3477ms | — | 1.10 | 4.40 | |
| openrouter | sonar-pro | 💻Code Gen | ok | $2.29 | 2049ms | — | 3.00 | 15.00 | |
| openrouter | gpt-chat-latest | 🔍Context Recall | pass | $2.32 | 536ms | — | 5.00 | 30.00 | |
| openrouter | kimi-k2.5 | 💻Code Gen | ok | $2.35 | 889ms | — | 0.38 | 2.02 | |
| sambanova | DeepSeek-V3.2 | 🚀Throughput | ok | $2.35 | 2744ms | — | 3.00 | 4.50 | |
| openrouter | qwen3.6-max-preview | 🔍Context Recall | pass | $2.40 | 1297ms | — | 1.04 | 6.24 | |
| openrouter | grok-4.3 | 🚀Throughput | ok | $2.50 | 977ms | — | 1.25 | 2.50 | |
| openrouter | deepseek-r1 | 🧮Reasoning | ok | $2.52 | 737ms | — | 0.70 | 2.50 | |
| anthropic | claude-haiku-4-5-20251001 | 🚀Throughput | ok | $2.54 | 5561ms | — | 1.00 | 5.00 | |
| openrouter | qwen3-vl-8b-thinking | 💻Code Gen | ok | $2.56 | 643ms | — | 0.12 | 1.36 | |
| openrouter | qwen3.7-max | 🔍Context Recall | pass | $2.57 | 875ms | — | 1.25 | 3.75 | |
| anthropic | claude-sonnet-4-5-20250929 | 🔧Tool Use | pass | $2.61 | 1564ms | — | 3.00 | 15.00 | |
| openrouter | magnum-v4-72b | 🚀Throughput | ok | $2.61 | 1058ms | — | 3.00 | 5.00 | |
| openrouter | qwen3-235b-a22b | 💻Code Gen | ok | $2.62 | 348ms | — | 0.46 | 1.82 | |
| openrouter | qwen3.5-plus-02-15 | 🚀Throughput | ok | $2.69 | 798ms | — | 0.26 | 1.56 | |
| deepinfra | Kimi-K2.6 | 💻Code Gen | ok | $2.70 | 9156ms | — | 0.75 | 3.50 | |
| openai | gpt-4-turbo | 🔍Context Recall | pass | $2.75 | 2059ms | — | 10.00 | 30.00 | |
| openrouter | seed-2.0-mini | 🚀Throughput | ok | $2.81 | 284ms | — | 0.10 | 0.40 | |
| openrouter | qwen3.6-flash | 🚀Throughput | ok | $2.88 | 494ms | — | 0.19 | 1.13 | |
| deepinfra | Qwen3-Max-Thinking | 🚀Throughput | ok | $3.05 | 7284ms | — | 1.20 | 6.00 | |
| openai | o3 | 🔍Context Recall | pass | $3.09 | 1331ms | — | 10.00 | 40.00 | |
| gemini | gemini-2.5-pro | 💻Code Gen | ok | $3.15 | 12618ms | — | 1.25 | 10.00 | |
| openrouter | gpt-chat-latest | 💻Code Gen | ok | $3.41 | 555ms | — | 5.00 | 30.00 | |
| openrouter | grok-build-0.1 | 🚀Throughput | ok | $3.44 | 634ms | — | 1.00 | 2.00 | |
| together | Kimi-K2.6 | 💻Code Gen | ok | $3.51 | 3594ms | — | 0.75 | 3.50 | |
| openrouter | qwen3.5-plus-02-15 | 💻Code Gen | ok | $3.58 | 790ms | — | 0.26 | 1.56 | |
| openai | gpt-4-turbo | 💻Code Gen | ok | $3.58 | 4775ms | — | 10.00 | 30.00 | |
| openrouter | qwen3-235b-a22b | 🚀Throughput | ok | $3.69 | 413ms | — | 0.46 | 1.82 | |
| deepinfra | DeepSeek-R1-0528 | 🧮Reasoning | ok | $3.74 | 54708ms | — | 0.50 | 2.15 | |
| anthropic | claude-opus-4-8 | 🔍Context Recall | pass | $3.74 | 2409ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-7 | 🔍Context Recall | pass | $3.81 | 2348ms | — | 5.00 | 25.00 | |
| openrouter | mistral-medium-3-5 | 🚀Throughput | ok | $3.82 | 966ms | — | 1.50 | 7.50 | |
| openrouter | glm-5.1 | 💻Code Gen | ok | $3.94 | 2007ms | — | 0.97 | 3.04 | |
| anthropic | claude-sonnet-4-6 | 💻Code Gen | ok | $3.94 | 4193ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.7-max | 💻Code Gen | ok | $4.20 | 841ms | — | 1.25 | 3.75 | |
| openai | o3-2025-04-16 | 🔧Tool Use | pass | $4.47 | 1880ms | — | 10.00 | 40.00 | |
| openai | o3 | { }JSON Output | pass | $4.68 | 1470ms | — | 10.00 | 40.00 | |
| openrouter | seed-1.6 | 🚀Throughput | ok | $4.72 | 536ms | — | 0.25 | 2.00 | |
| openai | o3-2025-04-16 | { }JSON Output | pass | $4.76 | 1447ms | — | 10.00 | 40.00 | |
| openrouter | qwen3.6-max-preview | { }JSON Output | pass | $4.98 | 1160ms | — | 1.04 | 6.24 | |
| openrouter | command-r-plus-08-2024 | 🚀Throughput | ok | $5.07 | 757ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | 🚀Throughput | ok | $5.09 | 2522ms | — | 2.50 | 10.00 | |
| openrouter | deepseek-r1 | 🚀Throughput | ok | $5.78 | 997ms | — | 0.70 | 2.50 | |
| openrouter | nova-premier-v1 | 🚀Throughput | ok | $6.41 | 724ms | — | 2.50 | 12.50 | |
| deepinfra | Kimi-K2.6 | 🧮Reasoning | ok | $6.53 | 17326ms | — | 0.75 | 3.50 | |
| openrouter | glm-5.1 | 🚀Throughput | ok | $6.74 | 3433ms | — | 0.97 | 3.04 | |
| openrouter | qwen3.7-max | 🧮Reasoning | ok | $6.87 | 1008ms | — | 1.25 | 3.75 | |
| openai | o3-2025-04-16 | 🧮Reasoning | ok | $7.53 | 1817ms | — | 10.00 | 40.00 | |
| openrouter | sonar-pro | 🚀Throughput | ok | $7.59 | 1908ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-6 | 🚀Throughput | ok | $7.61 | 12035ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🚀Throughput | ok | $7.61 | 11127ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.5-plus-02-15 | 🧮Reasoning | ok | $7.66 | 958ms | — | 0.26 | 1.56 | |
| anthropic | claude-opus-4-8 | 💻Code Gen | ok | $8.06 | 5451ms | — | 5.00 | 25.00 | |
| openrouter | grok-4.20-multi-agent | 🔍Context Recall | pass | $8.15 | 470ms | — | 1.25 | 2.50 | |
| together | Kimi-K2.6 | 🧮Reasoning | ok | $8.17 | 7836ms | — | 0.75 | 3.50 | |
| openrouter | qwen3.7-max | 🚀Throughput | ok | $8.24 | 1572ms | — | 1.25 | 3.75 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 💻Code Gen | ok | $8.99 | 380ms | — | 0.13 | 1.56 | |
| openrouter | qwen3.6-max-preview | 🧮Reasoning | ok | $9.86 | 978ms | — | 1.04 | 6.24 | |
| anthropic | claude-opus-4-7 | 💻Code Gen | ok | $10.62 | 6348ms | — | 5.00 | 25.00 | |
| openai | o3-2025-04-16 | 🔍Context Recall | pass | $10.77 | 2011ms | — | 10.00 | 40.00 | |
| openai | o1 | 🔧Tool Use | pass | $10.97 | 4376ms | — | 15.00 | 60.00 | |
| openrouter | qwen3.6-max-preview | 💻Code Gen | ok | $11.16 | 1027ms | — | 1.04 | 6.24 | |
| anthropic | claude-opus-4-8 | 🚀Throughput | ok | $12.79 | 7911ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-7 | 🚀Throughput | ok | $12.81 | 8003ms | — | 5.00 | 25.00 | |
| openai | o3-2025-04-16 | 💻Code Gen | ok | $13.75 | 2445ms | — | 10.00 | 40.00 | |
| openrouter | gpt-chat-latest | 🚀Throughput | ok | $15.18 | 536ms | — | 5.00 | 30.00 | |
| openai | gpt-4-turbo | 🚀Throughput | ok | $15.37 | 10514ms | — | 10.00 | 30.00 | |
| openai | o3 | 🧮Reasoning | ok | $15.45 | 2731ms | — | 10.00 | 40.00 | |
| openai | o1 | 🔍Context Recall | pass | $15.86 | 2474ms | — | 15.00 | 60.00 | |
| openrouter | qwen3.6-max-preview | 🚀Throughput | ok | $15.95 | 1093ms | — | 1.04 | 6.24 | |
| openrouter | grok-4.20-multi-agent | ⚡Ping | ok | $18.05 | 397ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 🚀Throughput | ok | $18.11 | 357ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 💻Code Gen | ok | $18.70 | 396ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 🧮Reasoning | ok | $18.87 | 390ms | — | 1.25 | 2.50 | |
| openai | o1 | { }JSON Output | pass | $19.14 | 3486ms | — | 15.00 | 60.00 | |
| openai | o3-2025-04-16 | 🚀Throughput | ok | $20.36 | 3780ms | — | 10.00 | 40.00 | |
| openai | o3 | 🚀Throughput | ok | $20.36 | 3563ms | — | 10.00 | 40.00 | |
| openai | o3 | 💻Code Gen | ok | $20.79 | 3123ms | — | 10.00 | 40.00 | |
| openai | o1 | 🧮Reasoning | ok | $23.05 | 4427ms | — | 15.00 | 60.00 | |
| openai | o1 | 🚀Throughput | ok | $30.54 | 7520ms | — | 15.00 | 60.00 | |
| openrouter | grok-4.20-multi-agent | { }JSON Output | pass | $31.48 | 621ms | — | 1.25 | 2.50 | |
| openai | o1 | 💻Code Gen | ok | $53.50 | 9132ms | — | 15.00 | 60.00 | |
| openrouter | bodybuilder | 🔍Context Recall | pass | — | 7660ms | — | — | — | |
| openrouter | bodybuilder | 🚀Throughput | ok | — | 6435ms | — | — | — | |
| openrouter | bodybuilder | ⚡Ping | ok | — | 2069ms | — | — | — | |
| openrouter | gpt-chat-latest | ⚡Ping | ok | — | 620ms | — | 5.00 | 30.00 | |
| gemini | gemini-3.1-pro-preview-customtools | 🔧Tool Use | pass | — | 2729ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 🔍Context Recall | pass | — | 4569ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 💻Code Gen | ok | — | 5239ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | { }JSON Output | pass | — | 4618ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | 🧮Reasoning | ok | — | 5213ms | — | — | — | |
| gemini | gemini-3.1-pro-preview-customtools | ⚡Ping | ok | — | 2629ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 🔧Tool Use | pass | — | 2605ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 🔍Context Recall | pass | — | 4216ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 💻Code Gen | ok | — | 12937ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | { }JSON Output | pass | — | 5710ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | 🧮Reasoning | ok | — | 11789ms | — | — | — | |
| gemini | gemini-3-pro-image-preview | ⚡Ping | ok | — | 2839ms | — | — | — | |
| openai | gpt-4 | 🔧Tool Use | pass | — | 1720ms | — | — | — | |
| openai | gpt-4 | 🔍Context Recall | pass | — | 1996ms | — | — | — | |
| openai | gpt-4 | 🚀Throughput | ok | — | 10968ms | — | — | — | |
| openai | gpt-4 | 💻Code Gen | ok | — | 4169ms | — | — | — | |
| openai | gpt-4 | { }JSON Output | pass | — | 3481ms | — | — | — | |
| openai | gpt-4 | 🧮Reasoning | ok | — | 2388ms | — | — | — | |
| openai | gpt-4 | ⚡Ping | ok | — | 2539ms | — | — | — | |
| gemini | gemini-pro-latest | 🔧Tool Use | pass | — | 2246ms | — | — | — | |
| gemini | gemini-pro-latest | 🔍Context Recall | pass | — | 4230ms | — | — | — | |
| gemini | gemini-pro-latest | 💻Code Gen | ok | — | 6314ms | — | — | — | |
| gemini | gemini-pro-latest | { }JSON Output | pass | — | 5224ms | — | — | — | |
| gemini | gemini-pro-latest | 🧮Reasoning | ok | — | 5622ms | — | — | — | |
| gemini | gemini-pro-latest | ⚡Ping | ok | — | 2170ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | 🔧Tool Use | pass | — | 624ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | 🔍Context Recall | pass | — | 710ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | 🚀Throughput | ok | — | 4638ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | 💻Code Gen | ok | — | 1036ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | { }JSON Output | pass | — | 723ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | 🧮Reasoning | ok | — | 732ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-preview | ⚡Ping | ok | — | 835ms | — | — | — | |
| gemini | gemini-3-flash-preview | 🔧Tool Use | pass | — | 2084ms | — | — | — | |
| gemini | gemini-3-flash-preview | 🔍Context Recall | pass | — | 2487ms | — | — | — | |
| gemini | gemini-3-flash-preview | 🚀Throughput | ok | — | 5989ms | — | — | — | |
| gemini | gemini-3-flash-preview | 💻Code Gen | ok | — | 2790ms | — | — | — | |
| gemini | gemini-3-flash-preview | { }JSON Output | pass | — | 2296ms | — | — | — | |
| gemini | gemini-3-flash-preview | 🧮Reasoning | ok | — | 4226ms | — | — | — | |
| gemini | gemini-3-flash-preview | ⚡Ping | ok | — | 2062ms | — | — | — | |
| anthropic | claude-fable-5 | 🔧Tool Use | pass | — | 13431ms | — | — | — | |
| anthropic | claude-fable-5 | 🔍Context Recall | pass | — | 5096ms | — | — | — | |
| anthropic | claude-fable-5 | 🚀Throughput | ok | — | 9703ms | — | — | — | |
| anthropic | claude-fable-5 | 💻Code Gen | ok | — | 8135ms | — | — | — | |
| anthropic | claude-fable-5 | { }JSON Output | pass | — | 4091ms | — | — | — | |
| anthropic | claude-fable-5 | 🧮Reasoning | ok | — | 4606ms | — | — | — | |
| anthropic | claude-fable-5 | ⚡Ping | ok | — | 3957ms | — | — | — | |
| openrouter | step-3.5-flash | ⚡Ping | ok | — | 10123ms | — | 0.10 | 0.30 | |
| openrouter | mistral-small-3.1-24b-instruct | 🚀Throughput | ok | — | 556ms | — | 0.35 | 0.56 | |
| openai | gpt-3.5-turbo-16k | 🔧Tool Use | pass | — | 1193ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🔍Context Recall | pass | — | 1348ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🚀Throughput | ok | — | 4136ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 💻Code Gen | ok | — | 2435ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | { }JSON Output | pass | — | 2315ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🧮Reasoning | ok | — | 2813ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | ⚡Ping | ok | — | 3306ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🔧Tool Use | pass | — | 794ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🔍Context Recall | pass | — | 821ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🚀Throughput | ok | — | 2612ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 💻Code Gen | ok | — | 962ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | { }JSON Output | pass | — | 853ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | 🧮Reasoning | ok | — | 933ms | — | — | — | |
| gemini | gemini-3.1-flash-lite-image | ⚡Ping | ok | — | 650ms | — | — | — | |
| cerebras | gemma-4-31b | 🚀Throughput | ok | — | 734ms | — | — | — | |
| cerebras | gemma-4-31b | 💻Code Gen | ok | — | 441ms | — | — | — | |
| cerebras | gemma-4-31b | { }JSON Output | pass | — | 419ms | — | — | — | |
| cerebras | gemma-4-31b | 🧮Reasoning | ok | — | 439ms | — | — | — | |
| cerebras | gemma-4-31b | ⚡Ping | ok | — | 416ms | — | — | — |
Each cell is the latest single run (n=1) — a fluke and a real weakness look the same here. For repeated-run, variance-aware numbers see the Deep Suite and Coding Models. On speed/latency tests, ok means the model responded, not that it was correct.