Loading benchmark data…
EyesInAI·Loading live benchmark data
Live benchmark results across all tested AI models. Sortable by cost, latency, throughput.
| Expand row | Test | Status | |||||||
|---|---|---|---|---|---|---|---|---|---|
| openrouter | north-mini-code:free | 🔍Context Recall | pass | free | 621ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🚀Throughput | ok | free | 627ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | { }JSON Output | pass | free | 701ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | 🧮Reasoning | ok | free | 666ms | — | 0.00 | 0.00 | |
| openrouter | north-mini-code:free | ⚡Ping | ok | free | 670ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-ultra-550b-a55b | 🔍Context Recall | pass | free | 11673ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-ultra-550b-a55b | 🧮Reasoning | ok | free | 19545ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-ultra-550b-a55b | ⚡Ping | ok | free | 17755ms | — | 0.00 | 0.00 | |
| groq | compound-mini | 🔍Context Recall | pass | free | 583ms | — | 0.00 | 0.00 | |
| groq | compound-mini | 🚀Throughput | ok | free | 9494ms | — | 0.00 | 0.00 | |
| groq | compound-mini | 💻Code Gen | ok | free | 1025ms | — | 0.00 | 0.00 | |
| groq | compound-mini | { }JSON Output | pass | free | 738ms | — | 0.00 | 0.00 | |
| groq | compound-mini | 🧮Reasoning | ok | free | 2167ms | — | 0.00 | 0.00 | |
| groq | compound-mini | ⚡Ping | ok | free | 356ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🚀Throughput | ok | free | 387ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | { }JSON Output | pass | free | 405ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-ultra-550b-a55b:free | 🧮Reasoning | ok | free | 437ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | 🔍Context Recall | pass | free | 3764ms | — | 0.00 | 0.00 | |
| nvidia | nemotron-3-super-120b-a12b | { }JSON Output | pass | free | 4185ms | — | 0.00 | 0.00 | |
| groq | compound | 🔍Context Recall | pass | free | 1685ms | — | 0.00 | 0.00 | |
| groq | compound | 💻Code Gen | ok | free | 2956ms | — | 0.00 | 0.00 | |
| groq | compound | 🧮Reasoning | ok | free | 2604ms | — | 0.00 | 0.00 | |
| groq | compound | ⚡Ping | ok | free | 741ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 🔍Context Recall | pass | free | 306ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 🚀Throughput | ok | free | 287ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 💻Code Gen | ok | free | 295ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | { }JSON Output | pass | free | 292ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | 🧮Reasoning | ok | free | 284ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-super-120b-a12b:free | ⚡Ping | ok | free | 281ms | — | 0.00 | 0.00 | |
| groq | qwen3.6-27b | 🔧Tool Use | pass | free | 1117ms | — | 0.00 | 0.00 | |
| groq | qwen3.6-27b | 🔍Context Recall | pass | free | 1142ms | — | 0.00 | 0.00 | |
| groq | qwen3.6-27b | 🚀Throughput | ok | free | 2834ms | — | 0.00 | 0.00 | |
| groq | qwen3.6-27b | 🧮Reasoning | ok | free | 1085ms | — | 0.00 | 0.00 | |
| groq | qwen3.6-27b | ⚡Ping | ok | free | 1345ms | — | 0.00 | 0.00 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | ⚡Ping | ok | <$0.01 | 1407ms | — | 0.02 | 0.03 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 895ms | — | 0.02 | 0.04 | |
| openrouter | l3-lunaris-8b | ⚡Ping | ok | <$0.01 | 507ms | — | 0.04 | 0.05 | |
| openrouter | granite-4.0-h-micro | ⚡Ping | ok | <$0.01 | 1138ms | — | 0.02 | 0.11 | |
| openrouter | llama-3.2-1b-instruct | ⚡Ping | ok | <$0.01 | 1014ms | — | 0.03 | 0.20 | |
| openrouter | gemma-3-12b-it | ⚡Ping | ok | <$0.01 | 355ms | — | 0.05 | 0.15 | |
| deepinfra | gemma-3-12b-it | ⚡Ping | ok | <$0.01 | 1172ms | — | 0.05 | 0.15 | |
| openrouter | nova-lite-v1 | ⚡Ping | ok | <$0.01 | 1438ms | — | 0.06 | 0.24 | |
| openrouter | ministral-3b-2512 | ⚡Ping | ok | <$0.01 | 457ms | — | 0.10 | 0.10 | |
| openrouter | qwen3-coder-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 1217ms | — | 0.07 | 0.28 | |
| deepinfra | DeepSeek-V4-Flash | ⚡Ping | ok | <$0.01 | 1428ms | — | 0.09 | 0.18 | |
| openrouter | reka-edge | ⚡Ping | ok | <$0.01 | 1172ms | — | 0.10 | 0.10 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | ⚡Ping | ok | <$0.01 | 692ms | — | 0.09 | 0.30 | |
| deepinfra | gemma-3-27b-it | ⚡Ping | ok | <$0.01 | 1002ms | — | 0.08 | 0.16 | |
| openai | gpt-4.1-nano | ⚡Ping | ok | <$0.01 | 1397ms | — | 0.10 | 0.40 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🧮Reasoning | ok | <$0.01 | 1540ms | — | 0.02 | 0.04 | |
| deepinfra | gemma-4-26B-A4B-it | ⚡Ping | ok | <$0.01 | 1026ms | — | 0.07 | 0.34 | |
| openrouter | gemma-4-26b-a4b-it | ⚡Ping | ok | <$0.01 | 2346ms | — | 0.07 | 0.34 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | { }JSON Output | pass | <$0.01 | 1383ms | — | 0.02 | 0.04 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | { }JSON Output | pass | <$0.01 | 2391ms | — | 0.02 | 0.03 | |
| openrouter | command-r-08-2024 | ⚡Ping | ok | <$0.01 | 558ms | — | 0.15 | 0.60 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | ⚡Ping | ok | <$0.01 | 1307ms | — | 0.10 | 0.30 | |
| openrouter | llama-3.3-70b-instruct | ⚡Ping | ok | <$0.01 | 795ms | — | 0.10 | 0.32 | |
| deepinfra | Qwen2.5-72B-Instruct | ⚡Ping | ok | <$0.01 | 1074ms | — | 0.13 | 0.40 | |
| openrouter | llama-4-scout | ⚡Ping | ok | <$0.01 | 1799ms | — | 0.10 | 0.30 | |
| openrouter | gemma-4-31b-it | ⚡Ping | ok | <$0.01 | 850ms | — | 0.09 | 0.34 | |
| openrouter | ministral-14b-2512 | ⚡Ping | ok | <$0.01 | 455ms | — | 0.20 | 0.20 | |
| openai | gpt-4o-mini-2024-07-18 | ⚡Ping | ok | <$0.01 | 1113ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | ⚡Ping | ok | <$0.01 | 701ms | — | 0.15 | 0.60 | |
| together | qwen-2-1.5b-instruct | ⚡Ping | ok | <$0.01 | 2816ms | — | 0.10 | 0.10 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🔧Tool Use | pass | <$0.01 | 3039ms | — | 0.02 | 0.03 | |
| openrouter | llama-3.2-3b-instruct | ⚡Ping | ok | <$0.01 | 336ms | — | 0.05 | 0.33 | |
| openrouter | qwen3-coder-next | ⚡Ping | ok | <$0.01 | 1116ms | — | 0.12 | 0.80 | |
| openrouter | qwen3-vl-30b-a3b-instruct | ⚡Ping | ok | <$0.01 | 10295ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | ⚡Ping | ok | <$0.01 | 873ms | — | 0.15 | 0.60 | |
| openrouter | mistral-small-3.2-24b-instruct | ⚡Ping | ok | <$0.01 | 349ms | — | 0.07 | 0.20 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | ⚡Ping | ok | <$0.01 | 991ms | — | 0.09 | 1.10 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | ⚡Ping | ok | <$0.01 | 983ms | — | 0.07 | 0.20 | |
| openrouter | deepseek-v3.2-exp | ⚡Ping | ok | <$0.01 | 1171ms | — | 0.27 | 0.41 | |
| openrouter | qwen3-coder-flash | ⚡Ping | ok | <$0.01 | 750ms | — | 0.20 | 0.97 | |
| openrouter | l3-lunaris-8b | { }JSON Output | pass | <$0.01 | 921ms | — | 0.04 | 0.05 | |
| openrouter | ernie-4.5-vl-424b-a47b | ⚡Ping | ok | <$0.01 | 831ms | — | 0.42 | 1.25 | |
| deepinfra | Mistral-Nemo-Instruct-2407 | 🔍Context Recall | pass | <$0.01 | 1321ms | — | 0.02 | 0.03 | |
| openrouter | mistral-small-2603 | ⚡Ping | ok | <$0.01 | 806ms | — | 0.15 | 0.60 | |
| openrouter | granite-4.0-h-micro | { }JSON Output | pass | <$0.01 | 840ms | — | 0.02 | 0.11 | |
| openrouter | deepseek-chat-v3.1 | ⚡Ping | ok | <$0.01 | 360ms | — | 0.25 | 0.95 | |
| openrouter | qwen-plus-2025-07-28 | ⚡Ping | ok | <$0.01 | 328ms | — | 0.26 | 0.78 | |
| openrouter | qwen-plus | ⚡Ping | ok | <$0.01 | 295ms | — | 0.26 | 0.78 | |
| openrouter | llama-4-maverick | ⚡Ping | ok | <$0.01 | 847ms | — | 0.20 | 0.70 | |
| openrouter | codestral-2508 | ⚡Ping | ok | <$0.01 | 430ms | — | 0.30 | 0.90 | |
| openrouter | granite-4.0-h-micro | 🧮Reasoning | ok | <$0.01 | 1066ms | — | 0.02 | 0.11 | |
| deepinfra | DeepSeek-V3 | ⚡Ping | ok | <$0.01 | 7038ms | — | 0.32 | 0.89 | |
| openrouter | deepseek-v4-flash | ⚡Ping | ok | <$0.01 | 1018ms | — | 0.09 | 0.18 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🔍Context Recall | pass | <$0.01 | 1794ms | — | 0.02 | 0.04 | |
| openrouter | llama-3.2-1b-instruct | 🧮Reasoning | ok | <$0.01 | 634ms | — | 0.03 | 0.20 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 💻Code Gen | ok | <$0.01 | 4436ms | — | 0.02 | 0.04 | |
| openrouter | deepseek-v3.2 | ⚡Ping | ok | <$0.01 | 3660ms | — | 0.27 | 0.40 | |
| openrouter | deepseek-chat-v3-0324 | ⚡Ping | ok | <$0.01 | 2853ms | — | 0.29 | 1.14 | |
| together | qwen-2-1.5b-instruct | 🧮Reasoning | ok | <$0.01 | 484ms | — | 0.10 | 0.10 | |
| openrouter | deepseek-v3.1-terminus | ⚡Ping | ok | <$0.01 | 1475ms | — | 0.27 | 1.00 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🔧Tool Use | pass | <$0.01 | 1387ms | — | 0.02 | 0.04 | |
| openrouter | l3-lunaris-8b | 💻Code Gen | ok | <$0.01 | 312ms | — | 0.04 | 0.05 | |
| openrouter | mistral-saba | ⚡Ping | ok | <$0.01 | 740ms | — | 0.20 | 0.60 | |
| openrouter | nova-lite-v1 | 🧮Reasoning | ok | <$0.01 | 1098ms | — | 0.06 | 0.24 | |
| openrouter | gemma-3-12b-it | 🧮Reasoning | ok | <$0.01 | 356ms | — | 0.05 | 0.15 | |
| openrouter | qwen3-vl-235b-a22b-instruct | ⚡Ping | ok | <$0.01 | 271ms | — | 0.21 | 1.90 | |
| openrouter | unslopnemo-12b | ⚡Ping | ok | <$0.01 | 637ms | — | 0.40 | 0.40 | |
| openai | gpt-4.1-mini-2025-04-14 | ⚡Ping | ok | <$0.01 | 592ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | ⚡Ping | ok | <$0.01 | 843ms | — | 0.40 | 1.60 | |
| deepinfra | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 1289ms | — | 0.03 | 0.14 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | ⚡Ping | ok | <$0.01 | 1772ms | — | 0.40 | 0.40 | |
| openrouter | gpt-oss-20b | ⚡Ping | ok | <$0.01 | 1033ms | — | 0.03 | 0.13 | |
| openrouter | granite-4.0-h-micro | 🔍Context Recall | pass | <$0.01 | 642ms | — | 0.02 | 0.11 | |
| openai | gpt-3.5-turbo | ⚡Ping | ok | <$0.01 | 2061ms | — | 0.50 | 1.50 | |
| openrouter | nova-lite-v1 | { }JSON Output | pass | <$0.01 | 1080ms | — | 0.06 | 0.24 | |
| deepinfra | DeepSeek-V4-Flash | 🧮Reasoning | ok | <$0.01 | 1397ms | — | 0.09 | 0.18 | |
| deepinfra | gemma-3-27b-it | 🧮Reasoning | ok | <$0.01 | 3154ms | — | 0.08 | 0.16 | |
| deepinfra | DeepSeek-V4-Flash | { }JSON Output | pass | <$0.01 | 1474ms | — | 0.09 | 0.18 | |
| openrouter | l3-lunaris-8b | 🔍Context Recall | pass | <$0.01 | 817ms | — | 0.04 | 0.05 | |
| deepinfra | phi-4 | { }JSON Output | pass | <$0.01 | 1349ms | — | 0.07 | 0.14 | |
| openrouter | perceptron-mk1 | ⚡Ping | ok | <$0.01 | 1109ms | — | 0.15 | 1.50 | |
| openrouter | reka-edge | { }JSON Output | pass | <$0.01 | 549ms | — | 0.10 | 0.10 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🧮Reasoning | ok | <$0.01 | 1555ms | — | 0.07 | 0.20 | |
| deepinfra | gpt-oss-20b | 🔧Tool Use | pass | <$0.01 | 1710ms | — | 0.03 | 0.14 | |
| openrouter | llama-3.2-1b-instruct | { }JSON Output | pass | <$0.01 | 625ms | — | 0.03 | 0.20 | |
| openrouter | ministral-3b-2512 | { }JSON Output | pass | <$0.01 | 1010ms | — | 0.10 | 0.10 | |
| openrouter | ministral-3b-2512 | 🧮Reasoning | ok | <$0.01 | 377ms | — | 0.10 | 0.10 | |
| openrouter | gemma-3-12b-it | { }JSON Output | pass | $0.010 | 557ms | — | 0.05 | 0.15 | |
| deepinfra | gemma-3-12b-it | { }JSON Output | pass | $0.010 | 2280ms | — | 0.05 | 0.15 | |
| deepinfra | gemma-3-27b-it | { }JSON Output | pass | $0.010 | 3083ms | — | 0.08 | 0.16 | |
| openrouter | deepseek-v4-flash | 🧮Reasoning | ok | $0.010 | 360ms | — | 0.09 | 0.18 | |
| openrouter | llama-3.1-70b-instruct | ⚡Ping | ok | $0.010 | 1102ms | — | 0.40 | 0.40 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🔧Tool Use | pass | $0.011 | 2106ms | — | 0.07 | 0.20 | |
| openrouter | gpt-oss-120b | ⚡Ping | ok | $0.011 | 1606ms | — | 0.04 | 0.17 | |
| openrouter | granite-4.0-h-micro | 💻Code Gen | ok | $0.011 | 458ms | — | 0.02 | 0.11 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | { }JSON Output | pass | $0.012 | 1397ms | — | 0.09 | 0.30 | |
| deepinfra | gemma-3-12b-it | 🧮Reasoning | ok | $0.012 | 3405ms | — | 0.05 | 0.15 | |
| openrouter | gpt-oss-20b | 🔍Context Recall | pass | $0.012 | 635ms | — | 0.03 | 0.13 | |
| openrouter | mistral-small-3.2-24b-instruct | { }JSON Output | pass | $0.012 | 830ms | — | 0.07 | 0.20 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | { }JSON Output | pass | $0.012 | 2144ms | — | 0.07 | 0.20 | |
| deepinfra | gemma-4-26B-A4B-it | 🔧Tool Use | pass | $0.013 | 1335ms | — | 0.07 | 0.34 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | ⚡Ping | ok | $0.013 | 1179ms | — | 0.05 | 0.20 | |
| openrouter | mistral-medium-3.1 | ⚡Ping | ok | $0.013 | 526ms | — | 0.40 | 2.00 | |
| openrouter | mistral-medium-3 | ⚡Ping | ok | $0.013 | 458ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | ⚡Ping | ok | $0.013 | 964ms | — | 0.40 | 2.00 | |
| openrouter | qwen3-coder-plus | ⚡Ping | ok | $0.013 | 873ms | — | 0.65 | 3.25 | |
| openrouter | gemma-2-27b-it | ⚡Ping | ok | $0.013 | 506ms | — | 0.65 | 0.65 | |
| openrouter | llama-3.2-3b-instruct | 🧮Reasoning | ok | $0.013 | 531ms | — | 0.05 | 0.33 | |
| deepinfra | Hermes-3-Llama-3.1-70B | ⚡Ping | ok | $0.013 | 919ms | — | 0.70 | 0.70 | |
| openai | gpt-4.1-nano | 🔧Tool Use | pass | $0.013 | 983ms | — | 0.10 | 0.40 | |
| deepinfra | NVIDIA-Nemotron-3-Super-120B-A12B | ⚡Ping | ok | $0.014 | 2378ms | — | 0.09 | 0.40 | |
| openrouter | kimi-k2 | ⚡Ping | ok | $0.014 | 1177ms | — | 0.57 | 2.30 | |
| openrouter | qwen3-coder-30b-a3b-instruct | { }JSON Output | pass | $0.014 | 1256ms | — | 0.07 | 0.28 | |
| openrouter | llama-3.3-70b-instruct | 🧮Reasoning | ok | $0.014 | 760ms | — | 0.10 | 0.32 | |
| openrouter | llama-4-scout | 🧮Reasoning | ok | $0.014 | 348ms | — | 0.10 | 0.30 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | 🧮Reasoning | ok | $0.014 | 2871ms | — | 0.10 | 0.30 | |
| openrouter | kimi-k2-0905 | ⚡Ping | ok | $0.015 | 721ms | — | 0.60 | 2.50 | |
| deepinfra | gemma-4-26B-A4B-it | { }JSON Output | pass | $0.015 | 1403ms | — | 0.07 | 0.34 | |
| openrouter | gemma-4-26b-a4b-it | { }JSON Output | pass | $0.015 | 2872ms | — | 0.07 | 0.34 | |
| openrouter | ministral-3b-2512 | 💻Code Gen | ok | $0.015 | 465ms | — | 0.10 | 0.10 | |
| openrouter | mistral-small-3.2-24b-instruct | 🧮Reasoning | ok | $0.015 | 570ms | — | 0.07 | 0.20 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | ⚡Ping | ok | $0.015 | 707ms | — | 0.23 | 2.30 | |
| openrouter | nova-pro-v1 | ⚡Ping | ok | $0.015 | 988ms | — | 0.80 | 3.20 | |
| openrouter | llama-4-scout | { }JSON Output | pass | $0.015 | 725ms | — | 0.10 | 0.30 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | { }JSON Output | pass | $0.015 | 2565ms | — | 0.10 | 0.30 | |
| together | qwen-2-1.5b-instruct | 💻Code Gen | ok | $0.015 | 618ms | — | 0.10 | 0.10 | |
| openrouter | qwen3-max | ⚡Ping | ok | $0.016 | 1050ms | — | 0.78 | 3.90 | |
| openrouter | llama-3.3-70b-instruct | { }JSON Output | pass | $0.016 | 980ms | — | 0.10 | 0.32 | |
| openrouter | llama-3.2-3b-instruct | { }JSON Output | pass | $0.016 | 524ms | — | 0.05 | 0.33 | |
| openrouter | gemma-4-31b-it | { }JSON Output | pass | $0.016 | 1140ms | — | 0.09 | 0.34 | |
| openrouter | l3.1-euryale-70b | ⚡Ping | ok | $0.016 | 496ms | — | 0.85 | 0.85 | |
| openrouter | seed-2.0-mini | ⚡Ping | ok | $0.016 | 852ms | — | 0.10 | 0.40 | |
| together | gpt-oss-20b | ⚡Ping | ok | $0.016 | 2095ms | — | 0.05 | 0.20 | |
| deepinfra | phi-4 | 🧮Reasoning | ok | $0.017 | 2067ms | — | 0.07 | 0.14 | |
| deepinfra | gemma-4-26B-A4B-it | 🧮Reasoning | ok | $0.017 | 1600ms | — | 0.07 | 0.34 | |
| deepinfra | Qwen2.5-72B-Instruct | { }JSON Output | pass | $0.017 | 1520ms | — | 0.13 | 0.40 | |
| openrouter | remm-slerp-l2-13b | ⚡Ping | ok | $0.017 | 378ms | — | 0.35 | 0.65 | |
| deepinfra | L3.1-70B-Euryale-v2.2 | ⚡Ping | ok | $0.017 | 878ms | — | 0.85 | 0.85 | |
| openrouter | laguna-xs-2.1 | ⚡Ping | ok | $0.018 | 819ms | — | 0.06 | 0.12 | |
| openrouter | gemma-4-26b-a4b-it | 🧮Reasoning | ok | $0.018 | 2857ms | — | 0.07 | 0.34 | |
| deepinfra | phi-4 | 🔍Context Recall | pass | $0.018 | 1167ms | — | 0.07 | 0.14 | |
| openrouter | hermes-3-llama-3.1-405b | ⚡Ping | ok | $0.018 | 656ms | — | 1.00 | 1.00 | |
| openrouter | nova-lite-v1 | 🔍Context Recall | pass | $0.018 | 869ms | — | 0.06 | 0.24 | |
| openrouter | gpt-oss-20b | { }JSON Output | pass | $0.019 | 582ms | — | 0.03 | 0.13 | |
| openrouter | gemma-4-31b-it | 🧮Reasoning | ok | $0.019 | 519ms | — | 0.09 | 0.34 | |
| openrouter | qwen2.5-vl-72b-instruct | ⚡Ping | ok | $0.019 | 1171ms | — | 0.80 | 1.00 | |
| openrouter | deepseek-v4-flash | { }JSON Output | pass | $0.019 | 715ms | — | 0.09 | 0.18 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🧮Reasoning | ok | $0.019 | 745ms | — | 0.07 | 0.28 | |
| openrouter | gemma-3-12b-it | 🔍Context Recall | pass | $0.019 | 318ms | — | 0.05 | 0.15 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | ⚡Ping | ok | $0.019 | 959ms | — | 0.60 | 2.40 | |
| deepinfra | gemma-3-12b-it | 🔍Context Recall | pass | $0.019 | 3868ms | — | 0.05 | 0.15 | |
| deepinfra | Seed-2.0-mini | ⚡Ping | ok | $0.019 | 2373ms | — | 0.10 | 0.40 | |
| openrouter | ministral-14b-2512 | { }JSON Output | pass | $0.020 | 464ms | — | 0.20 | 0.20 | |
| deepinfra | gemma-4-26B-A4B-it | 🔍Context Recall | pass | $0.020 | 1148ms | — | 0.07 | 0.34 | |
| openrouter | gemma-4-26b-a4b-it | 🔍Context Recall | pass | $0.020 | 580ms | — | 0.07 | 0.34 | |
| openai | gpt-4.1-nano | { }JSON Output | pass | $0.020 | 979ms | — | 0.10 | 0.40 | |
| deepinfra | phi-4 | 💻Code Gen | ok | $0.020 | 2418ms | — | 0.07 | 0.14 | |
| openrouter | deepseek-v3.2-exp | 🧮Reasoning | ok | $0.020 | 1483ms | — | 0.27 | 0.41 | |
| openai | gpt-4o-mini-2024-07-18 | 🔧Tool Use | pass | $0.020 | 910ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | 🔧Tool Use | pass | $0.020 | 1186ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🧮Reasoning | ok | $0.020 | 385ms | — | 0.09 | 0.30 | |
| openrouter | unslopnemo-12b | 🧮Reasoning | ok | $0.020 | 628ms | — | 0.40 | 0.40 | |
| openrouter | aion-rp-llama-3.1-8b | ⚡Ping | ok | $0.021 | 1167ms | — | 0.80 | 1.60 | |
| openai | gpt-4.1-nano | 🧮Reasoning | ok | $0.021 | 1792ms | — | 0.10 | 0.40 | |
| openrouter | gpt-oss-120b | 🔍Context Recall | pass | $0.022 | 969ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🔍Context Recall | pass | $0.022 | 320ms | — | 0.09 | 0.30 | |
| deepinfra | Qwen2.5-72B-Instruct | 🧮Reasoning | ok | $0.022 | 3292ms | — | 0.13 | 0.40 | |
| openrouter | reka-edge | 🔍Context Recall | pass | $0.023 | 548ms | — | 0.10 | 0.10 | |
| openrouter | mimo-v2.5 | { }JSON Output | pass | $0.023 | 865ms | — | 0.14 | 0.28 | |
| openrouter | deepseek-v4-flash | 💻Code Gen | ok | $0.023 | 1103ms | — | 0.09 | 0.18 | |
| deepinfra | DeepSeek-V4-Flash | 💻Code Gen | ok | $0.023 | 3890ms | — | 0.09 | 0.18 | |
| openrouter | ministral-14b-2512 | 🧮Reasoning | ok | $0.024 | 440ms | — | 0.20 | 0.20 | |
| deepinfra | gemma-3-12b-it | 💻Code Gen | ok | $0.024 | 6421ms | — | 0.05 | 0.15 | |
| openrouter | gemma-4-31b-it | 🔍Context Recall | pass | $0.024 | 1729ms | — | 0.09 | 0.34 | |
| openrouter | gpt-oss-20b | 🧮Reasoning | ok | $0.024 | 2014ms | — | 0.03 | 0.13 | |
| deepinfra | Qwen3-Max-Thinking | ⚡Ping | ok | $0.024 | 2507ms | — | 1.20 | 6.00 | |
| deepinfra | Qwen3-Max | ⚡Ping | ok | $0.024 | 2548ms | — | 1.20 | 6.00 | |
| openrouter | mistral-small-3.2-24b-instruct | 💻Code Gen | ok | $0.024 | 480ms | — | 0.07 | 0.20 | |
| deepinfra | gpt-oss-20b | 🔍Context Recall | pass | $0.024 | 2164ms | — | 0.03 | 0.14 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 💻Code Gen | ok | $0.025 | 2475ms | — | 0.07 | 0.20 | |
| openrouter | gemma-3-12b-it | 💻Code Gen | ok | $0.025 | 897ms | — | 0.05 | 0.15 | |
| openrouter | llama-3.2-3b-instruct | 🔍Context Recall | pass | $0.025 | 500ms | — | 0.05 | 0.33 | |
| openrouter | mistral-small-3.2-24b-instruct | 🔍Context Recall | pass | $0.025 | 812ms | — | 0.07 | 0.20 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🔍Context Recall | pass | $0.025 | 1157ms | — | 0.07 | 0.20 | |
| deepinfra | DeepSeek-V4-Flash | 🔍Context Recall | pass | $0.025 | 1935ms | — | 0.09 | 0.18 | |
| openai | gpt-4o-mini | 🧮Reasoning | ok | $0.025 | 911ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-v3.2 | { }JSON Output | pass | $0.026 | 965ms | — | 0.27 | 0.40 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🔍Context Recall | pass | $0.026 | 667ms | — | 0.07 | 0.28 | |
| openrouter | qwen-2.5-coder-32b-instruct | ⚡Ping | ok | $0.026 | 823ms | — | 0.66 | 1.00 | |
| deepinfra | gemma-3-27b-it | 💻Code Gen | ok | $0.026 | 6175ms | — | 0.08 | 0.16 | |
| openrouter | nova-2-lite-v1 | ⚡Ping | ok | $0.026 | 1464ms | — | 0.30 | 2.50 | |
| openai | gpt-4o-mini-2024-07-18 | 🧮Reasoning | ok | $0.026 | 1089ms | — | 0.15 | 0.60 | |
| together | gpt-oss-120b | ⚡Ping | ok | $0.026 | 1833ms | — | 0.15 | 0.60 | |
| openrouter | l3-lunaris-8b | 🚀Throughput | ok | $0.027 | 398ms | — | 0.04 | 0.05 | |
| openrouter | deepseek-v3.2-exp | { }JSON Output | pass | $0.027 | 1770ms | — | 0.27 | 0.41 | |
| openrouter | qwen3-vl-30b-a3b-instruct | { }JSON Output | pass | $0.027 | 5618ms | — | 0.15 | 0.60 | |
| openai | gpt-3.5-turbo | 🧮Reasoning | ok | $0.027 | 2885ms | — | 0.50 | 1.50 | |
| openrouter | ministral-3b-2512 | 🔍Context Recall | pass | $0.027 | 426ms | — | 0.10 | 0.10 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | { }JSON Output | pass | $0.027 | 2429ms | — | 0.15 | 0.60 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 🧮Reasoning | ok | $0.027 | 4433ms | — | 0.40 | 0.40 | |
| deepinfra | gemma-3-27b-it | 🔍Context Recall | pass | $0.028 | 6801ms | — | 0.08 | 0.16 | |
| openrouter | llama-3.1-70b-instruct | 🧮Reasoning | ok | $0.028 | 835ms | — | 0.40 | 0.40 | |
| openai | gpt-4.1-nano | 🔍Context Recall | pass | $0.028 | 919ms | — | 0.10 | 0.40 | |
| deepinfra | gemma-3-27b-it | 🔧Tool Use | pass | $0.028 | 1839ms | — | 0.08 | 0.16 | |
| openai | gpt-4o-mini-2024-07-18 | { }JSON Output | pass | $0.029 | 873ms | — | 0.15 | 0.60 | |
| openrouter | mistral-small-2603 | { }JSON Output | pass | $0.030 | 462ms | — | 0.15 | 0.60 | |
| openrouter | command-r-08-2024 | { }JSON Output | pass | $0.030 | 393ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🧮Reasoning | ok | $0.030 | 3627ms | — | 0.15 | 0.60 | |
| openrouter | command-r-08-2024 | 🧮Reasoning | ok | $0.030 | 428ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | { }JSON Output | pass | $0.030 | 1011ms | — | 0.15 | 0.60 | |
| openrouter | llama-4-maverick | 🧮Reasoning | ok | $0.030 | 862ms | — | 0.20 | 0.70 | |
| openrouter | qwen3-coder-next | { }JSON Output | pass | $0.030 | 489ms | — | 0.12 | 0.80 | |
| openrouter | gpt-oss-120b | { }JSON Output | pass | $0.031 | 2245ms | — | 0.04 | 0.17 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🧮Reasoning | ok | $0.031 | 579ms | — | 0.15 | 0.60 | |
| openrouter | nova-lite-v1 | 💻Code Gen | ok | $0.031 | 907ms | — | 0.06 | 0.24 | |
| deepinfra | Meta-Llama-3.1-8B-Instruct-Turbo | 🚀Throughput | ok | $0.031 | 18537ms | — | 0.02 | 0.04 | |
| deepinfra | gpt-oss-20b | { }JSON Output | pass | $0.032 | 3091ms | — | 0.03 | 0.14 | |
| openrouter | deepseek-v4-flash | 🔍Context Recall | pass | $0.032 | 1157ms | — | 0.09 | 0.18 | |
| openrouter | llama-3.2-1b-instruct | 💻Code Gen | ok | $0.032 | 674ms | — | 0.03 | 0.20 | |
| openrouter | llama-4-maverick | { }JSON Output | pass | $0.033 | 778ms | — | 0.20 | 0.70 | |
| openrouter | mistral-saba | { }JSON Output | pass | $0.033 | 791ms | — | 0.20 | 0.60 | |
| fireworks | gpt-oss-120b | ⚡Ping | ok | $0.034 | 600ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-v3.2 | 🧮Reasoning | ok | $0.034 | 1297ms | — | 0.27 | 0.40 | |
| openrouter | llama-3.3-70b-instruct | 🔍Context Recall | pass | $0.034 | 971ms | — | 0.10 | 0.32 | |
| openrouter | gpt-oss-120b | 🧮Reasoning | ok | $0.035 | 512ms | — | 0.04 | 0.17 | |
| openrouter | llama-4-scout | 🔍Context Recall | pass | $0.035 | 619ms | — | 0.10 | 0.30 | |
| openrouter | mistral-small-2603 | 🧮Reasoning | ok | $0.035 | 5390ms | — | 0.15 | 0.60 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | 🔍Context Recall | pass | $0.035 | 2111ms | — | 0.10 | 0.30 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 💻Code Gen | ok | $0.035 | 1684ms | — | 0.05 | 0.20 | |
| openrouter | qwen3-coder-next | 🔍Context Recall | pass | $0.035 | 757ms | — | 0.12 | 0.80 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | { }JSON Output | pass | $0.036 | 9498ms | — | 0.40 | 0.40 | |
| openrouter | remm-slerp-l2-13b | 🧮Reasoning | ok | $0.036 | 706ms | — | 0.35 | 0.65 | |
| openrouter | sonar-pro | ⚡Ping | ok | $0.036 | 2326ms | — | 3.00 | 15.00 | |
| openai | gpt-4.1-2025-04-14 | ⚡Ping | ok | $0.036 | 867ms | — | 2.00 | 8.00 | |
| openrouter | sonar-pro-search | ⚡Ping | ok | $0.036 | 1049ms | — | 3.00 | 15.00 | |
| openai | gpt-4.1 | ⚡Ping | ok | $0.036 | 690ms | — | 2.00 | 8.00 | |
| deepinfra | Hermes-3-Llama-3.1-70B | 🧮Reasoning | ok | $0.036 | 1293ms | — | 0.70 | 0.70 | |
| openrouter | mimo-v2.5 | 🔍Context Recall | pass | $0.037 | 779ms | — | 0.14 | 0.28 | |
| openrouter | hermes-4-405b | ⚡Ping | ok | $0.037 | 3808ms | — | 1.00 | 3.00 | |
| openrouter | step-3.7-flash | ⚡Ping | ok | $0.037 | 5002ms | — | 0.20 | 1.15 | |
| openrouter | command-r-plus-08-2024 | ⚡Ping | ok | $0.037 | 937ms | — | 2.50 | 10.00 | |
| openrouter | command-a | ⚡Ping | ok | $0.037 | 770ms | — | 2.50 | 10.00 | |
| deepinfra | Qwen2.5-72B-Instruct | 🔍Context Recall | pass | $0.038 | 2331ms | — | 0.13 | 0.40 | |
| openrouter | mistral-large | ⚡Ping | ok | $0.038 | 889ms | — | 2.00 | 6.00 | |
| openrouter | llama-3.1-70b-instruct | { }JSON Output | pass | $0.038 | 1097ms | — | 0.40 | 0.40 | |
| openrouter | qwen-plus | { }JSON Output | pass | $0.038 | 253ms | — | 0.26 | 0.78 | |
| openrouter | codestral-2508 | { }JSON Output | pass | $0.039 | 407ms | — | 0.30 | 0.90 | |
| openrouter | unslopnemo-12b | { }JSON Output | pass | $0.039 | 1891ms | — | 0.40 | 0.40 | |
| anthropic | claude-haiku-4-5-20251001 | ⚡Ping | ok | $0.039 | 965ms | — | 1.00 | 5.00 | |
| openrouter | qwen-plus-2025-07-28 | { }JSON Output | pass | $0.039 | 899ms | — | 0.26 | 0.78 | |
| deepinfra | phi-4 | ⚡Ping | ok | $0.039 | 4231ms | — | 0.07 | 0.14 | |
| deepinfra | gpt-oss-20b | 🧮Reasoning | ok | $0.039 | 4024ms | — | 0.03 | 0.14 | |
| deepinfra | gpt-oss-120b-Turbo | ⚡Ping | ok | $0.039 | 1783ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-chat-v3-0324 | 🧮Reasoning | ok | $0.039 | 1329ms | — | 0.29 | 1.14 | |
| deepinfra | DeepSeek-V4-Flash | 🔧Tool Use | pass | $0.040 | 2522ms | — | 0.09 | 0.18 | |
| openrouter | step-3.5-flash | ⚡Ping | ok | $0.040 | 1938ms | — | 0.10 | 0.30 | |
| openrouter | mercury-2 | ⚡Ping | ok | $0.040 | 699ms | — | 0.25 | 0.75 | |
| openrouter | qwen3-32b | ⚡Ping | ok | $0.040 | 810ms | — | 0.08 | 0.28 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🔧Tool Use | pass | $0.040 | 1033ms | — | 0.09 | 1.10 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🔧Tool Use | pass | $0.041 | 2533ms | — | 0.15 | 0.60 | |
| openrouter | gemma-2-27b-it | 🧮Reasoning | ok | $0.041 | 380ms | — | 0.65 | 0.65 | |
| openrouter | laguna-xs-2.1 | { }JSON Output | pass | $0.041 | 658ms | — | 0.06 | 0.12 | |
| openrouter | qwen3-coder-next | 🧮Reasoning | ok | $0.042 | 441ms | — | 0.12 | 0.80 | |
| openrouter | deepseek-chat-v3.1 | { }JSON Output | pass | $0.043 | 334ms | — | 0.25 | 0.95 | |
| together | gpt-oss-20b | 🔧Tool Use | pass | $0.043 | 2118ms | — | 0.05 | 0.20 | |
| openrouter | hy3-preview | ⚡Ping | ok | $0.044 | 2061ms | — | 0.18 | 0.60 | |
| openrouter | mimo-v2.5 | ⚡Ping | ok | $0.045 | 479ms | — | 0.14 | 0.28 | |
| groq | gpt-oss-120b | ⚡Ping | ok | $0.045 | 283ms | — | 0.15 | 0.75 | |
| openrouter | mistral-small-2603 | 🔍Context Recall | pass | $0.045 | 512ms | — | 0.15 | 0.60 | |
| openai | gpt-4o | ⚡Ping | ok | $0.045 | 998ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | ⚡Ping | ok | $0.045 | 651ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-08-06 | ⚡Ping | ok | $0.045 | 780ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-05-13 | ⚡Ping | ok | $0.045 | 668ms | — | 2.50 | 10.00 | |
| openrouter | ministral-14b-2512 | 💻Code Gen | ok | $0.045 | 466ms | — | 0.20 | 0.20 | |
| openrouter | trinity-large-thinking | ⚡Ping | ok | $0.045 | 1042ms | — | 0.25 | 0.80 | |
| deepinfra | DeepSeek-V3 | { }JSON Output | pass | $0.046 | 7460ms | — | 0.32 | 0.89 | |
| openrouter | qwen3-coder-flash | { }JSON Output | pass | $0.046 | 781ms | — | 0.20 | 0.97 | |
| together | gpt-oss-20b | { }JSON Output | pass | $0.046 | 1538ms | — | 0.05 | 0.20 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | { }JSON Output | pass | $0.046 | 1633ms | — | 0.09 | 1.10 | |
| openrouter | l3.1-euryale-70b | 🧮Reasoning | ok | $0.047 | 850ms | — | 0.85 | 0.85 | |
| openrouter | magnum-v4-72b | ⚡Ping | ok | $0.048 | 936ms | — | 2.50 | 5.00 | |
| deepinfra | gpt-oss-20b | 💻Code Gen | ok | $0.048 | 4511ms | — | 0.03 | 0.14 | |
| openai | gpt-4.1-nano | 💻Code Gen | ok | $0.048 | 1826ms | — | 0.10 | 0.40 | |
| openai | gpt-4o-mini-2024-07-18 | 🔍Context Recall | pass | $0.048 | 773ms | — | 0.15 | 0.60 | |
| openrouter | perceptron-mk1 | { }JSON Output | pass | $0.048 | 444ms | — | 0.15 | 1.50 | |
| openai | gpt-4o-mini | 🔍Context Recall | pass | $0.048 | 772ms | — | 0.15 | 0.60 | |
| openrouter | mistral-medium-3-5 | ⚡Ping | ok | $0.048 | 581ms | — | 1.50 | 7.50 | |
| openrouter | gemma-4-26b-a4b-it | 💻Code Gen | ok | $0.048 | 2274ms | — | 0.07 | 0.34 | |
| openrouter | deepseek-v3.1-terminus | { }JSON Output | pass | $0.048 | 3496ms | — | 0.27 | 1.00 | |
| deepinfra | MiMo-V2.5 | ⚡Ping | ok | $0.048 | 2840ms | — | 0.40 | 2.00 | |
| openrouter | deepseek-chat-v3-0324 | { }JSON Output | pass | $0.048 | 2227ms | — | 0.29 | 1.14 | |
| openrouter | command-r-08-2024 | 🔍Context Recall | pass | $0.049 | 408ms | — | 0.15 | 0.60 | |
| openrouter | ministral-14b-2512 | 🔍Context Recall | pass | $0.049 | 393ms | — | 0.20 | 0.20 | |
| deepinfra | NVIDIA-Nemotron-3-Super-120B-A12B | 🔍Context Recall | pass | $0.049 | 4634ms | — | 0.09 | 0.40 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🔍Context Recall | pass | $0.049 | 5835ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 🔍Context Recall | pass | $0.049 | 2217ms | — | 0.15 | 0.60 | |
| together | gpt-oss-20b | 🔍Context Recall | pass | $0.049 | 1956ms | — | 0.05 | 0.20 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | 💻Code Gen | ok | $0.050 | 7565ms | — | 0.10 | 0.30 | |
| openrouter | gemma-4-31b-it | 💻Code Gen | ok | $0.050 | 582ms | — | 0.09 | 0.34 | |
| openrouter | llama-4-scout | 💻Code Gen | ok | $0.050 | 327ms | — | 0.10 | 0.30 | |
| deepinfra | gemma-4-26B-A4B-it | 💻Code Gen | ok | $0.050 | 3820ms | — | 0.07 | 0.34 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 💻Code Gen | ok | $0.050 | 1404ms | — | 0.09 | 0.30 | |
| openrouter | deepseek-chat-v3.1 | 🧮Reasoning | ok | $0.050 | 857ms | — | 0.25 | 0.95 | |
| deepinfra | MythoMax-L2-13b | { }JSON Output | pass | $0.052 | 2355ms | — | 0.40 | 0.40 | |
| openrouter | mistral-saba | 🔍Context Recall | pass | $0.052 | 804ms | — | 0.20 | 0.60 | |
| deepinfra | NVIDIA-Nemotron-3-Super-120B-A12B | { }JSON Output | pass | $0.053 | 5210ms | — | 0.09 | 0.40 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🔧Tool Use | pass | $0.053 | 1866ms | — | 0.05 | 0.20 | |
| openrouter | ministral-3b-2512 | 🚀Throughput | ok | $0.053 | 388ms | — | 0.10 | 0.10 | |
| openrouter | reka-edge | 🚀Throughput | ok | $0.053 | 498ms | — | 0.10 | 0.10 | |
| deepinfra | DeepSeek-V3 | 🧮Reasoning | ok | $0.054 | 5520ms | — | 0.32 | 0.89 | |
| openrouter | laguna-xs-2.1 | 🔍Context Recall | pass | $0.054 | 659ms | — | 0.06 | 0.12 | |
| openai | gpt-4.1-mini | 🔧Tool Use | pass | $0.054 | 644ms | — | 0.40 | 1.60 | |
| together | gemma-4-31B-it | ⚡Ping | ok | $0.055 | 13831ms | — | 0.39 | 0.97 | |
| openrouter | gpt-oss-120b | 💻Code Gen | ok | $0.055 | 1815ms | — | 0.04 | 0.17 | |
| openrouter | seed-1.6-flash | { }JSON Output | pass | $0.055 | 196ms | — | 0.07 | 0.30 | |
| deepinfra | L3.1-70B-Euryale-v2.2 | 🧮Reasoning | ok | $0.055 | 1476ms | — | 0.85 | 0.85 | |
| together | qwen-2-1.5b-instruct | 🚀Throughput | ok | $0.055 | 1722ms | — | 0.10 | 0.10 | |
| deepinfra | MythoMax-L2-13b | ⚡Ping | ok | $0.056 | 2916ms | — | 0.40 | 0.40 | |
| openrouter | gpt-oss-20b | 💻Code Gen | ok | $0.056 | 677ms | — | 0.03 | 0.13 | |
| openrouter | ernie-4.5-vl-424b-a47b | { }JSON Output | pass | $0.056 | 1227ms | — | 0.42 | 1.25 | |
| deepinfra | Qwen2.5-72B-Instruct | 🔧Tool Use | pass | $0.056 | 3446ms | — | 0.13 | 0.40 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🔍Context Recall | pass | $0.057 | 1064ms | — | 0.09 | 1.10 | |
| openrouter | granite-4.0-h-micro | 🚀Throughput | ok | $0.057 | 1862ms | — | 0.02 | 0.11 | |
| openrouter | mistral-saba | 🧮Reasoning | ok | $0.057 | 836ms | — | 0.20 | 0.60 | |
| openrouter | deepseek-v3.2-exp | 🔍Context Recall | pass | $0.057 | 1460ms | — | 0.27 | 0.41 | |
| openrouter | unslopnemo-12b | 💻Code Gen | ok | $0.058 | 642ms | — | 0.40 | 0.40 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | { }JSON Output | pass | $0.059 | 2451ms | — | 0.05 | 0.20 | |
| openrouter | deepseek-v3.2 | 🔍Context Recall | pass | $0.059 | 1426ms | — | 0.27 | 0.40 | |
| openrouter | qwen-plus-2025-07-28 | 🧮Reasoning | ok | $0.059 | 401ms | — | 0.26 | 0.78 | |
| openai | gpt-4.1-mini-2025-04-14 | { }JSON Output | pass | $0.060 | 1173ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | { }JSON Output | pass | $0.060 | 910ms | — | 0.40 | 1.60 | |
| openrouter | glm-4.6v | ⚡Ping | ok | $0.060 | 3402ms | — | 0.30 | 0.90 | |
| openai | gpt-4.1-mini-2025-04-14 | 🧮Reasoning | ok | $0.060 | 986ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🧮Reasoning | ok | $0.060 | 945ms | — | 0.40 | 1.60 | |
| openai | gpt-3.5-turbo | 🔧Tool Use | pass | $0.060 | 2220ms | — | 0.50 | 1.50 | |
| openrouter | deepseek-chat-v3.1 | 🔍Context Recall | pass | $0.061 | 2044ms | — | 0.25 | 0.95 | |
| openrouter | remm-slerp-l2-13b | { }JSON Output | pass | $0.061 | 504ms | — | 0.35 | 0.65 | |
| openrouter | minimax-m2-her | ⚡Ping | ok | $0.062 | 1258ms | — | 0.30 | 1.20 | |
| openrouter | deepseek-v3.2 | 💻Code Gen | ok | $0.062 | 1172ms | — | 0.27 | 0.40 | |
| openrouter | mixtral-8x22b-instruct | ⚡Ping | ok | $0.062 | 672ms | — | 2.00 | 6.00 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔧Tool Use | pass | $0.062 | 784ms | — | 0.40 | 1.60 | |
| openrouter | qwen-plus | 🔍Context Recall | pass | $0.062 | 440ms | — | 0.26 | 0.78 | |
| deepinfra | NVIDIA-Nemotron-3-Super-120B-A12B | 💻Code Gen | ok | $0.063 | 7111ms | — | 0.09 | 0.40 | |
| openrouter | hermes-3-llama-3.1-405b | 🧮Reasoning | ok | $0.063 | 661ms | — | 1.00 | 1.00 | |
| groq | gpt-oss-120b | 🔧Tool Use | pass | $0.063 | 293ms | — | 0.15 | 0.75 | |
| openrouter | seed-2.0-mini | 🔍Context Recall | pass | $0.064 | 534ms | — | 0.10 | 0.40 | |
| openrouter | laguna-xs-2.1 | 🚀Throughput | ok | $0.064 | 643ms | — | 0.06 | 0.12 | |
| openrouter | gemma-2-27b-it | { }JSON Output | pass | $0.064 | 309ms | — | 0.65 | 0.65 | |
| openrouter | command-r-08-2024 | 💻Code Gen | ok | $0.064 | 379ms | — | 0.15 | 0.60 | |
| openrouter | laguna-xs-2.1 | 🧮Reasoning | ok | $0.065 | 630ms | — | 0.06 | 0.12 | |
| openrouter | glm-4.5v | ⚡Ping | ok | $0.065 | 10042ms | — | 0.60 | 1.80 | |
| together | gpt-oss-20b | 🧮Reasoning | ok | $0.065 | 2485ms | — | 0.05 | 0.20 | |
| openrouter | qwen3-coder-flash | 🧮Reasoning | ok | $0.065 | 627ms | — | 0.20 | 0.97 | |
| deepinfra | gpt-oss-120b-Turbo | 🔧Tool Use | pass | $0.065 | 1755ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-v3.1-terminus | 🔍Context Recall | pass | $0.066 | 1278ms | — | 0.27 | 1.00 | |
| together | Qwen3.5-9B | ⚡Ping | ok | $0.066 | 4442ms | — | 0.17 | 0.25 | |
| fireworks | gpt-oss-120b | 🔧Tool Use | pass | $0.066 | 736ms | — | 0.15 | 0.60 | |
| deepinfra | Qwen2.5-72B-Instruct | 💻Code Gen | ok | $0.067 | 9303ms | — | 0.13 | 0.40 | |
| openrouter | qwen-plus | 🧮Reasoning | ok | $0.067 | 249ms | — | 0.26 | 0.78 | |
| openrouter | gpt-oss-20b | 🚀Throughput | ok | $0.068 | 576ms | — | 0.03 | 0.13 | |
| together | Qwen3.5-9B | 💻Code Gen | ok | $0.068 | 3987ms | — | 0.17 | 0.25 | |
| openrouter | qwen2.5-vl-72b-instruct | 🧮Reasoning | ok | $0.068 | 717ms | — | 0.80 | 1.00 | |
| deepinfra | Seed-2.0-mini | 🔍Context Recall | pass | $0.068 | 2862ms | — | 0.10 | 0.40 | |
| deepinfra | Llama-4-Scout-17B-16E-Instruct | 🔧Tool Use | pass | $0.068 | 1094ms | — | 0.10 | 0.30 | |
| openrouter | deepseek-v3.1-terminus | 🧮Reasoning | ok | $0.069 | 1110ms | — | 0.27 | 1.00 | |
| together | gpt-oss-120b | 🔧Tool Use | pass | $0.069 | 847ms | — | 0.15 | 0.60 | |
| deepinfra | Hermes-3-Llama-3.1-70B | { }JSON Output | pass | $0.069 | 1944ms | — | 0.70 | 0.70 | |
| deepinfra | Qwen3-30B-A3B | ⚡Ping | ok | $0.070 | 1771ms | — | 0.12 | 0.50 | |
| openai | gpt-4o-mini-2024-07-18 | 💻Code Gen | ok | $0.070 | 1504ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | 💻Code Gen | ok | $0.070 | 1484ms | — | 0.15 | 0.60 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 💻Code Gen | ok | $0.071 | 8777ms | — | 0.40 | 0.40 | |
| openrouter | qwen3-vl-235b-a22b-instruct | { }JSON Output | pass | $0.072 | 289ms | — | 0.21 | 1.90 | |
| deepinfra | Qwen3-VL-30B-A3B-Instruct | 💻Code Gen | ok | $0.072 | 5639ms | — | 0.15 | 0.60 | |
| deepinfra | gpt-oss-120b-Turbo | 🔍Context Recall | pass | $0.072 | 1463ms | — | 0.15 | 0.60 | |
| openrouter | deepseek-v3.2-exp | 💻Code Gen | ok | $0.073 | 1468ms | — | 0.27 | 0.41 | |
| deepinfra | gpt-oss-120b-Turbo | 🧮Reasoning | ok | $0.073 | 1412ms | — | 0.15 | 0.60 | |
| openrouter | ernie-4.5-vl-424b-a47b | 🧮Reasoning | ok | $0.073 | 1257ms | — | 0.42 | 1.25 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🧮Reasoning | ok | $0.073 | 2774ms | — | 0.05 | 0.20 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 💻Code Gen | ok | $0.074 | 536ms | — | 0.15 | 0.60 | |
| together | Qwen3.5-9B | 🔧Tool Use | pass | $0.074 | 1536ms | — | 0.17 | 0.25 | |
| together | gpt-oss-20b | 💻Code Gen | ok | $0.074 | 4593ms | — | 0.05 | 0.20 | |
| openrouter | codestral-2508 | 🔍Context Recall | pass | $0.075 | 448ms | — | 0.30 | 0.90 | |
| together | MiniMax-M3 | ⚡Ping | ok | $0.075 | 1334ms | — | 0.30 | 1.20 | |
| openrouter | l3.1-euryale-70b | { }JSON Output | pass | $0.076 | 329ms | — | 0.85 | 0.85 | |
| anthropic | claude-sonnet-5 | ⚡Ping | ok | $0.076 | 1477ms | — | 2.00 | 10.00 | |
| fireworks | gpt-oss-120b | 🧮Reasoning | ok | $0.076 | 792ms | — | 0.15 | 0.60 | |
| openrouter | llama-3.3-70b-instruct | 💻Code Gen | ok | $0.076 | 317ms | — | 0.10 | 0.32 | |
| openrouter | qwen-2.5-coder-32b-instruct | { }JSON Output | pass | $0.076 | 370ms | — | 0.66 | 1.00 | |
| openrouter | mistral-small-2603 | 💻Code Gen | ok | $0.077 | 444ms | — | 0.15 | 0.60 | |
| openrouter | gemma-3-12b-it | 🚀Throughput | ok | $0.077 | 317ms | — | 0.05 | 0.15 | |
| openrouter | seed-1.6-flash | 🧮Reasoning | ok | $0.077 | 189ms | — | 0.07 | 0.30 | |
| openrouter | morph-v3-fast | ⚡Ping | ok | $0.078 | 657ms | — | 0.80 | 1.20 | |
| deepinfra | Seed-2.0-mini | { }JSON Output | pass | $0.079 | 3331ms | — | 0.10 | 0.40 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🔍Context Recall | pass | $0.079 | 2678ms | — | 0.05 | 0.20 | |
| openrouter | mistral-saba | 💻Code Gen | ok | $0.079 | 825ms | — | 0.20 | 0.60 | |
| openai | gpt-3.5-turbo | { }JSON Output | pass | $0.080 | 2500ms | — | 0.50 | 1.50 | |
| openrouter | qwen-plus-2025-07-28 | 🔍Context Recall | pass | $0.080 | 243ms | — | 0.26 | 0.78 | |
| openrouter | qwen3-coder-flash | 🔍Context Recall | pass | $0.080 | 739ms | — | 0.20 | 0.97 | |
| openrouter | mistral-medium-3.1 | 🧮Reasoning | ok | $0.080 | 452ms | — | 0.40 | 2.00 | |
| openrouter | seed-2.0-mini | { }JSON Output | pass | $0.080 | 537ms | — | 0.10 | 0.40 | |
| openrouter | kimi-k2 | 🧮Reasoning | ok | $0.080 | 1494ms | — | 0.57 | 2.30 | |
| deepinfra | L3.1-70B-Euryale-v2.2 | { }JSON Output | pass | $0.081 | 1549ms | — | 0.85 | 0.85 | |
| openrouter | qwen3-14b | ⚡Ping | ok | $0.081 | 383ms | — | 0.23 | 0.91 | |
| openrouter | minimax-m3 | ⚡Ping | ok | $0.081 | 1715ms | — | 0.30 | 1.20 | |
| openrouter | qwen3-30b-a3b | ⚡Ping | ok | $0.081 | 852ms | — | 0.12 | 0.50 | |
| deepinfra | Seed-2.0-pro | ⚡Ping | ok | $0.082 | 5649ms | — | 0.50 | 3.00 | |
| openrouter | llama-4-maverick | 💻Code Gen | ok | $0.082 | 556ms | — | 0.20 | 0.70 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🧮Reasoning | ok | $0.083 | 1473ms | — | 0.09 | 1.10 | |
| openrouter | perceptron-mk1 | 🧮Reasoning | ok | $0.084 | 877ms | — | 0.15 | 1.50 | |
| openrouter | perceptron-mk1 | 🔍Context Recall | pass | $0.085 | 468ms | — | 0.15 | 1.50 | |
| openrouter | qwen3-32b | { }JSON Output | pass | $0.085 | 380ms | — | 0.08 | 0.28 | |
| openrouter | llama-4-maverick | 🔍Context Recall | pass | $0.086 | 840ms | — | 0.20 | 0.70 | |
| openrouter | qwen3-coder-next | 💻Code Gen | ok | $0.086 | 432ms | — | 0.12 | 0.80 | |
| openrouter | nemotron-3-ultra-550b-a55b | ⚡Ping | ok | $0.086 | 2235ms | — | 0.63 | 3.13 | |
| openrouter | nova-pro-v1 | 🧮Reasoning | ok | $0.087 | 1418ms | — | 0.80 | 3.20 | |
| deepinfra | Seed-1.8 | ⚡Ping | ok | $0.087 | 2967ms | — | 0.25 | 2.00 | |
| openrouter | mistral-medium-3.1 | { }JSON Output | pass | $0.088 | 490ms | — | 0.40 | 2.00 | |
| openrouter | mistral-medium-3 | { }JSON Output | pass | $0.088 | 429ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | { }JSON Output | pass | $0.088 | 445ms | — | 0.40 | 2.00 | |
| openrouter | hermes-3-llama-3.1-405b | { }JSON Output | pass | $0.088 | 586ms | — | 1.00 | 1.00 | |
| openrouter | gpt-oss-120b | 🚀Throughput | ok | $0.088 | 880ms | — | 0.04 | 0.17 | |
| openrouter | seed-1.6-flash | ⚡Ping | ok | $0.088 | 890ms | — | 0.07 | 0.30 | |
| openrouter | mimo-v2.5 | 🧮Reasoning | ok | $0.088 | 1285ms | — | 0.14 | 0.28 | |
| openrouter | kimi-k2 | { }JSON Output | pass | $0.089 | 1946ms | — | 0.57 | 2.30 | |
| deepinfra | MiniMax-M3 | ⚡Ping | ok | $0.090 | 2925ms | — | 0.28 | 1.10 | |
| openrouter | kimi-k2-0905 | { }JSON Output | pass | $0.090 | 737ms | — | 0.60 | 2.50 | |
| openrouter | unslopnemo-12b | 🔍Context Recall | pass | $0.091 | 743ms | — | 0.40 | 0.40 | |
| openrouter | qwen2.5-vl-72b-instruct | { }JSON Output | pass | $0.091 | 797ms | — | 0.80 | 1.00 | |
| openrouter | minimax-m2 | ⚡Ping | ok | $0.091 | 3057ms | — | 0.26 | 1.02 | |
| openrouter | deepseek-v4-flash | 🚀Throughput | ok | $0.092 | 1373ms | — | 0.09 | 0.18 | |
| openrouter | kimi-k2-0905 | 🧮Reasoning | ok | $0.094 | 1327ms | — | 0.60 | 2.50 | |
| deepinfra | Hermes-3-Llama-3.1-70B | 💻Code Gen | ok | $0.095 | 4436ms | — | 0.70 | 0.70 | |
| deepinfra | Meta-Llama-3.1-70B-Instruct-Turbo | 🔍Context Recall | pass | $0.095 | 2931ms | — | 0.40 | 0.40 | |
| openrouter | codestral-2508 | 🧮Reasoning | ok | $0.096 | 448ms | — | 0.30 | 0.90 | |
| openrouter | llama-3.1-70b-instruct | 💻Code Gen | ok | $0.096 | 824ms | — | 0.40 | 0.40 | |
| openrouter | seed-1.6-flash | 🔍Context Recall | pass | $0.096 | 212ms | — | 0.07 | 0.30 | |
| openrouter | llama-3.1-70b-instruct | 🔍Context Recall | pass | $0.096 | 859ms | — | 0.40 | 0.40 | |
| together | gpt-oss-120b | 🧮Reasoning | ok | $0.097 | 1998ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-32b | 🔍Context Recall | pass | $0.097 | 393ms | — | 0.08 | 0.28 | |
| openrouter | devstral-2512 | 🧮Reasoning | ok | $0.098 | 474ms | — | 0.40 | 2.00 | |
| deepinfra | DeepSeek-V3 | 🔍Context Recall | pass | $0.099 | 6374ms | — | 0.32 | 0.89 | |
| fireworks | gpt-oss-120b | 🔍Context Recall | pass | $0.099 | 747ms | — | 0.15 | 0.60 | |
| openrouter | qwen-plus-2025-07-28 | 💻Code Gen | ok | $0.100 | 236ms | — | 0.26 | 0.78 | |
| together | gemma-4-31B-it | 🔧Tool Use | pass | $0.101 | 3695ms | — | 0.39 | 0.97 | |
| groq | gpt-oss-120b | 🧮Reasoning | ok | $0.101 | 418ms | — | 0.15 | 0.75 | |
| deepinfra | Qwen3-30B-A3B | 🔧Tool Use | pass | $0.101 | 3576ms | — | 0.12 | 0.50 | |
| openrouter | llama-3.2-1b-instruct | 🚀Throughput | ok | $0.102 | 699ms | — | 0.03 | 0.20 | |
| anthropic | claude-sonnet-4-6 | ⚡Ping | ok | $0.102 | 1663ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | ⚡Ping | ok | $0.102 | 2012ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🧮Reasoning | ok | $0.102 | 1059ms | — | 0.23 | 2.30 | |
| openrouter | mistral-small-3.2-24b-instruct | 🚀Throughput | ok | $0.102 | 301ms | — | 0.07 | 0.20 | |
| openrouter | skyfall-36b-v2 | ⚡Ping | ok | $0.103 | 916ms | — | 0.55 | 0.80 | |
| openrouter | minimax-m3 | { }JSON Output | pass | $0.103 | 866ms | — | 0.30 | 1.20 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🧮Reasoning | ok | $0.104 | 623ms | — | 0.21 | 1.90 | |
| openrouter | ernie-4.5-vl-424b-a47b | 🔍Context Recall | pass | $0.104 | 1208ms | — | 0.42 | 1.25 | |
| together | gpt-oss-120b | 🔍Context Recall | pass | $0.104 | 1556ms | — | 0.15 | 0.60 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🧮Reasoning | ok | $0.104 | 647ms | — | 0.60 | 2.40 | |
| openrouter | morph-v3-fast | 🧮Reasoning | ok | $0.105 | 393ms | — | 0.80 | 1.20 | |
| openrouter | qwen-plus | 💻Code Gen | ok | $0.105 | 319ms | — | 0.26 | 0.78 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | ⚡Ping | ok | $0.106 | 7813ms | — | 0.50 | 2.20 | |
| openrouter | ministral-14b-2512 | 🚀Throughput | ok | $0.107 | 419ms | — | 0.20 | 0.20 | |
| deepinfra | gpt-oss-20b | 🚀Throughput | ok | $0.108 | 11594ms | — | 0.03 | 0.14 | |
| deepinfra | phi-4 | 🚀Throughput | ok | $0.108 | 10009ms | — | 0.07 | 0.14 | |
| openrouter | qwen2.5-vl-72b-instruct | 💻Code Gen | ok | $0.109 | 798ms | — | 0.80 | 1.00 | |
| deepinfra | DeepSeek-V3 | 💻Code Gen | ok | $0.109 | 10597ms | — | 0.32 | 0.89 | |
| openrouter | seed-2.0-mini | 🧮Reasoning | ok | $0.109 | 797ms | — | 0.10 | 0.40 | |
| openrouter | codestral-2508 | 💻Code Gen | ok | $0.109 | 736ms | — | 0.30 | 0.90 | |
| openrouter | gemma-2-27b-it | 💻Code Gen | ok | $0.109 | 385ms | — | 0.65 | 0.65 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🔍Context Recall | pass | $0.109 | 314ms | — | 0.21 | 1.90 | |
| openrouter | qwen3-14b | 💻Code Gen | ok | $0.110 | 415ms | — | 0.23 | 0.91 | |
| openrouter | minimax-m2-her | { }JSON Output | pass | $0.110 | 906ms | — | 0.30 | 1.20 | |
| groq | gpt-oss-120b | 🔍Context Recall | pass | $0.112 | 586ms | — | 0.15 | 0.75 | |
| deepinfra | NVIDIA-Nemotron-3-Super-120B-A12B | 🔧Tool Use | pass | $0.112 | 9760ms | — | 0.09 | 0.40 | |
| openrouter | mercury-2 | 🔍Context Recall | pass | $0.113 | 634ms | — | 0.25 | 0.75 | |
| openai | gpt-3.5-turbo | 🔍Context Recall | pass | $0.113 | 1558ms | — | 0.50 | 1.50 | |
| openrouter | deepseek-chat-v3-0324 | 🔍Context Recall | pass | $0.115 | 1113ms | — | 0.29 | 1.14 | |
| openrouter | mistral-medium-3.1 | 🔍Context Recall | pass | $0.115 | 492ms | — | 0.40 | 2.00 | |
| openrouter | mistral-medium-3 | 🔍Context Recall | pass | $0.115 | 897ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🔍Context Recall | pass | $0.115 | 459ms | — | 0.40 | 2.00 | |
| openrouter | mercury-2 | { }JSON Output | pass | $0.116 | 402ms | — | 0.25 | 0.75 | |
| openrouter | glm-4.5-air | ⚡Ping | ok | $0.119 | 577ms | — | 0.13 | 0.85 | |
| openrouter | seed-1.6 | ⚡Ping | ok | $0.120 | 985ms | — | 0.25 | 2.00 | |
| openrouter | l3.1-euryale-70b | 💻Code Gen | ok | $0.120 | 313ms | — | 0.85 | 0.85 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 💻Code Gen | ok | $0.120 | 2606ms | — | 0.09 | 1.10 | |
| openai | gpt-4.1-mini | 🔍Context Recall | pass | $0.121 | 894ms | — | 0.40 | 1.60 | |
| openrouter | nova-lite-v1 | 🚀Throughput | ok | $0.122 | 1212ms | — | 0.06 | 0.24 | |
| openrouter | laguna-xs-2.1 | 💻Code Gen | ok | $0.122 | 652ms | — | 0.06 | 0.12 | |
| openrouter | mimo-v2.5 | 💻Code Gen | ok | $0.123 | 1745ms | — | 0.14 | 0.28 | |
| deepinfra | L3.1-70B-Euryale-v2.2 | 💻Code Gen | ok | $0.123 | 2998ms | — | 0.85 | 0.85 | |
| openai | gpt-4.1-mini-2025-04-14 | 🔍Context Recall | pass | $0.124 | 1229ms | — | 0.40 | 1.60 | |
| deepinfra | MythoMax-L2-13b | 🔍Context Recall | pass | $0.125 | 1620ms | — | 0.40 | 0.40 | |
| openrouter | qwen3-30b-a3b | { }JSON Output | pass | $0.125 | 867ms | — | 0.12 | 0.50 | |
| openrouter | step-3.5-flash | { }JSON Output | pass | $0.127 | 902ms | — | 0.10 | 0.30 | |
| groq | gpt-oss-120b | { }JSON Output | pass | $0.127 | 485ms | — | 0.15 | 0.75 | |
| openrouter | hy3-preview | 🧮Reasoning | ok | $0.127 | 1774ms | — | 0.18 | 0.60 | |
| fireworks | gpt-oss-120b | { }JSON Output | pass | $0.127 | 1058ms | — | 0.15 | 0.60 | |
| deepinfra | gpt-oss-120b-Turbo | { }JSON Output | pass | $0.128 | 1805ms | — | 0.15 | 0.60 | |
| openrouter | remm-slerp-l2-13b | 🔍Context Recall | pass | $0.128 | 534ms | — | 0.35 | 0.65 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | { }JSON Output | pass | $0.129 | 1234ms | — | 0.60 | 2.40 | |
| openrouter | minimax-m2-her | 🧮Reasoning | ok | $0.129 | 1507ms | — | 0.30 | 1.20 | |
| deepinfra | MiniMax-M2.7-Turbo | ⚡Ping | ok | $0.129 | 3102ms | — | 0.38 | 1.70 | |
| openrouter | nova-2-lite-v1 | { }JSON Output | pass | $0.131 | 1112ms | — | 0.30 | 2.50 | |
| deepinfra | DeepSeek-V3 | 🔧Tool Use | pass | $0.134 | 5631ms | — | 0.32 | 0.89 | |
| openrouter | deepseek-chat-v3-0324 | 💻Code Gen | ok | $0.136 | 1536ms | — | 0.29 | 1.14 | |
| deepinfra | DeepSeek-V4-Flash | 🚀Throughput | ok | $0.139 | 18463ms | — | 0.09 | 0.18 | |
| openrouter | nova-pro-v1 | { }JSON Output | pass | $0.139 | 910ms | — | 0.80 | 3.20 | |
| openrouter | minimax-m2.7 | ⚡Ping | ok | $0.142 | 1436ms | — | 0.30 | 1.20 | |
| openrouter | qwen3-coder-30b-a3b-instruct | 🚀Throughput | ok | $0.143 | 1012ms | — | 0.07 | 0.28 | |
| openrouter | qwen3-32b | 🚀Throughput | ok | $0.143 | 854ms | — | 0.08 | 0.28 | |
| openrouter | minimax-01 | ⚡Ping | ok | $0.145 | 3892ms | — | 0.20 | 1.10 | |
| openrouter | hermes-3-llama-3.1-405b | 💻Code Gen | ok | $0.145 | 614ms | — | 1.00 | 1.00 | |
| openrouter | qwen3-30b-a3b | 🔍Context Recall | pass | $0.145 | 475ms | — | 0.12 | 0.50 | |
| openrouter | trinity-large-thinking | 🧮Reasoning | ok | $0.149 | 404ms | — | 0.25 | 0.80 | |
| openrouter | minimax-m2-her | 🔍Context Recall | pass | $0.151 | 893ms | — | 0.30 | 1.20 | |
| openrouter | qwen3-30b-a3b-instruct-2507 | 🚀Throughput | ok | $0.153 | 539ms | — | 0.09 | 0.30 | |
| deepinfra | Nemotron-3-Nano-30B-A3B | 🚀Throughput | ok | $0.153 | 4822ms | — | 0.05 | 0.20 | |
| deepinfra | Seed-2.0-code | ⚡Ping | ok | $0.153 | 2418ms | — | 0.50 | 3.00 | |
| deepinfra | Mistral-Small-3.2-24B-Instruct-2506 | 🚀Throughput | ok | $0.154 | 16431ms | — | 0.07 | 0.20 | |
| together | Qwen3.5-9B | { }JSON Output | pass | $0.154 | 7254ms | — | 0.17 | 0.25 | |
| openrouter | llama-4-scout | 🚀Throughput | ok | $0.154 | 393ms | — | 0.10 | 0.30 | |
| openrouter | step-3.5-flash | 🚀Throughput | ok | $0.154 | 1609ms | — | 0.10 | 0.30 | |
| openrouter | deepseek-chat-v3.1 | 💻Code Gen | ok | $0.155 | 1714ms | — | 0.25 | 0.95 | |
| openrouter | qwen3-coder-plus | { }JSON Output | pass | $0.156 | 891ms | — | 0.65 | 3.25 | |
| together | gpt-oss-20b | 🚀Throughput | ok | $0.156 | 6864ms | — | 0.05 | 0.20 | |
| together | gpt-oss-120b | 💻Code Gen | ok | $0.158 | 2756ms | — | 0.15 | 0.60 | |
| deepinfra | Hermes-3-Llama-3.1-70B | 🔍Context Recall | pass | $0.158 | 2249ms | — | 0.70 | 0.70 | |
| openrouter | seed-1.6-flash | 🚀Throughput | ok | $0.158 | 206ms | — | 0.07 | 0.30 | |
| deepinfra | MiniMax-M3 | { }JSON Output | pass | $0.159 | 7416ms | — | 0.28 | 1.10 | |
| openai | gpt-3.5-turbo | 💻Code Gen | ok | $0.161 | 2206ms | — | 0.50 | 1.50 | |
| openrouter | mistral-medium-3 | 🧮Reasoning | ok | $0.162 | 436ms | — | 0.40 | 2.00 | |
| openrouter | glm-5v-turbo | ⚡Ping | ok | $0.162 | 2034ms | — | 1.20 | 4.00 | |
| openrouter | morph-v3-fast | { }JSON Output | pass | $0.164 | 371ms | — | 0.80 | 1.20 | |
| openrouter | qwen3-max | { }JSON Output | pass | $0.164 | 993ms | — | 0.78 | 3.90 | |
| openrouter | llama-3.3-70b-instruct | 🚀Throughput | ok | $0.164 | 787ms | — | 0.10 | 0.32 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔍Context Recall | pass | $0.166 | 659ms | — | 0.60 | 2.40 | |
| fireworks | kimi-k2p6 | ⚡Ping | ok | $0.166 | 862ms | — | 0.95 | 4.00 | |
| openrouter | llama-3.2-3b-instruct | 🚀Throughput | ok | $0.167 | 519ms | — | 0.05 | 0.33 | |
| openrouter | mercury-2 | 🧮Reasoning | ok | $0.168 | 641ms | — | 0.25 | 0.75 | |
| openrouter | qwen3-30b-a3b | 🧮Reasoning | ok | $0.169 | 926ms | — | 0.12 | 0.50 | |
| deepinfra | MiniMax-M3 | 🧮Reasoning | ok | $0.169 | 9601ms | — | 0.28 | 1.10 | |
| openai | gpt-4-turbo-2024-04-09 | ⚡Ping | ok | $0.170 | 2187ms | — | 10.00 | 30.00 | |
| anthropic | claude-opus-4-6 | ⚡Ping | ok | $0.170 | 1628ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | ⚡Ping | ok | $0.170 | 1715ms | — | 5.00 | 25.00 | |
| openrouter | aion-3.0-mini | ⚡Ping | ok | $0.171 | 1550ms | — | 0.70 | 1.40 | |
| openai | gpt-4.1-mini | 💻Code Gen | ok | $0.171 | 1276ms | — | 0.40 | 1.60 | |
| fireworks | gpt-oss-120b | 💻Code Gen | ok | $0.172 | 1122ms | — | 0.15 | 0.60 | |
| openrouter | gemma-4-26b-a4b-it | 🚀Throughput | ok | $0.173 | 335ms | — | 0.07 | 0.34 | |
| openrouter | qwen3-coder-flash | 💻Code Gen | ok | $0.174 | 394ms | — | 0.20 | 0.97 | |
| openrouter | gemma-4-31b-it | 🚀Throughput | ok | $0.174 | 518ms | — | 0.09 | 0.34 | |
| deepinfra | Qwen3-30B-A3B | 🧮Reasoning | ok | $0.174 | 5722ms | — | 0.12 | 0.50 | |
| openrouter | kimi-k2.6 | ⚡Ping | ok | $0.174 | 1301ms | — | 0.95 | 4.00 | |
| openrouter | morph-v3-fast | 💻Code Gen | ok | $0.175 | 373ms | — | 0.80 | 1.20 | |
| openrouter | gemma-2-27b-it | 🔍Context Recall | pass | $0.176 | 438ms | — | 0.65 | 0.65 | |
| openrouter | minimax-01 | { }JSON Output | pass | $0.176 | 884ms | — | 0.20 | 1.10 | |
| openrouter | qwen3-coder-plus | 🧮Reasoning | ok | $0.177 | 2616ms | — | 0.65 | 3.25 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🔍Context Recall | pass | $0.177 | 319ms | — | 0.66 | 1.00 | |
| deepinfra | MiMo-V2.5 | 🔍Context Recall | pass | $0.178 | 2566ms | — | 0.40 | 2.00 | |
| openrouter | skyfall-36b-v2 | 🧮Reasoning | ok | $0.178 | 878ms | — | 0.55 | 0.80 | |
| openrouter | mimo-v2.5 | 🚀Throughput | ok | $0.179 | 5709ms | — | 0.14 | 0.28 | |
| deepinfra | Qwen3.6-35B-A3B | ⚡Ping | ok | $0.180 | 14723ms | — | 0.10 | 0.95 | |
| openrouter | hermes-4-405b | { }JSON Output | pass | $0.182 | 438ms | — | 1.00 | 3.00 | |
| deepinfra | Step-3.7-Flash | 🔍Context Recall | pass | $0.183 | 1498ms | — | 0.20 | 1.15 | |
| deepinfra | GLM-4.7 | ⚡Ping | ok | $0.183 | 7063ms | — | 0.40 | 1.75 | |
| openrouter | ernie-4.5-vl-424b-a47b | 💻Code Gen | ok | $0.183 | 1301ms | — | 0.42 | 1.25 | |
| openrouter | hermes-4-405b | 🧮Reasoning | ok | $0.185 | 446ms | — | 1.00 | 3.00 | |
| deepinfra | MiniMax-M3 | 🔧Tool Use | pass | $0.186 | 5571ms | — | 0.28 | 1.10 | |
| openrouter | nova-2-lite-v1 | 🧮Reasoning | ok | $0.186 | 1224ms | — | 0.30 | 2.50 | |
| openrouter | step-3.5-flash | 🔍Context Recall | pass | $0.187 | 1551ms | — | 0.10 | 0.30 | |
| openrouter | minimax-m2-her | 💻Code Gen | ok | $0.188 | 820ms | — | 0.30 | 1.20 | |
| deepinfra | gpt-oss-120b-Turbo | 💻Code Gen | ok | $0.189 | 2629ms | — | 0.15 | 0.60 | |
| deepinfra | Seed-2.0-mini | 🧮Reasoning | ok | $0.190 | 6387ms | — | 0.10 | 0.40 | |
| anthropic | claude-opus-4-8 | ⚡Ping | ok | $0.190 | 1095ms | — | 5.00 | 25.00 | |
| openrouter | deepseek-v3.1-terminus | 💻Code Gen | ok | $0.190 | 1439ms | — | 0.27 | 1.00 | |
| openrouter | qwen3.5-35b-a3b | ⚡Ping | ok | $0.190 | 624ms | — | 0.31 | 1.25 | |
| openai | gpt-4.1-mini-2025-04-14 | 💻Code Gen | ok | $0.190 | 1560ms | — | 0.40 | 1.60 | |
| openrouter | l3.1-euryale-70b | 🔍Context Recall | pass | $0.190 | 586ms | — | 0.85 | 0.85 | |
| deepinfra | MythoMax-L2-13b | 🚀Throughput | ok | $0.193 | 9233ms | — | 0.40 | 0.40 | |
| openrouter | mercury-2 | 💻Code Gen | ok | $0.195 | 367ms | — | 0.25 | 0.75 | |
| openrouter | kimi-k2.5 | ⚡Ping | ok | $0.196 | 811ms | — | 0.45 | 2.25 | |
| together | Qwen3.5-9B | 🚀Throughput | ok | $0.196 | 8705ms | — | 0.17 | 0.25 | |
| openrouter | perceptron-mk1 | 💻Code Gen | ok | $0.196 | 438ms | — | 0.15 | 1.50 | |
| together | MiniMax-M3 | { }JSON Output | pass | $0.197 | 1634ms | — | 0.30 | 1.20 | |
| deepinfra | MiniMax-M2.7-Turbo | 🔧Tool Use | pass | $0.197 | 2362ms | — | 0.38 | 1.70 | |
| openrouter | qwen2.5-vl-72b-instruct | 🔍Context Recall | pass | $0.197 | 869ms | — | 0.80 | 1.00 | |
| deepinfra | Qwen3-30B-A3B | 🔍Context Recall | pass | $0.199 | 3275ms | — | 0.12 | 0.50 | |
| openrouter | hy3-preview | { }JSON Output | pass | $0.200 | 2002ms | — | 0.18 | 0.60 | |
| openrouter | aion-rp-llama-3.1-8b | 🧮Reasoning | ok | $0.204 | 864ms | — | 0.80 | 1.60 | |
| openrouter | seed-2.0-mini | 🚀Throughput | ok | $0.208 | 676ms | — | 0.10 | 0.40 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 💻Code Gen | ok | $0.208 | 330ms | — | 0.21 | 1.90 | |
| together | Qwen3.5-9B | 🔍Context Recall | pass | $0.209 | 7238ms | — | 0.17 | 0.25 | |
| openrouter | skyfall-36b-v2 | 💻Code Gen | ok | $0.210 | 432ms | — | 0.55 | 0.80 | |
| openrouter | deepseek-v3.2 | 🚀Throughput | ok | $0.211 | 834ms | — | 0.27 | 0.40 | |
| openrouter | kimi-k2 | 🔍Context Recall | pass | $0.213 | 1232ms | — | 0.57 | 2.30 | |
| openrouter | glm-4.5-air | { }JSON Output | pass | $0.214 | 1615ms | — | 0.13 | 0.85 | |
| openrouter | deepseek-v3.2-exp | 🚀Throughput | ok | $0.214 | 2530ms | — | 0.27 | 0.41 | |
| openrouter | unslopnemo-12b | 🚀Throughput | ok | $0.214 | 623ms | — | 0.40 | 0.40 | |
| openrouter | minimax-m2.1 | ⚡Ping | ok | $0.217 | 1636ms | — | 0.30 | 1.20 | |
| openrouter | llama-3.1-70b-instruct | 🚀Throughput | ok | $0.218 | 1354ms | — | 0.40 | 0.40 | |
| openrouter | qwen3.6-flash | ⚡Ping | ok | $0.218 | 413ms | — | 0.19 | 1.13 | |
| openrouter | kimi-k2-thinking | ⚡Ping | ok | $0.221 | 610ms | — | 0.60 | 2.50 | |
| openrouter | hermes-3-llama-3.1-405b | 🔍Context Recall | pass | $0.222 | 658ms | — | 1.00 | 1.00 | |
| openrouter | minimax-m2 | { }JSON Output | pass | $0.224 | 1361ms | — | 0.26 | 1.02 | |
| openrouter | glm-4.6v | { }JSON Output | pass | $0.226 | 1013ms | — | 0.30 | 0.90 | |
| openrouter | kimi-k2-0905 | 🔍Context Recall | pass | $0.228 | 717ms | — | 0.60 | 2.50 | |
| openrouter | glm-4.6v | 🧮Reasoning | ok | $0.229 | 987ms | — | 0.30 | 0.90 | |
| deepinfra | MiMo-V2.5 | { }JSON Output | pass | $0.230 | 8142ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 💻Code Gen | ok | $0.235 | 594ms | — | 0.40 | 2.00 | |
| deepinfra | L3.1-70B-Euryale-v2.2 | 🔍Context Recall | pass | $0.235 | 2534ms | — | 0.85 | 0.85 | |
| together | MiniMax-M3 | 🧮Reasoning | ok | $0.236 | 1972ms | — | 0.30 | 1.20 | |
| anthropic | claude-haiku-4-5-20251001 | 🧮Reasoning | ok | $0.237 | 914ms | — | 1.00 | 5.00 | |
| openrouter | mistral-medium-3.1 | 💻Code Gen | ok | $0.237 | 576ms | — | 0.40 | 2.00 | |
| openrouter | skyfall-36b-v2 | 🔍Context Recall | pass | $0.237 | 454ms | — | 0.55 | 0.80 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🧮Reasoning | ok | $0.238 | 1522ms | — | 0.63 | 3.13 | |
| openrouter | minimax-m3 | 🧮Reasoning | ok | $0.238 | 960ms | — | 0.30 | 1.20 | |
| openrouter | mistral-medium-3 | 💻Code Gen | ok | $0.239 | 505ms | — | 0.40 | 2.00 | |
| deepinfra | Step-3.7-Flash | 🔧Tool Use | pass | $0.240 | 1772ms | — | 0.20 | 1.15 | |
| deepinfra | Qwen3-Max-Thinking | { }JSON Output | pass | $0.240 | 2677ms | — | 1.20 | 6.00 | |
| openrouter | grok-4.20 | ⚡Ping | ok | $0.241 | 797ms | — | 1.25 | 2.50 | |
| deepinfra | Step-3.7-Flash | { }JSON Output | pass | $0.242 | 2071ms | — | 0.20 | 1.15 | |
| openrouter | qwen3-coder-plus | 🔍Context Recall | pass | $0.243 | 919ms | — | 0.65 | 3.25 | |
| openrouter | step-3.5-flash | 🧮Reasoning | ok | $0.243 | 2697ms | — | 0.10 | 0.30 | |
| openrouter | qwen3.6-35b-a3b | ⚡Ping | ok | $0.246 | 1158ms | — | 0.10 | 0.90 | |
| openrouter | minimax-m3 | 🔍Context Recall | pass | $0.247 | 1185ms | — | 0.30 | 1.20 | |
| deepinfra | Qwen3-Max | { }JSON Output | pass | $0.252 | 2044ms | — | 1.20 | 6.00 | |
| openrouter | qwen3.6-flash | { }JSON Output | pass | $0.252 | 250ms | — | 0.19 | 1.13 | |
| openrouter | nova-2-lite-v1 | 🔍Context Recall | pass | $0.254 | 559ms | — | 0.30 | 2.50 | |
| openrouter | qwen3-30b-a3b | 🚀Throughput | ok | $0.255 | 342ms | — | 0.12 | 0.50 | |
| openrouter | kimi-k2 | 💻Code Gen | ok | $0.256 | 1398ms | — | 0.57 | 2.30 | |
| openrouter | minimax-01 | 🧮Reasoning | ok | $0.258 | 786ms | — | 0.20 | 1.10 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔧Tool Use | pass | $0.259 | 804ms | — | 0.60 | 2.40 | |
| deepinfra | gemma-4-26B-A4B-it | 🚀Throughput | ok | $0.260 | 17762ms | — | 0.07 | 0.34 | |
| openrouter | qwen3-max | 🧮Reasoning | ok | $0.264 | 897ms | — | 0.78 | 3.90 | |
| anthropic | claude-opus-4-7 | ⚡Ping | ok | $0.265 | 970ms | — | 5.00 | 25.00 | |
| together | gemma-4-31B-it | 🔍Context Recall | pass | $0.268 | 10353ms | — | 0.39 | 0.97 | |
| openrouter | minimax-01 | 💻Code Gen | ok | $0.270 | 780ms | — | 0.20 | 1.10 | |
| openai | gpt-4.1-2025-04-14 | 🔧Tool Use | pass | $0.270 | 751ms | — | 2.00 | 8.00 | |
| openai | gpt-4.1 | 🔧Tool Use | pass | $0.270 | 764ms | — | 2.00 | 8.00 | |
| openrouter | step-3.7-flash | 🔍Context Recall | pass | $0.271 | 3338ms | — | 0.20 | 1.15 | |
| openrouter | minimax-m2.7 | 🔍Context Recall | pass | $0.272 | 2214ms | — | 0.30 | 1.20 | |
| openrouter | hy3-preview | 🔍Context Recall | pass | $0.273 | 1842ms | — | 0.18 | 0.60 | |
| deepinfra | MiniMax-M3 | 🔍Context Recall | pass | $0.274 | 11129ms | — | 0.28 | 1.10 | |
| openrouter | qwen3-max | 🔍Context Recall | pass | $0.276 | 975ms | — | 0.78 | 3.90 | |
| openrouter | deepseek-r1 | ⚡Ping | ok | $0.277 | 870ms | — | 0.70 | 2.50 | |
| together | MiniMax-M3 | 🔧Tool Use | pass | $0.283 | 1868ms | — | 0.30 | 1.20 | |
| openrouter | glm-4.5v | { }JSON Output | pass | $0.283 | 1925ms | — | 0.60 | 1.80 | |
| openai | gpt-4.1 | { }JSON Output | pass | $0.290 | 812ms | — | 2.00 | 8.00 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 💻Code Gen | ok | $0.292 | 1127ms | — | 0.60 | 2.40 | |
| openai | gpt-4.1 | 🧮Reasoning | ok | $0.292 | 986ms | — | 2.00 | 8.00 | |
| anthropic | claude-haiku-4-5-20251001 | { }JSON Output | pass | $0.294 | 1136ms | — | 1.00 | 5.00 | |
| openrouter | hermes-4-405b | 🔍Context Recall | pass | $0.295 | 450ms | — | 1.00 | 3.00 | |
| deepinfra | MiMo-V2.5 | 🔧Tool Use | pass | $0.296 | 3940ms | — | 0.40 | 2.00 | |
| groq | gpt-oss-120b | 💻Code Gen | ok | $0.298 | 973ms | — | 0.15 | 0.75 | |
| openrouter | step-3.7-flash | { }JSON Output | pass | $0.299 | 1897ms | — | 0.20 | 1.15 | |
| openrouter | mistral-medium-3-5 | 🧮Reasoning | ok | $0.300 | 978ms | — | 1.50 | 7.50 | |
| openrouter | kimi-k2-0905 | 💻Code Gen | ok | $0.300 | 750ms | — | 0.60 | 2.50 | |
| openrouter | seed-1.6 | { }JSON Output | pass | $0.301 | 543ms | — | 0.25 | 2.00 | |
| openrouter | qwen3.5-27b | ⚡Ping | ok | $0.301 | 344ms | — | 0.20 | 1.56 | |
| openrouter | minimax-m2.1 | { }JSON Output | pass | $0.302 | 1942ms | — | 0.30 | 1.20 | |
| openrouter | command-r-08-2024 | 🚀Throughput | ok | $0.304 | 397ms | — | 0.15 | 0.60 | |
| openrouter | magnum-v4-72b | { }JSON Output | pass | $0.305 | 858ms | — | 2.50 | 5.00 | |
| openrouter | qwen3-vl-30b-a3b-instruct | 🚀Throughput | ok | $0.306 | 682ms | — | 0.15 | 0.60 | |
| openai | gpt-4.1-nano | 🚀Throughput | ok | $0.306 | 8081ms | — | 0.10 | 0.40 | |
| openrouter | mistral-small-2603 | 🚀Throughput | ok | $0.307 | 429ms | — | 0.15 | 0.60 | |
| openrouter | hy3-preview | 🚀Throughput | ok | $0.308 | 2438ms | — | 0.18 | 0.60 | |
| deepinfra | Qwen3.5-122B-A10B | 🔧Tool Use | pass | $0.309 | 1362ms | — | 0.29 | 2.40 | |
| openrouter | mistral-saba | 🚀Throughput | ok | $0.309 | 798ms | — | 0.20 | 0.60 | |
| openrouter | minimax-01 | 🔍Context Recall | pass | $0.310 | 1951ms | — | 0.20 | 1.10 | |
| together | MiniMax-M3 | 🔍Context Recall | pass | $0.313 | 2062ms | — | 0.30 | 1.20 | |
| fireworks | glm-5p2 | 🔧Tool Use | pass | $0.313 | 1261ms | — | 0.95 | 3.00 | |
| openrouter | qwen3.7-plus | ⚡Ping | ok | $0.314 | 662ms | — | 0.32 | 1.28 | |
| openrouter | trinity-large-thinking | 🔍Context Recall | pass | $0.316 | 472ms | — | 0.25 | 0.80 | |
| openrouter | grok-4.20 | 🧮Reasoning | ok | $0.316 | 673ms | — | 1.25 | 2.50 | |
| deepinfra | Step-3.7-Flash | ⚡Ping | ok | $0.317 | 2151ms | — | 0.20 | 1.15 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔧Tool Use | pass | $0.321 | 2730ms | — | 0.50 | 2.20 | |
| openrouter | glm-4.5-air | 🔍Context Recall | pass | $0.322 | 683ms | — | 0.13 | 0.85 | |
| deepinfra | GLM-4.7 | 🔧Tool Use | pass | $0.324 | 48338ms | — | 0.40 | 1.75 | |
| openrouter | trinity-large-thinking | { }JSON Output | pass | $0.325 | 960ms | — | 0.25 | 0.80 | |
| openrouter | qwen3-14b | { }JSON Output | pass | $0.328 | 398ms | — | 0.23 | 0.91 | |
| openrouter | mistral-medium-3-5 | { }JSON Output | pass | $0.329 | 473ms | — | 1.50 | 7.50 | |
| openrouter | qwen3-next-80b-a3b-thinking | ⚡Ping | ok | $0.329 | 619ms | — | 0.15 | 1.20 | |
| openrouter | mixtral-8x22b-instruct | { }JSON Output | pass | $0.330 | 572ms | — | 2.00 | 6.00 | |
| deepinfra | GLM-5.1 | 🔧Tool Use | pass | $0.337 | 1707ms | — | 1.05 | 3.50 | |
| openai | gpt-4o | 🔧Tool Use | pass | $0.338 | 949ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | 🔧Tool Use | pass | $0.338 | 627ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-08-06 | 🔧Tool Use | pass | $0.338 | 797ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-05-13 | 🔧Tool Use | pass | $0.338 | 2605ms | — | 2.50 | 10.00 | |
| openrouter | mistral-large | 🧮Reasoning | ok | $0.338 | 827ms | — | 2.00 | 6.00 | |
| deepinfra | MiMo-V2.5 | 🧮Reasoning | ok | $0.342 | 4930ms | — | 0.40 | 2.00 | |
| openrouter | glm-4.7 | ⚡Ping | ok | $0.346 | 1623ms | — | 0.40 | 1.75 | |
| openrouter | qwen3-32b | 💻Code Gen | ok | $0.347 | 905ms | — | 0.08 | 0.28 | |
| openai | gpt-4.1-2025-04-14 | 🧮Reasoning | ok | $0.348 | 853ms | — | 2.00 | 8.00 | |
| openrouter | qwen3-14b | 🧮Reasoning | ok | $0.348 | 419ms | — | 0.23 | 0.91 | |
| openrouter | remm-slerp-l2-13b | 🚀Throughput | ok | $0.349 | 499ms | — | 0.35 | 0.65 | |
| openrouter | gemma-2-27b-it | 🚀Throughput | ok | $0.350 | 483ms | — | 0.65 | 0.65 | |
| openrouter | qwen3-14b | 🔍Context Recall | pass | $0.352 | 813ms | — | 0.23 | 0.91 | |
| openai | gpt-4o-2024-08-06 | { }JSON Output | pass | $0.352 | 737ms | — | 2.50 | 10.00 | |
| openrouter | seed-1.6-flash | 💻Code Gen | ok | $0.354 | 219ms | — | 0.07 | 0.30 | |
| openai | gpt-4.1-2025-04-14 | { }JSON Output | pass | $0.354 | 807ms | — | 2.00 | 8.00 | |
| openrouter | qwen3-coder-plus | 💻Code Gen | ok | $0.355 | 845ms | — | 0.65 | 3.25 | |
| openrouter | llama-4-maverick | 🚀Throughput | ok | $0.356 | 1199ms | — | 0.20 | 0.70 | |
| openrouter | hermes-4-405b | 💻Code Gen | ok | $0.357 | 425ms | — | 1.00 | 3.00 | |
| openrouter | mistral-large | { }JSON Output | pass | $0.360 | 1474ms | — | 2.00 | 6.00 | |
| openai | gpt-4o-2024-11-20 | { }JSON Output | pass | $0.362 | 773ms | — | 2.50 | 10.00 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | ⚡Ping | ok | $0.363 | 455ms | — | 0.20 | 2.40 | |
| deepinfra | Seed-1.8 | 🔍Context Recall | pass | $0.366 | 4234ms | — | 0.25 | 2.00 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | { }JSON Output | pass | $0.368 | 5610ms | — | 0.50 | 2.20 | |
| openai | gpt-4o | { }JSON Output | pass | $0.372 | 1074ms | — | 2.50 | 10.00 | |
| openrouter | grok-4.20 | { }JSON Output | pass | $0.375 | 712ms | — | 1.25 | 2.50 | |
| openrouter | mercury-2 | 🚀Throughput | ok | $0.380 | 368ms | — | 0.25 | 0.75 | |
| openrouter | minimax-m2.7 | 🧮Reasoning | ok | $0.382 | 1336ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2 | 🔍Context Recall | pass | $0.382 | 1007ms | — | 0.26 | 1.02 | |
| deepinfra | Qwen3-30B-A3B | 🚀Throughput | ok | $0.383 | 7315ms | — | 0.12 | 0.50 | |
| openrouter | minimax-m2 | 🧮Reasoning | ok | $0.383 | 1521ms | — | 0.26 | 1.02 | |
| openrouter | qwen3.5-plus-20260420 | ⚡Ping | ok | $0.387 | 558ms | — | 0.30 | 1.80 | |
| openrouter | mixtral-8x22b-instruct | 🧮Reasoning | ok | $0.392 | 635ms | — | 2.00 | 6.00 | |
| openrouter | nova-pro-v1 | 🔍Context Recall | pass | $0.395 | 1158ms | — | 0.80 | 3.20 | |
| openrouter | magnum-v4-72b | 🧮Reasoning | ok | $0.398 | 830ms | — | 2.50 | 5.00 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🧮Reasoning | ok | $0.398 | 3287ms | — | 0.50 | 2.20 | |
| openrouter | qwen-plus-2025-07-28 | 🚀Throughput | ok | $0.400 | 281ms | — | 0.26 | 0.78 | |
| openrouter | qwen-plus | 🚀Throughput | ok | $0.400 | 237ms | — | 0.26 | 0.78 | |
| deepinfra | Seed-1.8 | { }JSON Output | pass | $0.403 | 4810ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-coder-next | 🚀Throughput | ok | $0.405 | 995ms | — | 0.12 | 0.80 | |
| deepinfra | Qwen3-Max-Thinking | 🧮Reasoning | ok | $0.406 | 2980ms | — | 1.20 | 6.00 | |
| openrouter | minimax-m2.7 | { }JSON Output | pass | $0.409 | 2753ms | — | 0.30 | 1.20 | |
| openrouter | trinity-large-thinking | 🚀Throughput | ok | $0.410 | 922ms | — | 0.25 | 0.80 | |
| fireworks | glm-5p2 | ⚡Ping | ok | $0.411 | 2466ms | — | 0.95 | 3.00 | |
| openrouter | nova-pro-v1 | 💻Code Gen | ok | $0.417 | 968ms | — | 0.80 | 3.20 | |
| openrouter | minimax-m2.1 | 🔍Context Recall | pass | $0.417 | 1215ms | — | 0.30 | 1.20 | |
| openrouter | aion-3.0 | ⚡Ping | ok | $0.420 | 1756ms | — | 3.00 | 6.00 | |
| openrouter | hy3-preview | 💻Code Gen | ok | $0.423 | 1922ms | — | 0.18 | 0.60 | |
| openrouter | command-r-plus-08-2024 | { }JSON Output | pass | $0.427 | 664ms | — | 2.50 | 10.00 | |
| deepinfra | GLM-5.1 | ⚡Ping | ok | $0.429 | 2807ms | — | 1.05 | 3.50 | |
| openrouter | glm-4.5-air | 🚀Throughput | ok | $0.430 | 998ms | — | 0.13 | 0.85 | |
| deepinfra | Qwen3.6-35B-A3B | 🔍Context Recall | pass | $0.430 | 20608ms | — | 0.10 | 0.95 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 💻Code Gen | ok | $0.431 | 2398ms | — | 0.50 | 2.20 | |
| openrouter | qwen3.5-plus-02-15 | ⚡Ping | ok | $0.432 | 466ms | — | 0.26 | 1.56 | |
| openrouter | mistral-medium-3-5 | 🔍Context Recall | pass | $0.432 | 531ms | — | 1.50 | 7.50 | |
| openrouter | glm-4.6 | ⚡Ping | ok | $0.436 | 861ms | — | 0.43 | 1.75 | |
| openrouter | grok-build-0.1 | ⚡Ping | ok | $0.437 | 914ms | — | 1.00 | 2.00 | |
| openrouter | seed-1.6 | 🔍Context Recall | pass | $0.443 | 721ms | — | 0.25 | 2.00 | |
| openrouter | glm-4.6 | { }JSON Output | pass | $0.444 | 982ms | — | 0.43 | 1.75 | |
| openrouter | qwen3-vl-30b-a3b-thinking | { }JSON Output | pass | $0.444 | 1284ms | — | 0.20 | 2.40 | |
| openrouter | qwen3-vl-8b-thinking | { }JSON Output | pass | $0.448 | 308ms | — | 0.18 | 2.10 | |
| deepinfra | Qwen3-Max-Thinking | 🔍Context Recall | pass | $0.449 | 2550ms | — | 1.20 | 6.00 | |
| deepinfra | Qwen3-Max | 🔍Context Recall | pass | $0.449 | 2118ms | — | 1.20 | 6.00 | |
| openrouter | sonar-pro | { }JSON Output | pass | $0.450 | 3398ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.6-35b-a3b | 🚀Throughput | ok | $0.454 | 1045ms | — | 0.10 | 0.90 | |
| openrouter | l3.1-euryale-70b | 🚀Throughput | ok | $0.459 | 345ms | — | 0.85 | 0.85 | |
| openai | gpt-4o-mini-2024-07-18 | 🚀Throughput | ok | $0.459 | 7279ms | — | 0.15 | 0.60 | |
| openai | gpt-4o-mini | 🚀Throughput | ok | $0.459 | 5384ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-vl-30b-a3b-thinking | ⚡Ping | ok | $0.459 | 270ms | — | 0.20 | 2.40 | |
| openrouter | codestral-2508 | 🚀Throughput | ok | $0.460 | 858ms | — | 0.30 | 0.90 | |
| openrouter | glm-4.6v | 🚀Throughput | ok | $0.461 | 4081ms | — | 0.30 | 0.90 | |
| together | GLM-5.2 | 🔧Tool Use | pass | $0.461 | 495ms | — | 1.40 | 4.40 | |
| openrouter | qwen3.6-27b | ⚡Ping | ok | $0.463 | 1268ms | — | 0.30 | 2.00 | |
| openrouter | qwen3-14b | 🚀Throughput | ok | $0.464 | 397ms | — | 0.23 | 0.91 | |
| openrouter | sonar-pro-search | { }JSON Output | pass | $0.465 | 889ms | — | 3.00 | 15.00 | |
| deepinfra | gpt-oss-120b-Turbo | 🚀Throughput | ok | $0.466 | 6993ms | — | 0.15 | 0.60 | |
| together | gpt-oss-120b | 🚀Throughput | ok | $0.468 | 6060ms | — | 0.15 | 0.60 | |
| fireworks | gpt-oss-120b | 🚀Throughput | ok | $0.469 | 3259ms | — | 0.15 | 0.60 | |
| openrouter | qwen3-30b-a3b | 💻Code Gen | ok | $0.473 | 645ms | — | 0.12 | 0.50 | |
| deepinfra | Seed-2.0-mini | 🔧Tool Use | pass | $0.473 | 10528ms | — | 0.10 | 0.40 | |
| fireworks | kimi-k2p6 | 🔧Tool Use | pass | $0.473 | 1738ms | — | 0.95 | 4.00 | |
| openrouter | glm-5.1 | ⚡Ping | ok | $0.476 | 4767ms | — | 0.97 | 3.04 | |
| openrouter | morph-v3-fast | 🔍Context Recall | pass | $0.479 | 380ms | — | 0.80 | 1.20 | |
| openrouter | aion-3.0-mini | 🧮Reasoning | ok | $0.480 | 694ms | — | 0.70 | 1.40 | |
| openrouter | deepseek-chat-v3.1 | 🚀Throughput | ok | $0.483 | 4356ms | — | 0.25 | 0.95 | |
| openrouter | minimax-m2.1 | 🧮Reasoning | ok | $0.485 | 1027ms | — | 0.30 | 1.20 | |
| deepinfra | Qwen3-Max | 🔧Tool Use | pass | $0.485 | 2145ms | — | 1.20 | 6.00 | |
| openrouter | sonar-pro | 🧮Reasoning | ok | $0.489 | 2674ms | — | 3.00 | 15.00 | |
| deepinfra | Seed-2.0-pro | 🧮Reasoning | ok | $0.490 | 4526ms | — | 0.50 | 3.00 | |
| anthropic | claude-haiku-4-5-20251001 | 🔍Context Recall | pass | $0.492 | 1205ms | — | 1.00 | 5.00 | |
| openrouter | minimax-m2-her | 🚀Throughput | ok | $0.495 | 893ms | — | 0.30 | 1.20 | |
| openrouter | qwen3-coder-flash | 🚀Throughput | ok | $0.495 | 505ms | — | 0.20 | 0.97 | |
| openai | gpt-4o-2024-11-20 | 🧮Reasoning | ok | $0.495 | 818ms | — | 2.50 | 10.00 | |
| deepinfra | Qwen3-Max | 🧮Reasoning | ok | $0.496 | 2835ms | — | 1.20 | 6.00 | |
| openrouter | qwen3-vl-8b-thinking | ⚡Ping | ok | $0.499 | 331ms | — | 0.18 | 2.10 | |
| openrouter | aion-3.0-mini | { }JSON Output | pass | $0.501 | 694ms | — | 0.70 | 1.40 | |
| openrouter | grok-4.20 | 🔍Context Recall | pass | $0.503 | 740ms | — | 1.25 | 2.50 | |
| openai | gpt-4o-2024-05-13 | { }JSON Output | pass | $0.503 | 671ms | — | 2.50 | 10.00 | |
| deepinfra | Seed-2.0-pro | { }JSON Output | pass | $0.504 | 5238ms | — | 0.50 | 3.00 | |
| deepinfra | Seed-1.8 | 🧮Reasoning | ok | $0.504 | 5274ms | — | 0.25 | 2.00 | |
| openrouter | command-a | { }JSON Output | pass | $0.508 | 501ms | — | 2.50 | 10.00 | |
| openrouter | nova-2-lite-v1 | 💻Code Gen | ok | $0.508 | 733ms | — | 0.30 | 2.50 | |
| openrouter | deepseek-v3.1-terminus | 🚀Throughput | ok | $0.510 | 1449ms | — | 0.27 | 1.00 | |
| openrouter | grok-4.3 | ⚡Ping | ok | $0.514 | 660ms | — | 1.25 | 2.50 | |
| openrouter | skyfall-36b-v2 | 🚀Throughput | ok | $0.514 | 400ms | — | 0.55 | 0.80 | |
| deepinfra | Seed-2.0-pro | 🔧Tool Use | pass | $0.516 | 6564ms | — | 0.50 | 3.00 | |
| openrouter | aion-3.0-mini | 🔍Context Recall | pass | $0.517 | 753ms | — | 0.70 | 1.40 | |
| openrouter | minimax-m2 | 💻Code Gen | ok | $0.518 | 1067ms | — | 0.26 | 1.02 | |
| openrouter | glm-5-turbo | ⚡Ping | ok | $0.518 | 7598ms | — | 1.20 | 4.00 | |
| deepinfra | Seed-2.0-pro | 🔍Context Recall | pass | $0.521 | 3985ms | — | 0.50 | 3.00 | |
| openrouter | deepseek-r1 | { }JSON Output | pass | $0.522 | 1180ms | — | 0.70 | 2.50 | |
| openrouter | command-a | 🧮Reasoning | ok | $0.522 | 592ms | — | 2.50 | 10.00 | |
| openrouter | minimax-m2 | 🚀Throughput | ok | $0.523 | 585ms | — | 0.26 | 1.02 | |
| openrouter | mixtral-8x22b-instruct | 🔍Context Recall | pass | $0.524 | 533ms | — | 2.00 | 6.00 | |
| openrouter | kimi-k2-thinking | { }JSON Output | pass | $0.524 | 688ms | — | 0.60 | 2.50 | |
| openrouter | grok-4.20 | 💻Code Gen | ok | $0.529 | 749ms | — | 1.25 | 2.50 | |
| openrouter | seed-2.0-mini | 💻Code Gen | ok | $0.531 | 671ms | — | 0.10 | 0.40 | |
| openrouter | qwen2.5-vl-72b-instruct | 🚀Throughput | ok | $0.535 | 888ms | — | 0.80 | 1.00 | |
| openrouter | qwen-2.5-coder-32b-instruct | 🚀Throughput | ok | $0.539 | 355ms | — | 0.66 | 1.00 | |
| openrouter | hermes-3-llama-3.1-405b | 🚀Throughput | ok | $0.540 | 599ms | — | 1.00 | 1.00 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🔍Context Recall | pass | $0.547 | 5992ms | — | 0.50 | 2.20 | |
| deepinfra | Qwen3-Max-Thinking | 🔧Tool Use | pass | $0.552 | 2700ms | — | 1.20 | 6.00 | |
| deepinfra | GLM-4.7 | { }JSON Output | pass | $0.558 | 23265ms | — | 0.40 | 1.75 | |
| openrouter | qwen3-next-80b-a3b-thinking | 🔍Context Recall | pass | $0.562 | 390ms | — | 0.15 | 1.20 | |
| openrouter | qwen3.6-flash | 🚀Throughput | ok | $0.572 | 248ms | — | 0.19 | 1.13 | |
| fireworks | kimi-k2p6 | { }JSON Output | pass | $0.579 | 2804ms | — | 0.95 | 4.00 | |
| openrouter | deepseek-chat-v3-0324 | 🚀Throughput | ok | $0.580 | 5399ms | — | 0.29 | 1.14 | |
| groq | gpt-oss-120b | 🚀Throughput | ok | $0.582 | 1779ms | — | 0.15 | 0.75 | |
| openrouter | step-3.7-flash | 🚀Throughput | ok | $0.583 | 2299ms | — | 0.20 | 1.15 | |
| openrouter | seed-1.6 | 🧮Reasoning | ok | $0.588 | 541ms | — | 0.25 | 2.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🧮Reasoning | ok | $0.607 | 1314ms | — | 0.20 | 2.40 | |
| together | MiniMax-M3 | 💻Code Gen | ok | $0.611 | 5396ms | — | 0.30 | 1.20 | |
| openrouter | ernie-4.5-vl-424b-a47b | 🚀Throughput | ok | $0.618 | 1384ms | — | 0.42 | 1.25 | |
| openrouter | kimi-k2.5 | { }JSON Output | pass | $0.618 | 713ms | — | 0.45 | 2.25 | |
| openrouter | minimax-m2.7 | 🚀Throughput | ok | $0.621 | 3901ms | — | 0.30 | 1.20 | |
| openrouter | minimax-m2.1 | 🚀Throughput | ok | $0.621 | 866ms | — | 0.30 | 1.20 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🔍Context Recall | pass | $0.622 | 898ms | — | 0.63 | 3.13 | |
| openai | gpt-4o | 🧮Reasoning | ok | $0.625 | 1136ms | — | 2.50 | 10.00 | |
| deepinfra | MiniMax-M2.7-Turbo | 🧮Reasoning | ok | $0.628 | 3604ms | — | 0.38 | 1.70 | |
| openrouter | qwen3.5-35b-a3b | 🚀Throughput | ok | $0.638 | 1205ms | — | 0.31 | 1.25 | |
| openrouter | aion-3.0-mini | 💻Code Gen | ok | $0.638 | 888ms | — | 0.70 | 1.40 | |
| openrouter | mistral-large | 🔍Context Recall | pass | $0.644 | 869ms | — | 2.00 | 6.00 | |
| openrouter | glm-5.2 | ⚡Ping | ok | $0.650 | 627ms | — | 0.97 | 3.04 | |
| openrouter | qwen3.7-plus | 🚀Throughput | ok | $0.653 | 663ms | — | 0.32 | 1.28 | |
| anthropic | claude-sonnet-4-6 | { }JSON Output | pass | $0.657 | 1752ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | { }JSON Output | pass | $0.657 | 1719ms | — | 3.00 | 15.00 | |
| deepinfra | Qwen3.5-122B-A10B | ⚡Ping | ok | $0.658 | 2402ms | — | 0.29 | 2.40 | |
| openrouter | qwen3.7-plus | { }JSON Output | pass | $0.661 | 1016ms | — | 0.32 | 1.28 | |
| openrouter | minimax-m3 | 🚀Throughput | ok | $0.662 | 482ms | — | 0.30 | 1.20 | |
| deepinfra | MiniMax-M2.7-Turbo | { }JSON Output | pass | $0.666 | 3662ms | — | 0.38 | 1.70 | |
| openrouter | magnum-v4-72b | 🔍Context Recall | pass | $0.675 | 699ms | — | 2.50 | 5.00 | |
| deepinfra | L3.1-70B-Euryale-v2.2 | 🚀Throughput | ok | $0.677 | 16859ms | — | 0.85 | 0.85 | |
| openrouter | qwen3-vl-235b-a22b-thinking | 🧮Reasoning | ok | $0.678 | 10042ms | — | 0.40 | 4.00 | |
| together | Qwen3.5-9B | 🧮Reasoning | ok | $0.680 | 31005ms | — | 0.17 | 0.25 | |
| openrouter | qwen3.6-flash | 🔍Context Recall | pass | $0.682 | 445ms | — | 0.19 | 1.13 | |
| deepinfra | Seed-2.0-code | { }JSON Output | pass | $0.683 | 4258ms | — | 0.50 | 3.00 | |
| openai | gpt-4.1 | 🔍Context Recall | pass | $0.684 | 1093ms | — | 2.00 | 8.00 | |
| openrouter | qwen3-vl-8b-thinking | 🧮Reasoning | ok | $0.685 | 366ms | — | 0.18 | 2.10 | |
| deepinfra | Seed-1.8 | 🔧Tool Use | pass | $0.688 | 8286ms | — | 0.25 | 2.00 | |
| deepinfra | Seed-2.0-code | 🔧Tool Use | pass | $0.698 | 3857ms | — | 0.50 | 3.00 | |
| openrouter | minimax-01 | 🚀Throughput | ok | $0.698 | 835ms | — | 0.20 | 1.10 | |
| openrouter | qwen3-vl-8b-thinking | 💻Code Gen | ok | $0.705 | 286ms | — | 0.18 | 2.10 | |
| openrouter | qwen3.7-max | ⚡Ping | ok | $0.707 | 728ms | — | 1.48 | 4.42 | |
| openrouter | qwen3-vl-235b-a22b-thinking | { }JSON Output | pass | $0.709 | 10044ms | — | 0.40 | 4.00 | |
| openrouter | glm-4.6v | 💻Code Gen | ok | $0.709 | 3370ms | — | 0.30 | 0.90 | |
| openrouter | kimi-k2-thinking | 🔍Context Recall | pass | $0.709 | 668ms | — | 0.60 | 2.50 | |
| openrouter | glm-5v-turbo | { }JSON Output | pass | $0.714 | 2519ms | — | 1.20 | 4.00 | |
| anthropic | claude-sonnet-5 | { }JSON Output | pass | $0.714 | 1858ms | — | 2.00 | 10.00 | |
| deepinfra | MiMo-V2.5-Pro | 🔧Tool Use | pass | $0.714 | 17933ms | — | 1.00 | 3.00 | |
| deepinfra | Seed-2.0-code | 🔍Context Recall | pass | $0.725 | 4413ms | — | 0.50 | 3.00 | |
| openrouter | qwen3.5-122b-a10b | ⚡Ping | ok | $0.730 | 296ms | — | 0.26 | 2.08 | |
| openrouter | mistral-large | 💻Code Gen | ok | $0.738 | 925ms | — | 2.00 | 6.00 | |
| openrouter | aion-3.0 | { }JSON Output | pass | $0.750 | 1816ms | — | 3.00 | 6.00 | |
| openrouter | perceptron-mk1 | 🚀Throughput | ok | $0.755 | 515ms | — | 0.15 | 1.50 | |
| openrouter | qwen3-vl-235b-a22b-thinking | ⚡Ping | ok | $0.759 | 502ms | — | 0.40 | 4.00 | |
| openai | gpt-3.5-turbo | 🚀Throughput | ok | $0.759 | 5615ms | — | 0.50 | 1.50 | |
| openrouter | aion-rp-llama-3.1-8b | 🚀Throughput | ok | $0.760 | 738ms | — | 0.80 | 1.60 | |
| openai | gpt-4.1-2025-04-14 | 🔍Context Recall | pass | $0.764 | 787ms | — | 2.00 | 8.00 | |
| openrouter | step-3.5-flash | 💻Code Gen | ok | $0.770 | 1564ms | — | 0.10 | 0.30 | |
| anthropic | claude-sonnet-4-5-20250929 | 🧮Reasoning | ok | $0.771 | 1948ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-max | 💻Code Gen | ok | $0.773 | 887ms | — | 0.78 | 3.90 | |
| openrouter | glm-4.6v | 🔍Context Recall | pass | $0.774 | 1076ms | — | 0.30 | 0.90 | |
| openrouter | kimi-k2.5 | 🔍Context Recall | pass | $0.776 | 923ms | — | 0.45 | 2.25 | |
| deepinfra | GLM-4.7 | 🔍Context Recall | pass | $0.781 | 56848ms | — | 0.40 | 1.75 | |
| openrouter | step-3.7-flash | 🧮Reasoning | ok | $0.783 | 406ms | — | 0.20 | 1.15 | |
| openrouter | glm-4.7 | 💻Code Gen | ok | $0.785 | 1337ms | — | 0.40 | 1.75 | |
| openrouter | mixtral-8x22b-instruct | 💻Code Gen | ok | $0.786 | 567ms | — | 2.00 | 6.00 | |
| openrouter | qwen3.5-27b | 🚀Throughput | ok | $0.788 | 1269ms | — | 0.20 | 1.56 | |
| openrouter | sonar-pro-search | 🧮Reasoning | ok | $0.789 | 1225ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.5-plus-02-15 | 🚀Throughput | ok | $0.794 | 509ms | — | 0.26 | 1.56 | |
| openai | gpt-4o | 🔍Context Recall | pass | $0.795 | 1405ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-08-06 | 🔍Context Recall | pass | $0.795 | 916ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-05-13 | 🔍Context Recall | pass | $0.795 | 762ms | — | 2.50 | 10.00 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 🧮Reasoning | ok | $0.803 | 463ms | — | 0.20 | 2.40 | |
| openrouter | command-r-plus-08-2024 | 🧮Reasoning | ok | $0.813 | 664ms | — | 2.50 | 10.00 | |
| openrouter | command-r-plus-08-2024 | 🔍Context Recall | pass | $0.815 | 1331ms | — | 2.50 | 10.00 | |
| anthropic | claude-sonnet-4-6 | 🧮Reasoning | ok | $0.816 | 2365ms | — | 3.00 | 15.00 | |
| openrouter | nemotron-3-ultra-550b-a55b | { }JSON Output | pass | $0.829 | 1047ms | — | 0.63 | 3.13 | |
| deepinfra | Qwen3-Next-80B-A3B-Instruct | 🚀Throughput | ok | $0.835 | 9772ms | — | 0.09 | 1.10 | |
| anthropic | claude-sonnet-5 | 🧮Reasoning | ok | $0.840 | 1746ms | — | 2.00 | 10.00 | |
| openrouter | glm-4.7 | { }JSON Output | pass | $0.846 | 425ms | — | 0.40 | 1.75 | |
| openrouter | deepseek-r1 | 🔍Context Recall | pass | $0.854 | 958ms | — | 0.70 | 2.50 | |
| deepinfra | Qwen3.5-122B-A10B | 🧮Reasoning | ok | $0.865 | 3073ms | — | 0.29 | 2.40 | |
| anthropic | claude-haiku-4-5-20251001 | 🔧Tool Use | pass | $0.874 | 1357ms | — | 1.00 | 5.00 | |
| deepinfra | Step-3.7-Flash | 🚀Throughput | ok | $0.878 | 5751ms | — | 0.20 | 1.15 | |
| openrouter | qwen3.6-35b-a3b | 🔍Context Recall | pass | $0.878 | 1165ms | — | 0.10 | 0.90 | |
| openrouter | qwen3.6-27b | 🔍Context Recall | pass | $0.881 | 830ms | — | 0.30 | 2.00 | |
| openrouter | glm-4.7 | 🚀Throughput | ok | $0.889 | 10043ms | — | 0.40 | 1.75 | |
| openrouter | glm-4.6 | 🚀Throughput | ok | $0.890 | 1666ms | — | 0.43 | 1.75 | |
| anthropic | claude-opus-4-6 | { }JSON Output | pass | $0.895 | 2142ms | — | 5.00 | 25.00 | |
| fireworks | glm-5p2 | { }JSON Output | pass | $0.896 | 3894ms | — | 0.95 | 3.00 | |
| openrouter | qwen3.5-plus-02-15 | 🔍Context Recall | pass | $0.904 | 509ms | — | 0.26 | 1.56 | |
| anthropic | claude-haiku-4-5-20251001 | 💻Code Gen | ok | $0.905 | 2155ms | — | 1.00 | 5.00 | |
| openrouter | qwen3.7-plus | 🔍Context Recall | pass | $0.911 | 754ms | — | 0.32 | 1.28 | |
| openrouter | magnum-v4-72b | 💻Code Gen | ok | $0.912 | 694ms | — | 2.50 | 5.00 | |
| openrouter | kimi-k2.6 | { }JSON Output | pass | $0.914 | 898ms | — | 0.95 | 4.00 | |
| openrouter | qwen3.5-plus-20260420 | 🚀Throughput | ok | $0.916 | 814ms | — | 0.30 | 1.80 | |
| openrouter | glm-4.5v | 🧮Reasoning | ok | $0.917 | 2451ms | — | 0.60 | 1.80 | |
| openrouter | glm-4.5v | 🚀Throughput | ok | $0.921 | 1498ms | — | 0.60 | 1.80 | |
| deepinfra | Qwen3.5-122B-A10B | 🔍Context Recall | pass | $0.921 | 2766ms | — | 0.29 | 2.40 | |
| openrouter | qwen3-next-80b-a3b-thinking | { }JSON Output | pass | $0.923 | 400ms | — | 0.15 | 1.20 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | { }JSON Output | pass | $0.924 | 485ms | — | 0.20 | 2.40 | |
| deepinfra | MiniMax-M2.7-Turbo | 💻Code Gen | ok | $0.925 | 2645ms | — | 0.38 | 1.70 | |
| openrouter | mistral-medium-3-5 | 💻Code Gen | ok | $0.927 | 481ms | — | 1.50 | 7.50 | |
| openrouter | glm-4.7 | 🧮Reasoning | ok | $0.937 | 624ms | — | 0.40 | 1.75 | |
| openai | gpt-4o-2024-11-20 | 🔍Context Recall | pass | $0.945 | 796ms | — | 2.50 | 10.00 | |
| openrouter | qwen3.6-35b-a3b | 🧮Reasoning | ok | $0.952 | 1139ms | — | 0.10 | 0.90 | |
| openrouter | qwen3-vl-235b-a22b-instruct | 🚀Throughput | ok | $0.958 | 272ms | — | 0.21 | 1.90 | |
| openai | gpt-4.1 | 💻Code Gen | ok | $0.960 | 1726ms | — | 2.00 | 8.00 | |
| openrouter | nemotron-3-ultra-550b-a55b | 💻Code Gen | ok | $0.963 | 875ms | — | 0.63 | 3.13 | |
| openrouter | qwen3.5-35b-a3b | { }JSON Output | pass | $0.967 | 969ms | — | 0.31 | 1.25 | |
| openrouter | qwen3.5-27b | 🔍Context Recall | pass | $0.971 | 1076ms | — | 0.20 | 1.56 | |
| openrouter | glm-5.1 | { }JSON Output | pass | $0.974 | 791ms | — | 0.97 | 3.04 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 🔍Context Recall | pass | $0.974 | 458ms | — | 0.20 | 2.40 | |
| openrouter | command-a | 🔍Context Recall | pass | $0.995 | 685ms | — | 2.50 | 10.00 | |
| openrouter | glm-4.7 | 🔍Context Recall | pass | $1.00 | 1234ms | — | 0.40 | 1.75 | |
| openrouter | qwen3.6-27b | 🚀Throughput | ok | $1.01 | 1069ms | — | 0.30 | 2.00 | |
| openrouter | mistral-medium-3.1 | 🚀Throughput | ok | $1.02 | 501ms | — | 0.40 | 2.00 | |
| openrouter | mistral-medium-3 | 🚀Throughput | ok | $1.02 | 1240ms | — | 0.40 | 2.00 | |
| openrouter | devstral-2512 | 🚀Throughput | ok | $1.02 | 515ms | — | 0.40 | 2.00 | |
| deepinfra | Qwen3-Max | 💻Code Gen | ok | $1.02 | 3732ms | — | 1.20 | 6.00 | |
| openrouter | seed-1.6 | 🚀Throughput | ok | $1.03 | 461ms | — | 0.25 | 2.00 | |
| openrouter | qwen3.5-122b-a10b | 🔍Context Recall | pass | $1.03 | 773ms | — | 0.26 | 2.08 | |
| openrouter | qwen3-next-80b-a3b-thinking | 🧮Reasoning | ok | $1.03 | 907ms | — | 0.15 | 1.20 | |
| openrouter | qwen3.5-plus-02-15 | { }JSON Output | pass | $1.04 | 508ms | — | 0.26 | 1.56 | |
| openrouter | qwen3.5-27b | { }JSON Output | pass | $1.04 | 351ms | — | 0.20 | 1.56 | |
| openrouter | qwen3.5-122b-a10b | 🚀Throughput | ok | $1.05 | 1294ms | — | 0.26 | 2.08 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🔍Context Recall | pass | $1.06 | 384ms | — | 0.23 | 2.30 | |
| openrouter | glm-5.1 | 🧮Reasoning | ok | $1.09 | 1355ms | — | 0.97 | 3.04 | |
| anthropic | claude-opus-4-5-20251101 | { }JSON Output | pass | $1.09 | 1860ms | — | 5.00 | 25.00 | |
| openrouter | glm-4.5v | 🔍Context Recall | pass | $1.10 | 1712ms | — | 0.60 | 1.80 | |
| openrouter | glm-4.6 | 🔍Context Recall | pass | $1.10 | 2030ms | — | 0.43 | 1.75 | |
| openrouter | glm-4.6 | 🧮Reasoning | ok | $1.10 | 2062ms | — | 0.43 | 1.75 | |
| openai | gpt-4o-2024-08-06 | 🧮Reasoning | ok | $1.10 | 1138ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-05-13 | 🧮Reasoning | ok | $1.14 | 962ms | — | 2.50 | 10.00 | |
| openrouter | glm-5.2 | 🔍Context Recall | pass | $1.14 | 753ms | — | 0.97 | 3.04 | |
| openrouter | glm-4.6 | 💻Code Gen | ok | $1.15 | 1887ms | — | 0.43 | 1.75 | |
| openrouter | kimi-k2.5 | 🚀Throughput | ok | $1.15 | 1481ms | — | 0.45 | 2.25 | |
| openrouter | qwen3.5-35b-a3b | 🔍Context Recall | pass | $1.15 | 1128ms | — | 0.31 | 1.25 | |
| anthropic | claude-opus-4-8 | { }JSON Output | pass | $1.16 | 1516ms | — | 5.00 | 25.00 | |
| openrouter | kimi-k2 | 🚀Throughput | ok | $1.17 | 2396ms | — | 0.57 | 2.30 | |
| openrouter | glm-5.2 | { }JSON Output | pass | $1.18 | 636ms | — | 0.97 | 3.04 | |
| deepinfra | GLM-5.1 | { }JSON Output | pass | $1.19 | 4454ms | — | 1.05 | 3.50 | |
| deepinfra | GLM-5.1 | 🔍Context Recall | pass | $1.19 | 3068ms | — | 1.05 | 3.50 | |
| openrouter | qwen3-next-80b-a3b-thinking | 💻Code Gen | ok | $1.21 | 380ms | — | 0.15 | 1.20 | |
| openrouter | qwen3.5-plus-20260420 | { }JSON Output | pass | $1.22 | 636ms | — | 0.30 | 1.80 | |
| openrouter | qwen3.5-plus-20260420 | 🔍Context Recall | pass | $1.22 | 596ms | — | 0.30 | 1.80 | |
| fireworks | glm-5p2 | 🔍Context Recall | pass | $1.22 | 4716ms | — | 0.95 | 3.00 | |
| openrouter | grok-build-0.1 | 🔍Context Recall | pass | $1.22 | 943ms | — | 1.00 | 2.00 | |
| together | GLM-5.2 | ⚡Ping | ok | $1.22 | 2440ms | — | 1.40 | 4.40 | |
| openai | gpt-4.1-mini-2025-04-14 | 🚀Throughput | ok | $1.22 | 7512ms | — | 0.40 | 1.60 | |
| openai | gpt-4.1-mini | 🚀Throughput | ok | $1.22 | 6142ms | — | 0.40 | 1.60 | |
| openrouter | sonar-pro | 🔍Context Recall | pass | $1.23 | 1170ms | — | 3.00 | 15.00 | |
| openrouter | sonar-pro-search | 🔍Context Recall | pass | $1.23 | 825ms | — | 3.00 | 15.00 | |
| openrouter | grok-4.3 | 💻Code Gen | ok | $1.23 | 789ms | — | 1.25 | 2.50 | |
| openai | gpt-4.1-2025-04-14 | 💻Code Gen | ok | $1.24 | 1195ms | — | 2.00 | 8.00 | |
| openrouter | command-a | 💻Code Gen | ok | $1.25 | 451ms | — | 2.50 | 10.00 | |
| openrouter | grok-4.3 | { }JSON Output | pass | $1.26 | 685ms | — | 1.25 | 2.50 | |
| openrouter | qwen3.5-35b-a3b | 💻Code Gen | ok | $1.26 | 2287ms | — | 0.31 | 1.25 | |
| openrouter | command-r-plus-08-2024 | 💻Code Gen | ok | $1.26 | 681ms | — | 2.50 | 10.00 | |
| openrouter | qwen3.6-flash | 🧮Reasoning | ok | $1.27 | 688ms | — | 0.19 | 1.13 | |
| openrouter | nova-2-lite-v1 | 🚀Throughput | ok | $1.27 | 1202ms | — | 0.30 | 2.50 | |
| openrouter | deepseek-r1 | 🚀Throughput | ok | $1.27 | 972ms | — | 0.70 | 2.50 | |
| openrouter | kimi-k2-0905 | 🚀Throughput | ok | $1.27 | 870ms | — | 0.60 | 2.50 | |
| openrouter | grok-4.3 | 🧮Reasoning | ok | $1.28 | 540ms | — | 1.25 | 2.50 | |
| anthropic | claude-opus-4-6 | 🧮Reasoning | ok | $1.28 | 2832ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | 🧮Reasoning | ok | $1.28 | 1532ms | — | 5.00 | 25.00 | |
| openrouter | qwen3-vl-8b-thinking | 🔍Context Recall | pass | $1.29 | 312ms | — | 0.18 | 2.10 | |
| anthropic | claude-opus-4-8 | 🧮Reasoning | ok | $1.30 | 1258ms | — | 5.00 | 25.00 | |
| openai | gpt-4o-2024-05-13 | 💻Code Gen | ok | $1.30 | 988ms | — | 2.50 | 10.00 | |
| anthropic | claude-opus-4-7 | 🧮Reasoning | ok | $1.30 | 1291ms | — | 5.00 | 25.00 | |
| openai | gpt-4o-2024-11-20 | 💻Code Gen | ok | $1.31 | 1320ms | — | 2.50 | 10.00 | |
| anthropic | claude-opus-4-7 | { }JSON Output | pass | $1.31 | 1588ms | — | 5.00 | 25.00 | |
| deepinfra | MiniMax-M2.7-Turbo | 🚀Throughput | ok | $1.31 | 3901ms | — | 0.38 | 1.70 | |
| deepinfra | Qwen3-Max-Thinking | 💻Code Gen | ok | $1.32 | 5314ms | — | 1.20 | 6.00 | |
| openrouter | grok-4.3 | 🔍Context Recall | pass | $1.34 | 616ms | — | 1.25 | 2.50 | |
| openai | gpt-4-turbo-2024-04-09 | 🔧Tool Use | pass | $1.36 | 4004ms | — | 10.00 | 30.00 | |
| openrouter | seed-1.6 | 💻Code Gen | ok | $1.37 | 620ms | — | 0.25 | 2.00 | |
| openrouter | glm-5.1 | 💻Code Gen | ok | $1.37 | 777ms | — | 0.97 | 3.04 | |
| fireworks | kimi-k2p6 | 🔍Context Recall | pass | $1.39 | 3355ms | — | 0.95 | 4.00 | |
| openrouter | glm-5.2 | 🧮Reasoning | ok | $1.40 | 636ms | — | 0.97 | 3.04 | |
| openrouter | deepseek-r1 | 🧮Reasoning | ok | $1.40 | 898ms | — | 0.70 | 2.50 | |
| openrouter | grok-build-0.1 | { }JSON Output | pass | $1.41 | 911ms | — | 1.00 | 2.00 | |
| openrouter | aion-3.0-mini | 🚀Throughput | ok | $1.42 | 699ms | — | 0.70 | 1.40 | |
| openrouter | qwen3.7-plus | 💻Code Gen | ok | $1.46 | 611ms | — | 0.32 | 1.28 | |
| openrouter | qwen3.6-35b-a3b | 💻Code Gen | ok | $1.46 | 1814ms | — | 0.10 | 0.90 | |
| openrouter | qwen3.6-35b-a3b | { }JSON Output | pass | $1.47 | 3508ms | — | 0.10 | 0.90 | |
| anthropic | claude-sonnet-4-5-20250929 | 🔍Context Recall | pass | $1.48 | 2185ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.5-397b-a17b | 🔍Context Recall | pass | $1.48 | 1145ms | — | 0.55 | 3.50 | |
| deepinfra | Seed-2.0-pro | 💻Code Gen | ok | $1.48 | 8561ms | — | 0.50 | 3.00 | |
| together | GLM-5.2 | { }JSON Output | pass | $1.48 | 1995ms | — | 1.40 | 4.40 | |
| anthropic | claude-sonnet-5 | 🔍Context Recall | pass | $1.50 | 1802ms | — | 2.00 | 10.00 | |
| anthropic | claude-sonnet-5 | 🔧Tool Use | pass | $1.50 | 1551ms | — | 2.00 | 10.00 | |
| openrouter | grok-4.20 | 🚀Throughput | ok | $1.52 | 564ms | — | 1.25 | 2.50 | |
| openrouter | kimi-k2.6 | 🔍Context Recall | pass | $1.53 | 720ms | — | 0.95 | 4.00 | |
| openrouter | glm-5.1 | 🚀Throughput | ok | $1.55 | 1072ms | — | 0.97 | 3.04 | |
| openrouter | hermes-4-405b | 🚀Throughput | ok | $1.55 | 425ms | — | 1.00 | 3.00 | |
| openrouter | glm-5.2 | 🚀Throughput | ok | $1.56 | 597ms | — | 0.97 | 3.04 | |
| openrouter | grok-build-0.1 | 💻Code Gen | ok | $1.56 | 1139ms | — | 1.00 | 2.00 | |
| openrouter | glm-5.1 | 🔍Context Recall | pass | $1.56 | 2397ms | — | 0.97 | 3.04 | |
| openrouter | aion-3.0 | 🔍Context Recall | pass | $1.57 | 995ms | — | 3.00 | 6.00 | |
| openai | gpt-4o | 💻Code Gen | ok | $1.59 | 1998ms | — | 2.50 | 10.00 | |
| openai | gpt-4-turbo-2024-04-09 | { }JSON Output | pass | $1.59 | 3604ms | — | 10.00 | 30.00 | |
| openrouter | nemotron-3-ultra-550b-a55b | 🚀Throughput | ok | $1.59 | 2044ms | — | 0.63 | 3.13 | |
| openrouter | aion-3.0 | 🧮Reasoning | ok | $1.60 | 1718ms | — | 3.00 | 6.00 | |
| openrouter | nova-pro-v1 | 🚀Throughput | ok | $1.62 | 1025ms | — | 0.80 | 3.20 | |
| openrouter | glm-4.5-air | 🧮Reasoning | ok | $1.63 | 745ms | — | 0.13 | 0.85 | |
| openrouter | sonar-pro | 💻Code Gen | ok | $1.64 | 2601ms | — | 3.00 | 15.00 | |
| openrouter | glm-5v-turbo | 🔍Context Recall | pass | $1.65 | 5358ms | — | 1.20 | 4.00 | |
| openrouter | glm-5-turbo | 🧮Reasoning | ok | $1.65 | 9824ms | — | 1.20 | 4.00 | |
| openrouter | qwen3-coder-plus | 🚀Throughput | ok | $1.65 | 1278ms | — | 0.65 | 3.25 | |
| deepinfra | GLM-5.1 | 🧮Reasoning | ok | $1.67 | 7573ms | — | 1.05 | 3.50 | |
| together | GLM-5.2 | 💻Code Gen | ok | $1.67 | 1795ms | — | 1.40 | 4.40 | |
| deepinfra | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🚀Throughput | ok | $1.69 | 15600ms | — | 0.50 | 2.20 | |
| fireworks | glm-5p2 | 🧮Reasoning | ok | $1.72 | 7196ms | — | 0.95 | 3.00 | |
| openai | gpt-4o-2024-08-06 | 💻Code Gen | ok | $1.75 | 1628ms | — | 2.50 | 10.00 | |
| openrouter | qwen3.5-397b-a17b | 🚀Throughput | ok | $1.77 | 1155ms | — | 0.55 | 3.50 | |
| deepinfra | Qwen3.5-122B-A10B | 🚀Throughput | ok | $1.83 | 5143ms | — | 0.29 | 2.40 | |
| baseten | NVIDIA-Nemotron-3-Ultra-550B-A55B | 🚀Throughput | ok | $1.84 | 10860ms | — | 0.60 | 2.40 | |
| anthropic | claude-sonnet-4-6 | 🔍Context Recall | pass | $1.85 | 2821ms | — | 3.00 | 15.00 | |
| openrouter | kimi-k2-thinking | 💻Code Gen | ok | $1.85 | 652ms | — | 0.60 | 2.50 | |
| openrouter | qwen3.6-27b | { }JSON Output | pass | $1.88 | 1349ms | — | 0.30 | 2.00 | |
| deepinfra | Step-3.7-Flash | 💻Code Gen | ok | $1.92 | 9828ms | — | 0.20 | 1.15 | |
| openrouter | glm-4.5v | 💻Code Gen | ok | $1.94 | 2227ms | — | 0.60 | 1.80 | |
| openrouter | qwen3-vl-235b-a22b-thinking | 🔍Context Recall | pass | $1.94 | 864ms | — | 0.40 | 4.00 | |
| openrouter | qwen3.6-flash | 💻Code Gen | ok | $1.96 | 289ms | — | 0.19 | 1.13 | |
| openrouter | qwen3-max | 🚀Throughput | ok | $1.98 | 878ms | — | 0.78 | 3.90 | |
| deepinfra | Qwen3.7-Max | ⚡Ping | ok | $1.98 | 8886ms | — | 2.50 | 7.50 | |
| openrouter | kimi-k2.6 | 💻Code Gen | ok | $1.99 | 511ms | — | 0.95 | 4.00 | |
| openrouter | sonar-pro-search | 💻Code Gen | ok | $1.99 | 1239ms | — | 3.00 | 15.00 | |
| openrouter | glm-5v-turbo | 🧮Reasoning | ok | $2.03 | 4945ms | — | 1.20 | 4.00 | |
| openrouter | kimi-k2.6 | 🚀Throughput | ok | $2.04 | 613ms | — | 0.95 | 4.00 | |
| openrouter | glm-5-turbo | 💻Code Gen | ok | $2.04 | 9408ms | — | 1.20 | 4.00 | |
| openrouter | glm-5v-turbo | 🚀Throughput | ok | $2.04 | 2482ms | — | 1.20 | 4.00 | |
| openrouter | glm-5-turbo | 🚀Throughput | ok | $2.04 | 8734ms | — | 1.20 | 4.00 | |
| openrouter | glm-5-turbo | { }JSON Output | pass | $2.05 | 8817ms | — | 1.20 | 4.00 | |
| openrouter | kimi-k2.5 | 💻Code Gen | ok | $2.08 | 835ms | — | 0.45 | 2.25 | |
| openrouter | qwen3.5-397b-a17b | ⚡Ping | ok | $2.10 | 1962ms | — | 0.55 | 3.50 | |
| openrouter | qwen3.7-max | 🔍Context Recall | pass | $2.10 | 1004ms | — | 1.48 | 4.42 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 💻Code Gen | ok | $2.15 | 827ms | — | 0.20 | 2.40 | |
| openrouter | glm-5-turbo | 🔍Context Recall | pass | $2.15 | 8462ms | — | 1.20 | 4.00 | |
| openrouter | qwen3-next-80b-a3b-thinking | 🚀Throughput | ok | $2.17 | 506ms | — | 0.15 | 1.20 | |
| deepinfra | Qwen3.7-Max | 🔧Tool Use | pass | $2.19 | 5002ms | — | 2.50 | 7.50 | |
| openrouter | qwen3.5-27b | 💻Code Gen | ok | $2.22 | 1449ms | — | 0.20 | 1.56 | |
| openrouter | qwen3-vl-8b-thinking | 🚀Throughput | ok | $2.25 | 335ms | — | 0.18 | 2.10 | |
| openrouter | qwen3.7-max | 🚀Throughput | ok | $2.27 | 675ms | — | 1.48 | 4.42 | |
| anthropic | claude-opus-4-6 | 🔍Context Recall | pass | $2.29 | 2423ms | — | 5.00 | 25.00 | |
| openrouter | qwen3.5-plus-20260420 | 🧮Reasoning | ok | $2.30 | 1834ms | — | 0.30 | 1.80 | |
| fireworks | glm-5p2 | 🚀Throughput | ok | $2.31 | 10774ms | — | 0.95 | 3.00 | |
| openrouter | qwen3.7-max | { }JSON Output | pass | $2.36 | 670ms | — | 1.48 | 4.42 | |
| openrouter | qwen3.5-397b-a17b | { }JSON Output | pass | $2.38 | 2836ms | — | 0.55 | 3.50 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | { }JSON Output | pass | $2.39 | 310ms | — | 0.23 | 2.30 | |
| openai | gpt-4-turbo-2024-04-09 | 🧮Reasoning | ok | $2.40 | 4246ms | — | 10.00 | 30.00 | |
| openrouter | grok-build-0.1 | 🧮Reasoning | ok | $2.44 | 871ms | — | 1.00 | 2.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🔍Context Recall | pass | $2.47 | 270ms | — | 0.20 | 2.40 | |
| together | GLM-5.2 | 🧮Reasoning | ok | $2.47 | 2903ms | — | 1.40 | 4.40 | |
| openrouter | qwen3.7-plus | 🧮Reasoning | ok | $2.52 | 1022ms | — | 0.32 | 1.28 | |
| anthropic | claude-opus-4-5-20251101 | 🔍Context Recall | pass | $2.54 | 1620ms | — | 5.00 | 25.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 🚀Throughput | ok | $2.58 | 1286ms | — | 0.20 | 2.40 | |
| together | GLM-5.2 | 🔍Context Recall | pass | $2.59 | 1662ms | — | 1.40 | 4.40 | |
| openrouter | grok-4.3 | 🚀Throughput | ok | $2.59 | 599ms | — | 1.25 | 2.50 | |
| openrouter | magnum-v4-72b | 🚀Throughput | ok | $2.60 | 802ms | — | 2.50 | 5.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🔧Tool Use | pass | $2.61 | 2143ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 🚀Throughput | ok | $2.64 | 491ms | — | 0.23 | 2.30 | |
| deepinfra | GLM-5.1 | 🚀Throughput | ok | $2.68 | 10881ms | — | 1.05 | 3.50 | |
| openrouter | morph-v3-fast | 🚀Throughput | ok | $2.70 | 380ms | — | 0.80 | 1.20 | |
| openrouter | qwen3.5-plus-02-15 | 💻Code Gen | ok | $2.75 | 481ms | — | 0.26 | 1.56 | |
| openai | gpt-4-turbo-2024-04-09 | 🔍Context Recall | pass | $2.75 | 1637ms | — | 10.00 | 30.00 | |
| openrouter | kimi-k2.5 | 🧮Reasoning | ok | $2.82 | 1189ms | — | 0.45 | 2.25 | |
| openrouter | kimi-k2-thinking | 🚀Throughput | ok | $2.98 | 984ms | — | 0.60 | 2.50 | |
| openrouter | qwen3-30b-a3b-thinking-2507 | 🚀Throughput | ok | $3.04 | 498ms | — | 0.20 | 2.40 | |
| fireworks | kimi-k2p6 | 🚀Throughput | ok | $3.06 | 10436ms | — | 0.95 | 4.00 | |
| openrouter | qwen3.5-27b | 🧮Reasoning | ok | $3.06 | 4337ms | — | 0.20 | 1.56 | |
| openrouter | mistral-large | 🚀Throughput | ok | $3.07 | 976ms | — | 2.00 | 6.00 | |
| anthropic | claude-sonnet-5 | 💻Code Gen | ok | $3.08 | 3532ms | — | 2.00 | 10.00 | |
| openrouter | mixtral-8x22b-instruct | 🚀Throughput | ok | $3.09 | 705ms | — | 2.00 | 6.00 | |
| openrouter | grok-build-0.1 | 🚀Throughput | ok | $3.10 | 1085ms | — | 1.00 | 2.00 | |
| openrouter | qwen3.6-27b | 💻Code Gen | ok | $3.11 | 4520ms | — | 0.30 | 2.00 | |
| openrouter | qwen3.5-plus-02-15 | 🧮Reasoning | ok | $3.29 | 494ms | — | 0.26 | 1.56 | |
| openrouter | kimi-k2-thinking | 🧮Reasoning | ok | $3.36 | 1393ms | — | 0.60 | 2.50 | |
| together | GLM-5.2 | 🚀Throughput | ok | $3.39 | 4434ms | — | 1.40 | 4.40 | |
| openrouter | qwen3.5-122b-a10b | 💻Code Gen | ok | $3.40 | 386ms | — | 0.26 | 2.08 | |
| anthropic | claude-opus-4-7 | 🔍Context Recall | pass | $3.51 | 1802ms | — | 5.00 | 25.00 | |
| openrouter | glm-5v-turbo | 💻Code Gen | ok | $3.59 | 2181ms | — | 1.20 | 4.00 | |
| anthropic | claude-opus-4-8 | 🔍Context Recall | pass | $3.74 | 1777ms | — | 5.00 | 25.00 | |
| openrouter | qwen3.6-27b | 🧮Reasoning | ok | $3.75 | 600ms | — | 0.30 | 2.00 | |
| openrouter | qwen3.5-397b-a17b | 💻Code Gen | ok | $3.75 | 1094ms | — | 0.55 | 3.50 | |
| openrouter | mistral-medium-3-5 | 🚀Throughput | ok | $3.82 | 509ms | — | 1.50 | 7.50 | |
| anthropic | claude-haiku-4-5-20251001 | 🚀Throughput | ok | $3.82 | 9016ms | — | 1.00 | 5.00 | |
| openrouter | glm-5.2 | 💻Code Gen | ok | $3.83 | 750ms | — | 0.97 | 3.04 | |
| openrouter | kimi-k2.6 | 🧮Reasoning | ok | $3.83 | 3492ms | — | 0.95 | 4.00 | |
| anthropic | claude-sonnet-4-6 | 💻Code Gen | ok | $3.94 | 4762ms | — | 3.00 | 15.00 | |
| anthropic | claude-opus-4-5-20251101 | 🔧Tool Use | pass | $4.34 | 1906ms | — | 5.00 | 25.00 | |
| deepinfra | Qwen3.7-Max | { }JSON Output | pass | $4.42 | 11026ms | — | 2.50 | 7.50 | |
| deepinfra | Qwen3-Max-Thinking | 🚀Throughput | ok | $4.58 | 15692ms | — | 1.20 | 6.00 | |
| deepinfra | Qwen3-Max | 🚀Throughput | ok | $4.58 | 13640ms | — | 1.20 | 6.00 | |
| openrouter | qwen3-vl-235b-a22b-thinking | 🚀Throughput | ok | $4.62 | 10041ms | — | 0.40 | 4.00 | |
| openrouter | qwen3-vl-235b-a22b-thinking | 💻Code Gen | ok | $4.75 | 1216ms | — | 0.40 | 4.00 | |
| openai | gpt-4-turbo-2024-04-09 | 💻Code Gen | ok | $4.90 | 11249ms | — | 10.00 | 30.00 | |
| openrouter | command-a | 🚀Throughput | ok | $5.07 | 482ms | — | 2.50 | 10.00 | |
| openrouter | command-r-plus-08-2024 | 🚀Throughput | ok | $5.07 | 2885ms | — | 2.50 | 10.00 | |
| fireworks | kimi-k2p6 | 💻Code Gen | ok | $5.15 | 13187ms | — | 0.95 | 4.00 | |
| openrouter | grok-4.20-multi-agent | ⚡Ping | ok | $5.37 | 708ms | — | 1.25 | 2.50 | |
| deepinfra | Qwen3.7-Max | 🔍Context Recall | pass | $5.41 | 10871ms | — | 2.50 | 7.50 | |
| openrouter | qwen3.5-plus-20260420 | 💻Code Gen | ok | $5.74 | 813ms | — | 0.30 | 1.80 | |
| anthropic | claude-opus-4-6 | 💻Code Gen | ok | $6.10 | 4285ms | — | 5.00 | 25.00 | |
| openrouter | aion-3.0 | 🚀Throughput | ok | $6.11 | 1467ms | — | 3.00 | 6.00 | |
| openai | gpt-4.1-2025-04-14 | 🚀Throughput | ok | $6.12 | 6177ms | — | 2.00 | 8.00 | |
| openai | gpt-4.1 | 🚀Throughput | ok | $6.12 | 8715ms | — | 2.00 | 8.00 | |
| openrouter | step-3.7-flash | 💻Code Gen | ok | $6.51 | 2323ms | — | 0.20 | 1.15 | |
| anthropic | claude-opus-4-5-20251101 | 💻Code Gen | ok | $6.77 | 4405ms | — | 5.00 | 25.00 | |
| fireworks | kimi-k2p6 | 🧮Reasoning | ok | $7.31 | 25796ms | — | 0.95 | 4.00 | |
| openrouter | sonar-pro-search | 🚀Throughput | ok | $7.44 | 3433ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.7-max | 💻Code Gen | ok | $7.61 | 606ms | — | 1.48 | 4.42 | |
| openai | gpt-4o | 🚀Throughput | ok | $7.65 | 9008ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-11-20 | 🚀Throughput | ok | $7.65 | 4111ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-08-06 | 🚀Throughput | ok | $7.65 | 6019ms | — | 2.50 | 10.00 | |
| openai | gpt-4o-2024-05-13 | 🚀Throughput | ok | $7.65 | 4245ms | — | 2.50 | 10.00 | |
| anthropic | claude-sonnet-5 | 🚀Throughput | ok | $7.67 | 8465ms | — | 2.00 | 10.00 | |
| openrouter | qwen3-235b-a22b-thinking-2507 | 💻Code Gen | ok | $7.78 | 1576ms | — | 0.23 | 2.30 | |
| anthropic | claude-opus-4-8 | 💻Code Gen | ok | $7.82 | 4022ms | — | 5.00 | 25.00 | |
| openrouter | sonar-pro | 🚀Throughput | ok | $8.05 | 1393ms | — | 3.00 | 15.00 | |
| openrouter | qwen3.7-max | 🧮Reasoning | ok | $8.07 | 965ms | — | 1.48 | 4.42 | |
| openrouter | qwen3.5-35b-a3b | 🧮Reasoning | ok | $8.39 | 1806ms | — | 0.31 | 1.25 | |
| anthropic | claude-opus-4-7 | 💻Code Gen | ok | $9.09 | 5234ms | — | 5.00 | 25.00 | |
| openrouter | grok-4.20-multi-agent | { }JSON Output | pass | $9.83 | 973ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 💻Code Gen | ok | $10.35 | 804ms | — | 1.25 | 2.50 | |
| deepinfra | GLM-5.1 | 💻Code Gen | ok | $10.51 | 40895ms | — | 1.05 | 3.50 | |
| openrouter | qwen3.5-122b-a10b | 🧮Reasoning | ok | $11.33 | 1723ms | — | 0.26 | 2.08 | |
| anthropic | claude-sonnet-4-6 | 🚀Throughput | ok | $11.45 | 18119ms | — | 3.00 | 15.00 | |
| anthropic | claude-sonnet-4-5-20250929 | 🚀Throughput | ok | $11.45 | 16108ms | — | 3.00 | 15.00 | |
| openrouter | qwen3-vl-30b-a3b-thinking | 💻Code Gen | ok | $11.46 | 542ms | — | 0.20 | 2.40 | |
| openrouter | grok-4.20-multi-agent | 🧮Reasoning | ok | $12.36 | 664ms | — | 1.25 | 2.50 | |
| openrouter | grok-4.20-multi-agent | 🔍Context Recall | pass | $13.80 | 1021ms | — | 1.25 | 2.50 | |
| openrouter | qwen3.5-397b-a17b | 🧮Reasoning | ok | $16.75 | 931ms | — | 0.55 | 3.50 | |
| anthropic | claude-opus-4-6 | 🚀Throughput | ok | $19.09 | 18069ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-5-20251101 | 🚀Throughput | ok | $19.09 | 15820ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-8 | 🚀Throughput | ok | $19.19 | 11349ms | — | 5.00 | 25.00 | |
| anthropic | claude-opus-4-7 | 🚀Throughput | ok | $19.21 | 11959ms | — | 5.00 | 25.00 | |
| openrouter | grok-4.20-multi-agent | 🚀Throughput | ok | $73.99 | 796ms | — | 1.25 | 2.50 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | 🚀Throughput | ok | — | 350ms | — | 0.00 | 0.00 | |
| openrouter | nemotron-3-nano-omni-30b-a3b-reasoning:free | ⚡Ping | ok | — | 293ms | — | 0.00 | 0.00 | |
| openai | gpt-4-0613 | 🔧Tool Use | pass | — | 2040ms | — | — | — | |
| openai | gpt-4-0613 | 🔍Context Recall | pass | — | 2350ms | — | — | — | |
| openai | gpt-4-0613 | 🚀Throughput | ok | — | 13026ms | — | — | — | |
| openai | gpt-4-0613 | 💻Code Gen | ok | — | 4248ms | — | — | — | |
| openai | gpt-4-0613 | { }JSON Output | pass | — | 1748ms | — | — | — | |
| openai | gpt-4-0613 | 🧮Reasoning | ok | — | 2784ms | — | — | — | |
| openai | gpt-4-0613 | ⚡Ping | ok | — | 2687ms | — | — | — | |
| openrouter | nemotron-3-ultra-550b-a55b:free | ⚡Ping | ok | — | 760ms | — | 0.00 | 0.00 | |
| openai | gpt-4 | 🔧Tool Use | pass | — | 2834ms | — | — | — | |
| openai | gpt-4 | 🔍Context Recall | pass | — | 1780ms | — | — | — | |
| openai | gpt-4 | 🚀Throughput | ok | — | 12665ms | — | — | — | |
| openai | gpt-4 | 💻Code Gen | ok | — | 3370ms | — | — | — | |
| openai | gpt-4 | { }JSON Output | pass | — | 2572ms | — | — | — | |
| openai | gpt-4 | 🧮Reasoning | ok | — | 1125ms | — | — | — | |
| openai | gpt-4 | ⚡Ping | ok | — | 3058ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🔧Tool Use | pass | — | 1123ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🔍Context Recall | pass | — | 1697ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🚀Throughput | ok | — | 4760ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 💻Code Gen | ok | — | 1619ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | { }JSON Output | pass | — | 1007ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | 🧮Reasoning | ok | — | 2699ms | — | — | — | |
| openai | gpt-3.5-turbo-16k | ⚡Ping | ok | — | 3026ms | — | — | — | |
| anthropic | claude-fable-5 | 🔧Tool Use | pass | — | 3625ms | — | — | — | |
| anthropic | claude-fable-5 | 🔍Context Recall | pass | — | 3440ms | — | — | — | |
| anthropic | claude-fable-5 | 🚀Throughput | ok | — | 11234ms | — | — | — | |
| anthropic | claude-fable-5 | 💻Code Gen | ok | — | 4232ms | — | — | — | |
| anthropic | claude-fable-5 | { }JSON Output | pass | — | 3727ms | — | — | — | |
| anthropic | claude-fable-5 | 🧮Reasoning | ok | — | 3365ms | — | — | — | |
| anthropic | claude-fable-5 | ⚡Ping | ok | — | 3027ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | 🔧Tool Use | pass | — | 1889ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | 🔍Context Recall | pass | — | 1903ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | 🚀Throughput | ok | — | 4604ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | 💻Code Gen | ok | — | 3704ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | { }JSON Output | pass | — | 2584ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | 🧮Reasoning | ok | — | 3072ms | — | — | — | |
| openai | gpt-3.5-turbo-1106 | ⚡Ping | ok | — | 2717ms | — | — | — | |
| openrouter | nex-n2-pro | 🔍Context Recall | pass | — | 1410ms | — | — | — | |
| openrouter | nex-n2-pro | 🚀Throughput | ok | — | 1007ms | — | — | — | |
| openrouter | nex-n2-pro | 💻Code Gen | ok | — | 682ms | — | — | — | |
| openrouter | nex-n2-pro | { }JSON Output | pass | — | 1352ms | — | — | — | |
| openrouter | nex-n2-pro | 🧮Reasoning | ok | — | 688ms | — | — | — | |
| openrouter | nex-n2-pro | ⚡Ping | ok | — | 5051ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🔧Tool Use | pass | — | 1935ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🔍Context Recall | pass | — | 2521ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🚀Throughput | ok | — | 6224ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 💻Code Gen | ok | — | 1315ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | { }JSON Output | pass | — | 2443ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | 🧮Reasoning | ok | — | 1696ms | — | — | — | |
| openai | gpt-3.5-turbo-0125 | ⚡Ping | ok | — | 2752ms | — | — | — |
Each cell is the latest single run (n=1) — a fluke and a real weakness look the same here. For repeated-run, variance-aware numbers see the Deep Suite and Coding Models. On speed/latency tests, ok means the model responded, not that it was correct.