EyesInAI
Switchyard
Benchmarks
Models
Learn
News
Benchmark your use case
⌘K
AI Benchmark Intelligence
Loading benchmark data…
EyesInAI
·
Loading live benchmark data
Home
Benchmark
Search
Refresh
Text
A
Loading models…
EyesInAI
·
Loading models…
All models
openrouter
anthropic/claude-opus-4.8
Last tested Jun 9, 2026
Overall pass
85%
Avg latency
1978 ms
Context
—
Tools
—
Input $/1M
—
Output $/1M
—
Tests run
13
Passed
11/13
AI summary
Hardware to run it
Hosted:
API only
Self-host:
API only
Proprietary / weights not released — hosted API only.
Test results
⚡
Ping
Latency & availability — single-word reply
2453 ms
🧮
Reasoning
Basic math reasoning — show work, give answer
1466 ms
{ }
JSON Output
Structured output compliance — valid JSON with required keys
1614 ms
💻
Code Gen
Python function generation with docstring
fail
🚀
Throughput
Token generation speed — 500-token long-form response
4293 ms
🔍
Context Recall
Retrieval from in-context data — 20-item list Q&A
Compare with another model
See the leaderboard
2730 ms
📝
Summarization
Real-world: distill a news article into 3 bullet points
1231 ms
🏷️
Classification
Real-world: sentiment + category from customer review
1813 ms
📄
Data Extraction
Real-world: pull structured fields from an invoice
1345 ms
📋
Instruction Follow
Real-world: multi-rule compliance (5 sentences, no "the", etc.)
1768 ms
✅
Format Compliance
IFEval-style: 4 bullets, keyword inclusion/exclusion, no preamble
1686 ms
🪡
Long-Context Needle
Find a 6-digit code buried in ~3.5k tokens of filler text
1858 ms
🧠
Multi-Step Logic
BBH-lite: boolean expression + web of lies + object counting
fail