EyesInAI
Switchyard
Benchmarks
Models
Learn
News
Benchmark your use case
⌘K
AI Benchmark Intelligence
Loading benchmark data…
EyesInAI
·
Loading live benchmark data
Home
Benchmark
Search
Refresh
Text
A
Loading models…
EyesInAI
·
Loading models…
All models
deepinfra
mistralai/Mistral-Small-3.2-24B-Instruct-2506
Last tested Jun 21, 2026
Overall pass
86%
Avg latency
9801 ms
Context
128k
Tools
Yes
Input $/1M
$0.07
Output $/1M
$0.20
Tests run
7
Passed
6/7
AI summary
Hardware to run it
Hosted:
$0.075 in / $0.2 out
per 1M
Self-host:
API only
Proprietary / weights not released — hosted API only.
Test results
⚡
Ping
Latency & availability — single-word reply
17567 ms
🧮
Reasoning
Basic math reasoning — show work, give answer
16422 ms
{ }
JSON Output
Structured output compliance — valid JSON with required keys
4073 ms
💻
Code Gen
Python function generation with docstring
5615 ms
🚀
Throughput
Token generation speed — 500-token long-form response
fail
🔍
Context Recall
Retrieval from in-context data — 20-item list Q&A
Compare with another model
See the leaderboard
2520 ms
🔧
Tool Use
Function/tool calling — get_weather invocation
1945 ms