EyesInAI
Benchmarks
Models
Learn
Latest
AI Benchmark Intelligence
Loading benchmark data…
EyesInAI
·
Loading live benchmark data
Home
Search
Refresh
All models
baseten
deepseek-ai/DeepSeek-V4-Pro
Last tested Jun 11, 2026
Overall pass
57%
Avg latency
3407 ms
Context
128k
Tools
No
Input $/1M
$1.74
Output $/1M
$3.48
Tests run
7
Passed
4/7
Test results
⚡
Ping
Latency & availability — single-word reply
1235 ms
🧮
Reasoning
Basic math reasoning — show work, give answer
fail
{ }
JSON Output
Structured output compliance — valid JSON with required keys
2387 ms
💻
Code Gen
Python function generation with docstring
fail
🚀
Throughput
Token generation speed — 500-token long-form response
8811 ms
🔍
Context Recall
Retrieval from in-context data — 20-item list Q&A
fail
🔧
Tool Use
Function/tool calling — get_weather invocation
1718 ms
Compare with another model
See the leaderboard