EyesInAI
Switchyard
Chatbots
Benchmarks
Models
Learn
News
Home
Switchyard
Chatbots
Which model for your task?
Leaderboard
Deep Suite
Coding Models
Judge Bake-off
Compare
Trends
Try Models
Catalog
Providers
By Origin
By Layer
Hardware
Open Source
License Tiers
Explainers
Automation & Agents
Cut Costs
Case Studies
Papers
Notes
Principles
Methodology
Jargon
Contact
Latest
Governance & Access
Pricing & Billing
Data Centers & Power
Articles
Investigated & Declined
Trending models
Status
Archive
Benchmark your use case
Loading benchmark data…
EyesInAI
·
Loading live benchmark data
Home
Benchmark
Settings
Loading models…
EyesInAI
·
Loading models…
All models
openrouter
kwaipilot/kat-coder-pro-v2.5
Last tested Jul 16, 2026
Overall pass
100%
Avg latency
604 ms
Context
256k
Tools
Yes
Input $/1M
$0.74
Output $/1M
$2.96
Tests run
6
Passed
6/6
AI summary
Hardware to run it
Hosted:
$0.74 in / $2.96 out
per 1M
Self-host:
API only
Proprietary / weights not released — hosted API only.
Test results
⚡
Ping
Latency & availability — single-word reply
527 ms
🧮
Reasoning
Basic math reasoning — show work, give answer
515 ms
{ }
JSON Output
Structured output compliance — valid JSON with required keys
615 ms
💻
Code Gen
Python function generation with docstring
664 ms
🚀
Throughput
Token generation speed — 500-token long-form response
525 ms
🔍
Context Recall
Retrieval from in-context data — 20-item list Q&A
Compare with another model
See the leaderboard
778 ms