Capability matrix
Raw benchmark parity rarely decides the pick — tooling, open weights, and provider reliability usually do.
GPT 5.6-Sol leads on 11 of 14 shared benchmarks.
| Dimension | GPT 5.6-Sol | Kimi K3 |
|---|---|---|
| GPQA Diamond | 94.1% | 92.9% |
| HLE | 44.5% | 43.5% |
| MathArena Apex | — | 65.6% |
| Terminal-Bench 2.1 | 88.8% | 88.3% |
| Terminal-Bench 3.0 | 34.4% | 17.7% |
| Terminal-Bench 4.0 | 39.9% | 12.6% |
| DeepSWE v1.1 | 73% | 67.5% |
| ProgramBench | 23% | 17.5% |
| NL2Repo-Bench | 56.8% | 58% |
| CyberGym | 84.5% | 80% |
| SEC-Bench Pro | 74.3% | — |
| ExploitGym | 33.7% | — |
| HLE (w/tools) | — | 59.8% |
| Automation-Bench | 45.8% | 46.7% |
| Agents' Last Exam | 26.7% | 27.6% |
| Chartography (w/tools) | 79.9% | 68.1% |
| BabyVision (w/tools) | 88.9% | 85.7% |
| ZeroBench-main (w/tools) | 53% | 41% |
| Blended price | $12.00 /1M | — |
| Full priceInput · Output · Cached input | $4.00 · $20.00 · $0.400 | — |
| Context window | 1,050K | — |
Adjust the monthly volume — every model recomputes instantly.
Estimates use list prices and ignore cached input, batch discounts, and off-peak rates.