Side-by-side comparison of pricing, 12 benchmarks, and generation speed.
| Metric | Devstral Small (Jul '25) | Hermes 3 - Llama-3.1 70B |
|---|---|---|
| Input ($/M tokens) | $0.1 | $0.3 |
| Output ($/M tokens) | $0.3 | $0.3 |
Data from Artificial Analysis API — 12 benchmarks
Devstral Small (Jul '25) is cheaper overall. Its blended price (3:1 input/output ratio) is $0.15/M tokens vs $0.30/M for Hermes 3 - Llama-3.1 70B.
Devstral Small (Jul '25) wins 11 out of 12 benchmarks compared to 1 for Hermes 3 - Llama-3.1 70B. See the detailed benchmark chart above for per-category results.
Devstral Small (Jul '25) generates tokens faster at 301 tok/s vs 40 tok/s. However, Hermes 3 - Llama-3.1 70B has lower time-to-first-token (0.34s vs 0.34s).
Choose based on your priorities: Devstral Small (Jul '25) for lower cost, Devstral Small (Jul '25) for stronger benchmark performance, and Devstral Small (Jul '25) for faster generation. For latency-sensitive apps, check the TTFT comparison above.