Side-by-side comparison of pricing, 12 benchmarks, and generation speed.
| Metric | Hermes 4 - Llama-3.1 405B (Non-reasoning) | Gemini 3 Flash Preview (Reasoning) |
|---|---|---|
| Input ($/M tokens) | $1 | $0.5 |
| Output ($/M tokens) | $3 | $3 |
Data from Artificial Analysis API — 12 benchmarks
Gemini 3 Flash Preview (Reasoning) is cheaper overall. Its blended price (3:1 input/output ratio) is $1.13/M tokens vs $1.50/M for Hermes 4 - Llama-3.1 405B (Non-reasoning).
Gemini 3 Flash Preview (Reasoning) wins 11 out of 12 benchmarks compared to 0 for Hermes 4 - Llama-3.1 405B (Non-reasoning). See the detailed benchmark chart above for per-category results.
Gemini 3 Flash Preview (Reasoning) generates tokens faster at 180 tok/s vs 33 tok/s. Hermes 4 - Llama-3.1 405B (Non-reasoning) also has lower time-to-first-token (0.68s vs 6.33s).
Choose based on your priorities: Gemini 3 Flash Preview (Reasoning) for lower cost, Gemini 3 Flash Preview (Reasoning) for stronger benchmark performance, and Gemini 3 Flash Preview (Reasoning) for faster generation. For latency-sensitive apps, check the TTFT comparison above.