Side-by-side comparison of pricing, 12 benchmarks, and generation speed.
| Metric | Hermes 4 - Llama-3.1 405B (Reasoning) | Gemini 3 Flash Preview (Non-reasoning) |
|---|---|---|
| Input ($/M tokens) | $1 | $0.5 |
| Output ($/M tokens) | $3 | $3 |
Data from Artificial Analysis API — 12 benchmarks
Gemini 3 Flash Preview (Non-reasoning) is cheaper overall. Its blended price (3:1 input/output ratio) is $1.13/M tokens vs $1.50/M for Hermes 4 - Llama-3.1 405B (Reasoning).
Gemini 3 Flash Preview (Non-reasoning) wins 8 out of 12 benchmarks compared to 2 for Hermes 4 - Llama-3.1 405B (Reasoning). See the detailed benchmark chart above for per-category results.
Gemini 3 Flash Preview (Non-reasoning) generates tokens faster at 209 tok/s vs 38 tok/s. However, Gemini 3 Flash Preview (Non-reasoning) has lower time-to-first-token (0.72s vs 0.80s).
Choose based on your priorities: Gemini 3 Flash Preview (Non-reasoning) for lower cost, Gemini 3 Flash Preview (Non-reasoning) for stronger benchmark performance, and Gemini 3 Flash Preview (Non-reasoning) for faster generation. For latency-sensitive apps, check the TTFT comparison above.