Compare/Hermes 4 - Llama-3.1 405B (Non-reasoning) vs Mistral Small (Feb '24)

Hermes 4 - Llama-3.1 405B (Non-reasoning)vsMistral Small (Feb '24)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Nous Research

Hermes 4 - Llama-3.1 405B (Non-reasoning)

Input
$1/M
Output
$3/M
Speed
39 tok/s
TTFT
0.76s
Mistral

Mistral Small (Feb '24)

Input
$1/M
Output
$3/M
Speed
162 tok/s
TTFT
0.53s

Winner by Category

Cheaper
Tie
Faster (tok/s)
Mistral Small (Feb '24)
Lower Latency
Mistral Small (Feb '24)
Benchmarks (9-2)
Hermes 4 - Llama-3.1 405B (Non-reasoning)

Pricing Comparison

MetricHermes 4 - Llama-3.1 405B (Non-reasoning)Mistral Small (Feb '24)
Input ($/M tokens)$1$1
Output ($/M tokens)$3$3
Cost for 1M input + 100K output tokens:
Hermes 4 - Llama-3.1 405B (Non-reasoning)$1.30
Mistral Small (Feb '24)$1.30

Speed Comparison

Output Speed (tokens/s) — higher is better
Hermes 4 - Llama-3.1 405B (Non-reasoning)
39 tok/s
Mistral Small (Feb '24)
162 tok/s
Time to First Token (seconds) — lower is better
Hermes 4 - Llama-3.1 405B (Non-reasoning)
0.76s
Mistral Small (Feb '24)
0.53s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
8.83.6
Coding Index
Math Index
15.3
GPQA Diamond
53.6%30.2%
MMLU-Pro
72.9%41.9%
LiveCodeBench
54.6%11.1%
AIME 2025
15.3%
MATH-500
56.2%
Humanity's Last Exam
4.2%4.4%
SciCode
34.6%13.4%
IFBench
34.8%
TerminalBench
9.8%
Hermes 4 - Llama-3.1 405B (Non-reasoning)9 wins
2 winsMistral Small (Feb '24)

Frequently Asked Questions

Which is cheaper, Hermes 4 - Llama-3.1 405B (Non-reasoning) or Mistral Small (Feb '24)?

Both models have similar pricing. Check the detailed breakdown above for input vs output token costs.

Which model performs better on benchmarks?

Hermes 4 - Llama-3.1 405B (Non-reasoning) wins 9 out of 12 benchmarks compared to 2 for Mistral Small (Feb '24). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Mistral Small (Feb '24) generates tokens faster at 162 tok/s vs 39 tok/s. However, Mistral Small (Feb '24) has lower time-to-first-token (0.53s vs 0.76s).

When should I use Hermes 4 - Llama-3.1 405B (Non-reasoning) vs Mistral Small (Feb '24)?

Choose based on your priorities: both are similarly priced, Hermes 4 - Llama-3.1 405B (Non-reasoning) for stronger benchmark performance, and Mistral Small (Feb '24) for faster generation. For latency-sensitive apps, check the TTFT comparison above.