Compare/Mistral Small (Feb '24) vs Hermes 4 - Llama-3.1 405B (Reasoning)

Mistral Small (Feb '24)vsHermes 4 - Llama-3.1 405B (Reasoning)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Mistral

Mistral Small (Feb '24)

Input
$1/M
Output
$3/M
Speed
174 tok/s
TTFT
0.41s
Nous Research

Hermes 4 - Llama-3.1 405B (Reasoning)

Input
$1/M
Output
$3/M
Speed
31 tok/s
TTFT
0.71s

Winner by Category

Cheaper
Tie
Faster (tok/s)
Mistral Small (Feb '24)
Lower Latency
Mistral Small (Feb '24)
Benchmarks (1-11)
Hermes 4 - Llama-3.1 405B (Reasoning)

Pricing Comparison

MetricMistral Small (Feb '24)Hermes 4 - Llama-3.1 405B (Reasoning)
Input ($/M tokens)$1$1
Output ($/M tokens)$3$3
Cost for 1M input + 100K output tokens:
Mistral Small (Feb '24)$1.30
Hermes 4 - Llama-3.1 405B (Reasoning)$1.30

Speed Comparison

Output Speed (tokens/s) — higher is better
Mistral Small (Feb '24)
174 tok/s
Hermes 4 - Llama-3.1 405B (Reasoning)
31 tok/s
Time to First Token (seconds) — lower is better
Mistral Small (Feb '24)
0.41s
Hermes 4 - Llama-3.1 405B (Reasoning)
0.71s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
9.018.6
Coding Index
16.0
Math Index
69.7
GPQA Diamond
30.2%72.7%
MMLU-Pro
41.9%82.9%
LiveCodeBench
11.1%68.6%
AIME 2025
69.7%
MATH-500
56.2%
Humanity's Last Exam
4.4%10.3%
SciCode
13.4%25.2%
IFBench
32.7%
TerminalBench
11.4%
Mistral Small (Feb '24)1 wins
11 winsHermes 4 - Llama-3.1 405B (Reasoning)

Frequently Asked Questions

Which is cheaper, Mistral Small (Feb '24) or Hermes 4 - Llama-3.1 405B (Reasoning)?

Both models have similar pricing. Check the detailed breakdown above for input vs output token costs.

Which model performs better on benchmarks?

Hermes 4 - Llama-3.1 405B (Reasoning) wins 11 out of 12 benchmarks compared to 1 for Mistral Small (Feb '24). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Mistral Small (Feb '24) generates tokens faster at 174 tok/s vs 31 tok/s. Mistral Small (Feb '24) also has lower time-to-first-token (0.41s vs 0.71s).

When should I use Mistral Small (Feb '24) vs Hermes 4 - Llama-3.1 405B (Reasoning)?

Choose based on your priorities: both are similarly priced, Hermes 4 - Llama-3.1 405B (Reasoning) for stronger benchmark performance, and Mistral Small (Feb '24) for faster generation. For latency-sensitive apps, check the TTFT comparison above.