Compare/Mistral Small (Feb '24) vs Hermes 4 - Llama-3.1 405B (Non-reasoning)

Mistral Small (Feb '24)vsHermes 4 - Llama-3.1 405B (Non-reasoning)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Mistral

Mistral Small (Feb '24)

Input
$1/M
Output
$3/M
Speed
157 tok/s
TTFT
0.53s
Nous Research

Hermes 4 - Llama-3.1 405B (Non-reasoning)

Input
$1/M
Output
$3/M
Speed
34 tok/s
TTFT
0.76s

Winner by Category

Cheaper
Tie
Faster (tok/s)
Mistral Small (Feb '24)
Lower Latency
Mistral Small (Feb '24)
Benchmarks (2-10)
Hermes 4 - Llama-3.1 405B (Non-reasoning)

Pricing Comparison

MetricMistral Small (Feb '24)Hermes 4 - Llama-3.1 405B (Non-reasoning)
Input ($/M tokens)$1$1
Output ($/M tokens)$3$3
Cost for 1M input + 100K output tokens:
Mistral Small (Feb '24)$1.30
Hermes 4 - Llama-3.1 405B (Non-reasoning)$1.30

Speed Comparison

Output Speed (tokens/s) — higher is better
Mistral Small (Feb '24)
157 tok/s
Hermes 4 - Llama-3.1 405B (Non-reasoning)
34 tok/s
Time to First Token (seconds) — lower is better
Mistral Small (Feb '24)
0.53s
Hermes 4 - Llama-3.1 405B (Non-reasoning)
0.76s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
9.017.6
Coding Index
18.1
Math Index
15.3
GPQA Diamond
30.2%53.6%
MMLU-Pro
41.9%72.9%
LiveCodeBench
11.1%54.6%
AIME 2025
15.3%
MATH-500
56.2%
Humanity's Last Exam
4.4%4.2%
SciCode
13.4%34.6%
IFBench
34.8%
TerminalBench
9.8%
Mistral Small (Feb '24)2 wins
10 winsHermes 4 - Llama-3.1 405B (Non-reasoning)

Frequently Asked Questions

Which is cheaper, Mistral Small (Feb '24) or Hermes 4 - Llama-3.1 405B (Non-reasoning)?

Both models have similar pricing. Check the detailed breakdown above for input vs output token costs.

Which model performs better on benchmarks?

Hermes 4 - Llama-3.1 405B (Non-reasoning) wins 10 out of 12 benchmarks compared to 2 for Mistral Small (Feb '24). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Mistral Small (Feb '24) generates tokens faster at 157 tok/s vs 34 tok/s. Mistral Small (Feb '24) also has lower time-to-first-token (0.53s vs 0.76s).

When should I use Mistral Small (Feb '24) vs Hermes 4 - Llama-3.1 405B (Non-reasoning)?

Choose based on your priorities: both are similarly priced, Hermes 4 - Llama-3.1 405B (Non-reasoning) for stronger benchmark performance, and Mistral Small (Feb '24) for faster generation. For latency-sensitive apps, check the TTFT comparison above.