Compare/Llama 3.2 Instruct 1B vs Devstral Small (May '25)

Llama 3.2 Instruct 1BvsDevstral Small (May '25)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Meta

Llama 3.2 Instruct 1B

Input
$0.1/M
Output
$0.1/M
Speed
91 tok/s
TTFT
0.42s
Mistral

Devstral Small (May '25)

Input
$0.06/M
Output
$0.12/M
Speed
TTFT

Winner by Category

Cheaper
Devstral Small (May '25)
Faster (tok/s)
Llama 3.2 Instruct 1B
Lower Latency
Devstral Small (May '25)
Benchmarks (3-9)
Devstral Small (May '25)

Pricing Comparison

MetricLlama 3.2 Instruct 1BDevstral Small (May '25)
Input ($/M tokens)$0.1$0.06
Output ($/M tokens)$0.1$0.12
Cost for 1M input + 100K output tokens:
Llama 3.2 Instruct 1B$0.11
Devstral Small (May '25)$0.07

Speed Comparison

Output Speed (tokens/s) — higher is better
Llama 3.2 Instruct 1B
91 tok/s
Devstral Small (May '25)
Time to First Token (seconds) — lower is better
Llama 3.2 Instruct 1B
0.42s
Devstral Small (May '25)

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
6.318.0
Coding Index
0.612.2
Math Index
0.0
GPQA Diamond
19.6%43.4%
MMLU-Pro
20.0%63.2%
LiveCodeBench
1.9%25.8%
AIME 2025
0.0%
MATH-500
14.0%68.4%
Humanity's Last Exam
5.3%4.0%
SciCode
1.7%24.5%
IFBench
22.8%31.6%
TerminalBench
0.0%6.1%
Llama 3.2 Instruct 1B3 wins
9 winsDevstral Small (May '25)

Frequently Asked Questions

Which is cheaper, Llama 3.2 Instruct 1B or Devstral Small (May '25)?

Devstral Small (May '25) is cheaper overall. Its blended price (3:1 input/output ratio) is $0.07/M tokens vs $0.10/M for Llama 3.2 Instruct 1B.

Which model performs better on benchmarks?

Devstral Small (May '25) wins 9 out of 12 benchmarks compared to 3 for Llama 3.2 Instruct 1B. See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Llama 3.2 Instruct 1B generates tokens faster at 91 tok/s vs 0 tok/s. However, Devstral Small (May '25) has lower time-to-first-token (0.00s vs 0.42s).

When should I use Llama 3.2 Instruct 1B vs Devstral Small (May '25)?

Choose based on your priorities: Devstral Small (May '25) for lower cost, Devstral Small (May '25) for stronger benchmark performance, and Llama 3.2 Instruct 1B for faster generation. For latency-sensitive apps, check the TTFT comparison above.