Compare/Devstral Small (May '25) vs Grok-1

Devstral Small (May '25)vsGrok-1

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Mistral

Devstral Small (May '25)

Input
$0/M
Output
$0/M
Speed
TTFT
xAI

Grok-1

Input
$0/M
Output
$0/M
Speed
TTFT

Winner by Category

Cheaper
Tie
Faster (tok/s)
Tie
Lower Latency
Tie
Benchmarks (10-0)
Devstral Small (May '25)

Pricing Comparison

MetricDevstral Small (May '25)Grok-1
Input ($/M tokens)$0$0
Output ($/M tokens)$0$0
Cost for 1M input + 100K output tokens:
Devstral Small (May '25)$0.00
Grok-1$0.00

Speed Comparison

Speed data not available for these models.

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
18.011.7
Coding Index
12.2
Math Index
GPQA Diamond
43.4%
MMLU-Pro
63.2%
LiveCodeBench
25.8%
AIME 2025
MATH-500
68.4%
Humanity's Last Exam
4.0%
SciCode
24.5%
IFBench
31.6%
TerminalBench
6.1%
Devstral Small (May '25)10 wins
0 winsGrok-1

Frequently Asked Questions

Which is cheaper, Devstral Small (May '25) or Grok-1?

Both models have similar pricing. Check the detailed breakdown above for input vs output token costs.

Which model performs better on benchmarks?

Devstral Small (May '25) wins 10 out of 12 benchmarks compared to 0 for Grok-1. See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Both models have comparable generation speeds.

When should I use Devstral Small (May '25) vs Grok-1?

Choose based on your priorities: both are similarly priced, Devstral Small (May '25) for stronger benchmark performance, and both have comparable speed. For latency-sensitive apps, check the TTFT comparison above.