Compare/Step 3.5 Flash vs Devstral Small (Jul '25)

Step 3.5 FlashvsDevstral Small (Jul '25)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

StepFun

Step 3.5 Flash

Input
$0.1/M
Output
$0.3/M
Speed
93 tok/s
TTFT
3.48s
Mistral

Devstral Small (Jul '25)

Input
$0.1/M
Output
$0.3/M
Speed
301 tok/s
TTFT
0.34s

Winner by Category

Cheaper
Tie
Faster (tok/s)
Devstral Small (Jul '25)
Lower Latency
Devstral Small (Jul '25)
Benchmarks (7-5)
Step 3.5 Flash

Pricing Comparison

MetricStep 3.5 FlashDevstral Small (Jul '25)
Input ($/M tokens)$0.1$0.1
Output ($/M tokens)$0.3$0.3
Cost for 1M input + 100K output tokens:
Step 3.5 Flash$0.13
Devstral Small (Jul '25)$0.13

Speed Comparison

Output Speed (tokens/s) — higher is better
Step 3.5 Flash
93 tok/s
Devstral Small (Jul '25)
301 tok/s
Time to First Token (seconds) — lower is better
Step 3.5 Flash
3.48s
Devstral Small (Jul '25)
0.34s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
37.815.2
Coding Index
31.612.1
Math Index
29.3
GPQA Diamond
83.1%41.4%
MMLU-Pro
62.2%
LiveCodeBench
25.4%
AIME 2025
29.3%
MATH-500
63.5%
Humanity's Last Exam
19.1%3.7%
SciCode
40.4%24.3%
IFBench
64.6%34.6%
TerminalBench
27.3%6.1%
Step 3.5 Flash7 wins
5 winsDevstral Small (Jul '25)

Frequently Asked Questions

Which is cheaper, Step 3.5 Flash or Devstral Small (Jul '25)?

Both models have similar pricing. Check the detailed breakdown above for input vs output token costs.

Which model performs better on benchmarks?

Step 3.5 Flash wins 7 out of 12 benchmarks compared to 5 for Devstral Small (Jul '25). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Devstral Small (Jul '25) generates tokens faster at 301 tok/s vs 93 tok/s. However, Devstral Small (Jul '25) has lower time-to-first-token (0.34s vs 3.48s).

When should I use Step 3.5 Flash vs Devstral Small (Jul '25)?

Choose based on your priorities: both are similarly priced, Step 3.5 Flash for stronger benchmark performance, and Devstral Small (Jul '25) for faster generation. For latency-sensitive apps, check the TTFT comparison above.