Compare/Phi-4 vs Grok 4 Fast (Non-reasoning)

Phi-4vsGrok 4 Fast (Non-reasoning)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Microsoft Azure

Phi-4

Input
$0.125/M
Output
$0.5/M
Speed
37 tok/s
TTFT
0.41s
xAI

Grok 4 Fast (Non-reasoning)

Input
$0.2/M
Output
$0.5/M
Speed
123 tok/s
TTFT
0.30s

Winner by Category

Cheaper
Phi-4
Faster (tok/s)
Grok 4 Fast (Non-reasoning)
Lower Latency
Grok 4 Fast (Non-reasoning)
Benchmarks (1-11)
Grok 4 Fast (Non-reasoning)

Pricing Comparison

MetricPhi-4Grok 4 Fast (Non-reasoning)
Input ($/M tokens)$0.125$0.2
Output ($/M tokens)$0.5$0.5
Cost for 1M input + 100K output tokens:
Phi-4$0.17
Grok 4 Fast (Non-reasoning)$0.25

Speed Comparison

Output Speed (tokens/s) — higher is better
Phi-4
37 tok/s
Grok 4 Fast (Non-reasoning)
123 tok/s
Time to First Token (seconds) — lower is better
Phi-4
0.41s
Grok 4 Fast (Non-reasoning)
0.30s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
10.423.1
Coding Index
11.219.0
Math Index
18.041.3
GPQA Diamond
57.5%60.6%
MMLU-Pro
71.4%73.0%
LiveCodeBench
23.1%40.1%
AIME 2025
18.0%41.3%
MATH-500
81.0%
Humanity's Last Exam
4.1%5.0%
SciCode
26.0%32.9%
IFBench
23.5%37.7%
TerminalBench
3.8%12.1%
Phi-41 wins
11 winsGrok 4 Fast (Non-reasoning)

Frequently Asked Questions

Which is cheaper, Phi-4 or Grok 4 Fast (Non-reasoning)?

Phi-4 is cheaper overall. Its blended price (3:1 input/output ratio) is $0.22/M tokens vs $0.28/M for Grok 4 Fast (Non-reasoning).

Which model performs better on benchmarks?

Grok 4 Fast (Non-reasoning) wins 11 out of 12 benchmarks compared to 1 for Phi-4. See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

Grok 4 Fast (Non-reasoning) generates tokens faster at 123 tok/s vs 37 tok/s. However, Grok 4 Fast (Non-reasoning) has lower time-to-first-token (0.30s vs 0.41s).

When should I use Phi-4 vs Grok 4 Fast (Non-reasoning)?

Choose based on your priorities: Phi-4 for lower cost, Grok 4 Fast (Non-reasoning) for stronger benchmark performance, and Grok 4 Fast (Non-reasoning) for faster generation. For latency-sensitive apps, check the TTFT comparison above.