Compare/Gemini 2.5 Pro Preview (May' 25) vs GPT-4o (Aug '24)

Gemini 2.5 Pro Preview (May' 25)vsGPT-4o (Aug '24)

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Google

Gemini 2.5 Pro Preview (May' 25)

Input
$1.25/M
Output
$10/M
Speed
TTFT
OpenAI

GPT-4o (Aug '24)

Input
$2.5/M
Output
$10/M
Speed
84 tok/s
TTFT
0.68s

Winner by Category

Cheaper
Gemini 2.5 Pro Preview (May' 25)
Faster (tok/s)
GPT-4o (Aug '24)
Lower Latency
Gemini 2.5 Pro Preview (May' 25)
Benchmarks (7-3)
Gemini 2.5 Pro Preview (May' 25)

Pricing Comparison

MetricGemini 2.5 Pro Preview (May' 25)GPT-4o (Aug '24)
Input ($/M tokens)$1.25$2.5
Output ($/M tokens)$10$10
Cost for 1M input + 100K output tokens:
Gemini 2.5 Pro Preview (May' 25)$2.25
GPT-4o (Aug '24)$3.50

Speed Comparison

Output Speed (tokens/s) — higher is better
Gemini 2.5 Pro Preview (May' 25)
GPT-4o (Aug '24)
84 tok/s
Time to First Token (seconds) — lower is better
Gemini 2.5 Pro Preview (May' 25)
GPT-4o (Aug '24)
0.68s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
29.518.6
Coding Index
16.6
Math Index
GPQA Diamond
82.2%52.1%
MMLU-Pro
83.7%
LiveCodeBench
77.0%31.7%
AIME 2025
MATH-500
98.6%79.5%
Humanity's Last Exam
15.4%2.9%
SciCode
41.6%33.1%
IFBench
36.0%
TerminalBench
8.3%
Gemini 2.5 Pro Preview (May' 25)7 wins
3 winsGPT-4o (Aug '24)

Frequently Asked Questions

Which is cheaper, Gemini 2.5 Pro Preview (May' 25) or GPT-4o (Aug '24)?

Gemini 2.5 Pro Preview (May' 25) is cheaper overall. Its blended price (3:1 input/output ratio) is $3.44/M tokens vs $4.38/M for GPT-4o (Aug '24).

Which model performs better on benchmarks?

Gemini 2.5 Pro Preview (May' 25) wins 7 out of 12 benchmarks compared to 3 for GPT-4o (Aug '24). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

GPT-4o (Aug '24) generates tokens faster at 84 tok/s vs 0 tok/s. Gemini 2.5 Pro Preview (May' 25) also has lower time-to-first-token (0.00s vs 0.68s).

When should I use Gemini 2.5 Pro Preview (May' 25) vs GPT-4o (Aug '24)?

Choose based on your priorities: Gemini 2.5 Pro Preview (May' 25) for lower cost, Gemini 2.5 Pro Preview (May' 25) for stronger benchmark performance, and GPT-4o (Aug '24) for faster generation. For latency-sensitive apps, check the TTFT comparison above.