Compare/Gemini 1.5 Pro (Sep '24) vs o3

Gemini 1.5 Pro (Sep '24)vso3

Side-by-side comparison of pricing, 12 benchmarks, and generation speed.

Google

Gemini 1.5 Pro (Sep '24)

Input
$0/M
Output
$0/M
Speed
TTFT
OpenAI

o3

Input
$2/M
Output
$8/M
Speed
125 tok/s
TTFT
6.65s

Winner by Category

Cheaper
Gemini 1.5 Pro (Sep '24)
Faster (tok/s)
o3
Lower Latency
Gemini 1.5 Pro (Sep '24)
Benchmarks (1-11)
o3

Pricing Comparison

MetricGemini 1.5 Pro (Sep '24)o3
Input ($/M tokens)$0$2
Output ($/M tokens)$0$8
Cost for 1M input + 100K output tokens:
Gemini 1.5 Pro (Sep '24)$0.00
o3$2.80

Speed Comparison

Output Speed (tokens/s) — higher is better
Gemini 1.5 Pro (Sep '24)
o3
125 tok/s
Time to First Token (seconds) — lower is better
Gemini 1.5 Pro (Sep '24)
o3
6.65s

Benchmark Comparison

Data from Artificial Analysis API — 12 benchmarks

Intelligence Index
10.030.4
Coding Index
23.6
Math Index
88.3
GPQA Diamond
58.9%82.7%
MMLU-Pro
75.0%85.3%
LiveCodeBench
31.6%80.8%
AIME 2025
88.3%
MATH-500
87.6%99.2%
Humanity's Last Exam
4.9%20.0%
SciCode
29.5%41.0%
IFBench
71.4%
TerminalBench
37.1%
Gemini 1.5 Pro (Sep '24)1 wins
11 winso3

Frequently Asked Questions

Which is cheaper, Gemini 1.5 Pro (Sep '24) or o3?

Gemini 1.5 Pro (Sep '24) is cheaper overall. Its blended price (3:1 input/output ratio) is $0.00/M tokens vs $3.50/M for o3.

Which model performs better on benchmarks?

o3 wins 11 out of 12 benchmarks compared to 1 for Gemini 1.5 Pro (Sep '24). See the detailed benchmark chart above for per-category results.

Which is faster for real-time applications?

o3 generates tokens faster at 125 tok/s vs 0 tok/s. Gemini 1.5 Pro (Sep '24) also has lower time-to-first-token (0.00s vs 6.65s).

When should I use Gemini 1.5 Pro (Sep '24) vs o3?

Choose based on your priorities: Gemini 1.5 Pro (Sep '24) for lower cost, o3 for stronger benchmark performance, and o3 for faster generation. For latency-sensitive apps, check the TTFT comparison above.