Fastest AI models ranked live by tokens/sec, TTFT latency, throughput. Mercury 2 leads at 1,101 tok/s, Granite 4.0 H Small 452, LFM2.5-VL-1.6B 429, Step 3.7 Flash 394, Granite 3.3 8B 377. Real-time rankings for 500+ models — Mercury 2, GPT-5.5, Claude Opus 4.8, Gemini 3, DeepSeek. Free.
| # | Model | Score | Benchmarks | Input $/M | Output $/M | Speed | TTFT |
|---|---|---|---|---|---|---|---|
| 1 | Mercury 2 Inception | 90 | 54 | $0.25 | $0.75 | 1194 | 3.02s |
| 2 | 61 | 95 | $0.50 | $3.00 | 209 | 5.83s | |
| 3 | gpt-oss-120b (low) OpenAI | 61 | 67 | $0.15 | $0.60 | 329 | 0.50s |
| 4 | Step 3.7 Flash StepFun | 61 | 55 | $0.20 | $1.15 | 393 | 0.75s |
| 5 | gpt-oss-120b (high) OpenAI | 60 | 73 | $0.15 | $0.60 | 271 | 0.51s |
| 6 | GPT-5.1 Codex (high) OpenAI | 60 | 90 | $1.25 | $10.00 | 201 | 4.71s |
| 7 | GLM-5.2 (max) Z AI | 59 | 85 | $1.40 | $4.40 | 189 | 0.91s |
| 8 | 59 | 85 | $0.25 | $2.00 | 211 | 6.24s | |
| 9 | Kimi K2 Thinking Kimi | 59 | 88 | $0.60 | $2.50 | 168 | 0.79s |
| 10 | Gemini 3.5 Flash (high) Google | 59 | 86 | $1.50 | $9.00 | 243 | 13.94s |
| 11 | Qwen3.7 Max Alibaba | 59 | 83 | $2.50 | $7.50 | 201 | 1.55s |
| 12 | GPT-5 Codex (high) OpenAI | 58 | 93 | $1.25 | $10.00 | 169 | 7.83s |
| 13 | Cogito v2.1 (Reasoning) Deep Cogito | 58 | 96 | $1.25 | $1.25 | 94 | 0.47s |
| 14 | 58 | 57 | $0.20 | $0.60 | 297 | 0.24s | |
| 15 | 57 | 73 | $0.50 | $3.00 | 207 | 0.69s |
Models are scored using a weighted combination of benchmarks, pricing, and speed metrics relevant to this use case.
Speed depends on the metric. Check the rankings above for both output speed (tokens/s) and TTFT (time to first token). Smaller models and those optimized for inference typically lead.
Not necessarily. Some smaller models achieve excellent benchmark scores while being much faster. The rankings above show both speed and quality so you can find the best tradeoff.
For a good user experience: TTFT under 1 second, output speed above 50 tok/s. For premium feel: TTFT under 0.3s, speed above 100 tok/s. Streaming helps mask latency.