Key Takeaways
GPT-5.4 wins:
- Larger context window
- Higher intelligence benchmark
- Better at coding
- Supports vision
Grok 3 Mini wins:
- Cheaper input tokens
- Cheaper output tokens
- Faster response time
- Better at math
- Has reasoning mode
Price Advantage
Grok 3 Mini
Benchmark Advantage
GPT-5.4
Context Window
GPT-5.4
Speed
Grok 3 Mini
Pricing Comparison
Price Comparison
| Metric | GPT-5.4 | Grok 3 Mini | Winner |
|---|---|---|---|
| Input (per 1M tokens) | $2.50 | $0.25 | Grok 3 Mini |
| Output (per 1M tokens) | $15.00 | $0.50 | Grok 3 Mini |
| Cache Read (per 1M) | $0.25 | $0.07 | Grok 3 Mini |
Using a 3:1 input/output ratio, Grok 3 Mini is 94% cheaper overall.
GPT-5.4 Providers
No provider data available
Grok 3 Mini Providers
No provider data available
Benchmark Comparison
7
Benchmarks Compared
3
GPT-5.4 Wins
0
Grok 3 Mini Wins
Benchmark Scores
| Benchmark | GPT-5.4 | Grok 3 Mini | Winner |
|---|---|---|---|
Intelligence Index Overall intelligence score | 57.0 | 32.1 | |
Coding Index Code generation & understanding | 57.3 | 25.2 | |
Math Index Mathematical reasoning | - | 84.7 | - |
MMLU Pro Academic knowledge | - | 82.8 | - |
GPQA Graduate-level science | 92.0 | 79.1 | |
LiveCodeBench Competitive programming | - | 69.6 | - |
AIME Competition math | - | 93.3 | - |
GPT-5.4 significantly outperforms in coding benchmarks.
Cost vs Quality
X-axis:
Y-axis:
Loading chart...
Other models
Context & Performance
Context Window
GPT-5.4
1,050,000
tokens
Grok 3 Mini
131,072
tokens
GPT-5.4 has a 88% larger context window.
Speed Performance
| Metric | GPT-5.4 | Grok 3 Mini | Winner |
|---|---|---|---|
| Tokens/second | 84.0 tok/s | 196.6 tok/s | |
| Time to First Token | 165.19s | 0.47s |
Grok 3 Mini responds 134% faster on average.
Capabilities
Feature Comparison
| Feature | GPT-5.4 | Grok 3 Mini |
|---|---|---|
| Vision (Image Input) | ||
| Tool/Function Calls | ||
| Reasoning Mode | ||
| Audio Input | ||
| Audio Output | ||
| PDF Input | ||
| Prompt Caching | ||
| Web Search |
License & Release
| Property | GPT-5.4 | Grok 3 Mini |
|---|---|---|
| License | Proprietary | Proprietary |
| Author | OpenAI | Xai |
| Released | Mar 2026 | Jun 2025 |
GPT-5.4 Modalities
Input
textimagefile
Output
text
Grok 3 Mini Modalities
Input
text
Output
text