Key Takeaways
Llemma 7b wins:
- Cheaper input tokens
- Cheaper output tokens
Gemini 3 Pro Preview wins:
- Larger context window
- Faster response time
- Higher intelligence benchmark
- Better at coding
- Better at math
- Supports vision
- Has reasoning mode
- Supports tool calls
Price Advantage
Llemma 7b
Benchmark Advantage
Gemini 3 Pro Preview
Context Window
Gemini 3 Pro Preview
Speed
Gemini 3 Pro Preview
Pricing Comparison
Price Comparison
| Metric | Llemma 7b | Gemini 3 Pro Preview | Winner |
|---|---|---|---|
| Input (per 1M tokens) | $0.80 | $2.00 | Llemma 7b |
| Output (per 1M tokens) | $1.20 | $12.00 | Llemma 7b |
| Cache Read (per 1M) | N/A | $200000.00 | Gemini 3 Pro Preview |
| Cache Write (per 1M) | N/A | $375000.00 | Gemini 3 Pro Preview |
Using a 3:1 input/output ratio, Llemma 7b is 80% cheaper overall.
Llemma 7b Providers
Featherless $0.80 (Cheapest)
Gemini 3 Pro Preview Providers
Google AI Studio $2.00 (Cheapest)
Google $2.00 (Cheapest)
Benchmark Comparison
6
Benchmarks Compared
0
Llemma 7b Wins
0
Gemini 3 Pro Preview Wins
Benchmark Scores
| Benchmark | Llemma 7b | Gemini 3 Pro Preview | Winner |
|---|---|---|---|
Intelligence Index Overall intelligence score | - | 48.4 | - |
Coding Index Code generation & understanding | - | 46.5 | - |
Math Index Mathematical reasoning | - | 95.7 | - |
MMLU Pro Academic knowledge | - | 89.8 | - |
GPQA Graduate-level science | - | 90.8 | - |
LiveCodeBench Competitive programming | - | 91.7 | - |
Gemini 3 Pro Preview significantly outperforms in coding benchmarks.
Cost vs Quality
X-axis:
Y-axis:
Loading chart...
Other models
Context & Performance
Context Window
Llemma 7b
4,096
tokens
Max output: 4,096 tokens
Gemini 3 Pro Preview
1,048,576
tokens
Max output: 65,536 tokens
Gemini 3 Pro Preview has a 100% larger context window.
Speed Performance
| Metric | Llemma 7b | Gemini 3 Pro Preview | Winner |
|---|---|---|---|
| Tokens/second | N/A | 132.8 tok/s | |
| Time to First Token | N/A | 30.65s |
Capabilities
Feature Comparison
| Feature | Llemma 7b | Gemini 3 Pro Preview |
|---|---|---|
| Vision (Image Input) | ||
| Tool/Function Calls | ||
| Reasoning Mode | ||
| Audio Input | ||
| Audio Output | ||
| PDF Input | ||
| Prompt Caching | ||
| Web Search |
License & Release
| Property | Llemma 7b | Gemini 3 Pro Preview |
|---|---|---|
| License | Open Source | Proprietary |
| Author | Eleutherai | |
| Released | Apr 2025 | Nov 2025 |
Llemma 7b Modalities
Input
text
Output
text
Gemini 3 Pro Preview Modalities
Input
textimagefileaudiovideo
Output
text