Key Takeaways
Llama 3.1 405B Instruct wins:
- Larger context window
- Faster response time
- Higher intelligence benchmark
- Better at coding
- Better at math
- Supports tool calls
Llama 3.1 70B Instruct 1B wins:
- No clear advantages in compared metrics
Price Advantage
Llama 3.1 405B Instruct
Benchmark Advantage
Llama 3.1 405B Instruct
Context Window
Llama 3.1 405B Instruct
Speed
Llama 3.1 405B Instruct
Pricing Comparison
Price Comparison
| Metric | Llama 3.1 405B Instruct | Llama 3.1 70B Instruct 1B | Winner |
|---|---|---|---|
| Input (per 1M tokens) | $0.90 | $0.90 | Tie |
| Output (per 1M tokens) | $0.90 | $0.90 | Tie |
| Cache Read (per 1M) | $0.45 | $0.45 | Tie |
Both models have similar overall pricing.
Llama 3.1 405B Instruct Providers
No provider data available
Llama 3.1 70B Instruct 1B Providers
No provider data available
Benchmark Comparison
8
Benchmarks Compared
0
Llama 3.1 405B Instruct Wins
0
Llama 3.1 70B Instruct 1B Wins
Benchmark Scores
| Benchmark | Llama 3.1 405B Instruct | Llama 3.1 70B Instruct 1B | Winner |
|---|---|---|---|
Intelligence Index Overall intelligence score | 17.4 | - | - |
Coding Index Code generation & understanding | 14.5 | - | - |
Math Index Mathematical reasoning | 3.0 | - | - |
MMLU Pro Academic knowledge | 73.2 | - | - |
GPQA Graduate-level science | 51.5 | - | - |
LiveCodeBench Competitive programming | 30.5 | - | - |
Aider Real-world code editing | 66.2 | - | - |
AIME Competition math | 21.3 | - | - |
Llama 3.1 405B Instruct significantly outperforms in coding benchmarks.
Cost vs Quality
X-axis:
Y-axis:
Loading chart...
Llama 3.1 405B Instruct
Other models
Context & Performance
Context Window
Llama 3.1 405B Instruct
131,000
tokens
Llama 3.1 70B Instruct 1B
N/A
tokens
Speed Performance
| Metric | Llama 3.1 405B Instruct | Llama 3.1 70B Instruct 1B | Winner |
|---|---|---|---|
| Tokens/second | 30.4 tok/s | N/A | |
| Time to First Token | 0.68s | N/A |
Capabilities
Feature Comparison
| Feature | Llama 3.1 405B Instruct | Llama 3.1 70B Instruct 1B |
|---|---|---|
| Vision (Image Input) | ||
| Tool/Function Calls | ||
| Reasoning Mode | ||
| Audio Input | ||
| Audio Output | ||
| PDF Input | ||
| Prompt Caching | ||
| Web Search |
License & Release
| Property | Llama 3.1 405B Instruct | Llama 3.1 70B Instruct 1B |
|---|---|---|
| License | Open Source | Proprietary |
| Author | Meta-llama | Meta-llama |
| Released | Jul 2024 | Unknown |
Llama 3.1 405B Instruct Modalities
Input
text
Output
text
Llama 3.1 70B Instruct 1B Modalities
Input
Output