Key Takeaways
Phi 4 Multimodal Instruct wins:
- Cheaper input tokens
- Cheaper output tokens
- Larger context window
- Faster response time
- Supports vision
- Has reasoning mode
WizardLM-2 8x22B wins:
- Higher intelligence benchmark
Price Advantage
Phi 4 Multimodal Instruct
Benchmark Advantage
WizardLM-2 8x22B
Context Window
Phi 4 Multimodal Instruct
Speed
Phi 4 Multimodal Instruct
Pricing Comparison
Price Comparison
| Metric | Phi 4 Multimodal Instruct | WizardLM-2 8x22B | Winner |
|---|---|---|---|
| Input (per 1M tokens) | $0.05 | $0.62 | Phi 4 Multimodal Instruct |
| Output (per 1M tokens) | $0.10 | $0.62 | Phi 4 Multimodal Instruct |
Using a 3:1 input/output ratio, Phi 4 Multimodal Instruct is 90% cheaper overall.
Phi 4 Multimodal Instruct Providers
No provider data available
WizardLM-2 8x22B Providers
No provider data available
Benchmark Comparison
7
Benchmarks Compared
2
Phi 4 Multimodal Instruct Wins
1
WizardLM-2 8x22B Wins
Benchmark Scores
| Benchmark | Phi 4 Multimodal Instruct | WizardLM-2 8x22B | Winner |
|---|---|---|---|
Intelligence Index Overall intelligence score | 10.0 | 33.1 | |
MMLU Pro Academic knowledge | 48.5 | 40.0 | |
GPQA Graduate-level science | 31.5 | 17.6 | |
LiveCodeBench Competitive programming | 13.1 | - | - |
Aider Real-world code editing | - | 44.4 | - |
AIME Competition math | 9.3 | - | - |
BBH Big-Bench Hard | - | 48.6 | - |
Phi 4 Multimodal Instruct wins 2 out of 7 benchmarks.
Cost vs Quality
X-axis:
Y-axis:
Loading chart...
Phi 4 Multimodal Instruct
Other models
Context & Performance
Context Window
Phi 4 Multimodal Instruct
131,072
tokens
WizardLM-2 8x22B
65,535
tokens
Phi 4 Multimodal Instruct has a 50% larger context window.
Speed Performance
| Metric | Phi 4 Multimodal Instruct | WizardLM-2 8x22B | Winner |
|---|---|---|---|
| Tokens/second | 16.8 tok/s | N/A | |
| Time to First Token | 0.35s | N/A |
Capabilities
Feature Comparison
| Feature | Phi 4 Multimodal Instruct | WizardLM-2 8x22B |
|---|---|---|
| Vision (Image Input) | ||
| Tool/Function Calls | ||
| Reasoning Mode | ||
| Audio Input | ||
| Audio Output | ||
| PDF Input | ||
| Prompt Caching | ||
| Web Search |
License & Release
| Property | Phi 4 Multimodal Instruct | WizardLM-2 8x22B |
|---|---|---|
| License | Open Source | Open Source |
| Author | Microsoft | Microsoft |
| Released | Unknown | Apr 2024 |
Phi 4 Multimodal Instruct Modalities
Input
Output
WizardLM-2 8x22B Modalities
Input
text
Output
text