Key Takeaways
Hermes 3 405B Instruct wins:
- Cheaper input tokens
- Cheaper output tokens
GPT-5.1-Codex wins:
- Larger context window
- Faster response time
- Higher intelligence benchmark
- Better at coding
- Better at math
- Supports vision
Price Advantage
Hermes 3 405B Instruct
Benchmark Advantage
GPT-5.1-Codex
Context Window
GPT-5.1-Codex
Speed
GPT-5.1-Codex
Pricing Comparison
Price Comparison
| Metric | Hermes 3 405B Instruct | GPT-5.1-Codex | Winner |
|---|---|---|---|
| Input (per 1M tokens) | $1.00 | $1.25 | Hermes 3 405B Instruct |
| Output (per 1M tokens) | $1.00 | $10.00 | Hermes 3 405B Instruct |
| Cache Read (per 1M) | N/A | $0.13 | GPT-5.1-Codex |
Using a 3:1 input/output ratio, Hermes 3 405B Instruct is 71% cheaper overall.
Hermes 3 405B Instruct Providers
DeepInfra $1.00 (Cheapest)
GPT-5.1-Codex Providers
OpenAI $1.25 (Cheapest)
Azure $1.25 (Cheapest)
Benchmark Comparison
7
Benchmarks Compared
0
Hermes 3 405B Instruct Wins
0
GPT-5.1-Codex Wins
Benchmark Scores
| Benchmark | Hermes 3 405B Instruct | GPT-5.1-Codex | Winner |
|---|---|---|---|
Intelligence Index Overall intelligence score | - | 43.1 | - |
Coding Index Code generation & understanding | - | 36.6 | - |
Math Index Mathematical reasoning | - | 95.7 | - |
MMLU Pro Academic knowledge | - | 86.0 | - |
GPQA Graduate-level science | - | 86.0 | - |
LiveCodeBench Competitive programming | - | 84.9 | - |
Aider Real-world code editing | 63.9 | - | - |
GPT-5.1-Codex significantly outperforms in coding benchmarks.
Cost vs Quality
X-axis:
Y-axis:
Loading chart...
Other models
Context & Performance
Context Window
Hermes 3 405B Instruct
131,072
tokens
Max output: 16,384 tokens
GPT-5.1-Codex
400,000
tokens
Max output: 128,000 tokens
GPT-5.1-Codex has a 67% larger context window.
Speed Performance
| Metric | Hermes 3 405B Instruct | GPT-5.1-Codex | Winner |
|---|---|---|---|
| Tokens/second | N/A | 103.6 tok/s | |
| Time to First Token | N/A | 6.57s |
Capabilities
Feature Comparison
| Feature | Hermes 3 405B Instruct | GPT-5.1-Codex |
|---|---|---|
| Vision (Image Input) | ||
| Tool/Function Calls | ||
| Reasoning Mode | ||
| Audio Input | ||
| Audio Output | ||
| PDF Input | ||
| Prompt Caching | ||
| Web Search |
License & Release
| Property | Hermes 3 405B Instruct | GPT-5.1-Codex |
|---|---|---|
| License | Open Source | Proprietary |
| Author | Nousresearch | OpenAI |
| Released | Aug 2024 | Nov 2025 |
Hermes 3 405B Instruct Modalities
Input
text
Output
text
GPT-5.1-Codex Modalities
Input
textimage
Output
text