MMLU Leaderboard

Massive Multitask Language Understanding — tests knowledge across 57 subjects.

Data from LayerLens

Models

Best Score

90.5

Average

77.0

Std Dev

18.4

Categories

General Knowledge

SourceLayerLens

Provider	Model	Input $/M	Output $/M	MMLU	Actions
DS DeepSeek	R1 0528	$0.450	$2.150	90.5	Try
X Xai	Grok 3 Mini Beta	$0.300	$0.500	89.2	Try
O OpenAI	o3 Mini	$1.100	$4.400	88.9	Try
K Kimi	Kimi K2 0711	$0.550	$2.200	88.3	Try
O OpenAI	GPT-OSS-120b	$0.039	$0.190	87.6	Try
AL Alibaba	QwQ 32B	$0.150	$0.400	85.9	Try
G Google	Gemini 2.5 Flash Thinking	$0.300	$2.500	85.7	Try
G Google	Gemini 2.5 Flash	$0.300	$2.500	85.7	Try
M Meta	Llama 4 Maverick	$0.150	$0.600	85.5	Try
A Anthropic	Claude 3.7 Sonnet Thinking	$3.000	$15.000	85.3	Try
A Anthropic	Claude 3.7 Sonnet	$3.000	$15.000	85.3	Try
AL Alibaba	Qwen3 30B A3B Thinking	$0.080	$0.280	85.3	Try
AL Alibaba	Qwen3 30B A3B	$0.080	$0.280	85.3	Try
G Google	Gemini 2.0 Flash	$0.100	$0.400	84.8	Try
O OpenAI	GPT-4.1	$2.000	$8.000	84.6	Try
BD Baidu	ERNIE 4.5 300B A47B	$0.280	$1.100	84.5	Try
CO Cohere	Command A	$2.500	$10.000	84.1	Try
DS Deepseek	DeepSeek V3	$0.320	$0.890	83.4	Try
MI Mistral	Mistral Medium 3	$0.400	$2.000	82.6	Try
AM Amazon	Nova Pro 1.0	$0.800	$3.200	78.3	Try
MS Microsoft Azure	Phi 4	$0.060	$0.140	77.6	Try
MI Mistral	Pixtral Large 2411	$2.000	$6.000	77.2	Try
MI Mistral	Mistral Small 3.2 24B	$0.060	$0.180	76.0	Try
MI Mistral	Devstral Small 1.1	$0.100	$0.300	73.5	Try
A Anthropic	Claude 3.5 Haiku	$0.800	$4.000	72.8	Try
AM Amazon	Nova Micro 1.0	$0.035	$0.140	68.9	Try
M Meta	Llama 3.1 405B Instruct	$4.000	$4.000	37.1	Try
M Meta	Llama 4 Scout	$0.080	$0.300	24.6	Try
M Meta	Llama 3.2 3B Instruct	$0.051	$0.340	15.3	Try

Pricing from OpenRouter. Benchmarks from Artificial Analysis.

Deploy OpenClaw in Under 1 Minute— We handle hosting, scaling, and maintenance

93 out of our 301 tracked models have had a price change in March.

Get our weekly newsletter on pricing changes, new releases, and tools.

About MMLU

Massive Multitask Language Understanding — tests knowledge across 57 subjects.

This leaderboard shows all models with MMLU benchmark scores, ranked from highest to lowest. Pricing data is included to help you compare performance against cost.