SimpleQA Leaderboard

Simple question answering benchmark testing factual accuracy and knowledge retrieval.

Data from LayerLens

Models

Best Score

53.0

Average

19.8

Std Dev

13.9

Categories

Reasoning and LogicGeneral Knowledge

SourceLayerLens

Provider	Model	Input $/M	Output $/M	SimpleQA	Actions
G Google	Gemini 2.5 Pro	$1.250	$10.000	53.0	Try
AL Alibaba	Qwen3 235B A22B Instruct 2507	$0.071	$0.100	50.6	Try
AL Alibaba	Qwen3 VL 235B A22B Instruct	$0.200	$0.880	46.7	Try
O OpenAI	GPT-4.1	$2.000	$8.000	40.4	Try
X Xai	Grok 3 Beta	$3.000	$15.000	38.3	Try
QW Qwen	Qwen3 VL 235B A22B Thinking	$0.000	$0.000	37.9	Try
X xAI	Grok 3	$3.000	$15.000	37.4	Try
BD Baidu	ERNIE 4.5 300B A47B	$0.280	$1.100	36.9	Try
A Anthropic	Claude 3.7 Sonnet Thinking	$3.000	$15.000	32.8	Try
A Anthropic	Claude 3.7 Sonnet	$3.000	$15.000	32.8	Try
DS DeepSeek	R1	$0.700	$2.500	29.1	Try
K Kimi	Kimi K2 0711	$0.550	$2.200	26.5	Try
DS DeepSeek	R1 0528	$0.450	$2.150	25.1	Try
DS DeepSeek	DeepSeek V3.1	$0.150	$0.750	23.3	Try
DS DeepSeek	DeepSeek V3.1 Thinking	$0.150	$0.750	23.3	Try
DS Deepseek	DeepSeek V3	$0.320	$0.890	23.0	Try
M Meta	Llama 4 Maverick	$0.150	$0.600	22.1	Try
MI Mistral	Mistral Medium 3.1	$0.400	$2.000	20.5	Try
MI Mistral	Mistral Medium 3	$0.400	$2.000	19.7	Try
X Xai	Grok 3 Mini Beta	$0.300	$0.500	18.4	Try
NO Nous Research	Hermes 3 70B Instruct	$0.300	$0.300	17.1	Try
MI Mistral	Pixtral Large 2411	$2.000	$6.000	16.7	Try
CO Cohere	Command A	$2.500	$10.000	15.8	Try
O OpenAI	o3 Mini	$1.100	$4.400	14.0	Try
AL Alibaba	Qwen3 235B A22B Thinking	$0.455	$1.820	12.7	Try
AL Alibaba	Qwen3 235B A22B	$0.455	$1.820	12.7	Try
AM Amazon	Nova Pro 1.0	$0.800	$3.200	12.6	Try
AL Alibaba	Tongyi DeepResearch 30B A3B	$0.090	$0.450	11.9	Try
MI Mistral	Mistral Small 3.2 24B	$0.060	$0.180	9.7	Try
G Google	Gemma 3 27B	$0.040	$0.150	8.5	Try
A Anthropic	Claude 3.5 Haiku	$0.800	$4.000	8.0	Try
M Meta	Llama 4 Scout	$0.080	$0.300	7.3	Try
MI Mistral	Devstral Small 1.1	$0.100	$0.300	6.7	Try
AM Amazon	Nova Lite 1.0	$0.060	$0.240	6.6	Try
AL Alibaba	Qwen3 30B A3B Thinking	$0.080	$0.280	5.6	Try
AL Alibaba	Qwen3 30B A3B	$0.080	$0.280	5.6	Try
AL Alibaba	Qwen3 32B Thinking	$0.080	$0.240	5.5	Try
AL Alibaba	Qwen3 32B	$0.080	$0.240	5.5	Try
AM Amazon	Nova Micro 1.0	$0.035	$0.140	4.7	Try
G Google	Gemma 3n 4B	$0.020	$0.040	4.0	Try
MS Microsoft Azure	Phi 4	$0.060	$0.140	2.3	Try
M Meta	Llama 3.2 3B Instruct	$0.051	$0.340	0.5	Try

Pricing from OpenRouter. Benchmarks from Artificial Analysis.

Deploy OpenClaw in Under 1 Minute— We handle hosting, scaling, and maintenance

93 out of our 301 tracked models have had a price change in March.

Get our weekly newsletter on pricing changes, new releases, and tools.

About SimpleQA

Simple question answering benchmark testing factual accuracy and knowledge retrieval.

This leaderboard shows all models with SimpleQA benchmark scores, ranked from highest to lowest. Pricing data is included to help you compare performance against cost.