BIRD-CRITIC Leaderboard

BIRD-CRITIC — multi-turn benchmark testing SQL generation and database interaction.

Data from LayerLens

Models

Best Score

34.0

Average

27.9

Std Dev

3.6

Categories

Multi-turn

SourceLayerLens

Provider	Model	Input $/M	Output $/M	BIRD-CRITIC	Actions
A Anthropic	Claude Opus 4.6 Thinking	$5.000	$25.000	34.0	Try
A Anthropic	Claude Opus 4.6	$5.000	$25.000	34.0	Try
Z Z AI	GLM 4.7 Thinking	$0.300	$1.400	33.0	Try
Z Z AI	GLM 4.7	$0.300	$1.400	33.0	Try
K Kimi	Kimi K2.5 Thinking	$0.450	$2.200	31.3	Try
K Kimi	Kimi K2.5	$0.450	$2.200	31.3	Try
AL Alibaba	Qwen3 Coder 480B A35B (exacto)	$0.220	$1.000	31.0	Try
AL Alibaba	Qwen3 235B A22B Instruct 2507	$0.071	$0.100	30.9	Try
O OpenAI	GPT-4o	$2.500	$10.000	30.6	Try
A Anthropic	Claude 3.7 Sonnet Thinking	$3.000	$15.000	29.7	Try
A Anthropic	Claude 3.7 Sonnet	$3.000	$15.000	29.7	Try
G Google	Gemini 2.5 Flash Thinking	$0.300	$2.500	29.7	Try
G Google	Gemini 2.5 Flash	$0.300	$2.500	29.7	Try
O OpenAI	GPT-OSS-120b	$0.039	$0.190	25.8	Try
G Google	Gemma 3 27B	$0.040	$0.150	25.8	Try
MM MiniMax	MiniMax M2.1	$0.270	$0.950	25.7	Try
NV NVIDIA	Llama 3.3 Nemotron Super 49B V1.5 Thinking	$0.100	$0.400	25.3	Try
NV NVIDIA	Llama 3.3 Nemotron Super 49B V1.5	$0.100	$0.400	25.3	Try
Z Z AI	GLM 4.6V Thinking	$0.300	$0.900	25.3	Try
Z Z AI	GLM 4.6V	$0.300	$0.900	25.3	Try
MI Mistral AI	Mistral Large 3 2512	$0.500	$1.500	25.0	Try
Z Z AI	GLM-4.7-Flash Thinking	$0.060	$0.400	25.0	Try
Z Z AI	GLM-4.7-Flash	$0.060	$0.400	25.0	Try
P Prime Intellect	INTELLECT-3	$0.200	$1.100	24.7	Try
NV NVIDIA	Nemotron 3 Nano 30B A3B Thinking	$0.050	$0.200	22.7	Try
NV NVIDIA	Nemotron 3 Nano 30B A3B	$0.050	$0.200	22.7	Try
BD Baidu	ERNIE 4.5 300B A47B	$0.280	$1.100	21.7	Try

Pricing from OpenRouter. Benchmarks from Artificial Analysis.

Deploy OpenClaw in Under 1 Minute— We handle hosting, scaling, and maintenance

93 out of our 301 tracked models have had a price change in March.

Get our weekly newsletter on pricing changes, new releases, and tools.

About BIRD-CRITIC

BIRD-CRITIC — multi-turn benchmark testing SQL generation and database interaction.

This leaderboard shows all models with BIRD-CRITIC benchmark scores, ranked from highest to lowest. Pricing data is included to help you compare performance against cost.