BIRD-CRITIC Leaderboard

BIRD-CRITIC — multi-turn benchmark testing SQL generation and database interaction.

As of June 2, 2026, the top-scoring model on BIRD-CRITIC is Claude Opus 4.6 at 34.0%, followed by Claude Opus 4.6 at 34.0% and GLM 4.7 at 33.0%. 31 models have been evaluated on this benchmark.

Last updated: June 2, 2026

Models

Best Score

34.0

Average

27.7

Std Dev

3.5

Categories

Multi-turn

SourceLayerLens

Provider	Model	Input $/M	Output $/M	BIRD-CRITIC	Actions
A Anthropic	Claude Opus 4.6 Thinking	$5.000	$25.000	34.0	Try
A Anthropic	Claude Opus 4.6	$5.000	$25.000	34.0	Try
Z Z AI	GLM 4.7 Thinking	$0.400	$1.540	33.0	Try
Z Z AI	GLM 4.7	$0.400	$1.540	33.0	Try
K Kimi	Kimi K2.5 Thinking	$0.400	$1.900	31.3	Try
K Kimi	Kimi K2.5	$0.400	$1.900	31.3	Try
AL Alibaba	Qwen3 Coder 480B A35B (exacto)	$0.220	$0.900	31.0	Try
AL Alibaba	Qwen3 235B A22B Instruct 2507	$0.071	$0.100	30.9	Try
A Anthropic	Claude 3.7 Sonnet Thinking	$3.000	$15.000	29.7	Try
A Anthropic	Claude 3.7 Sonnet	$3.000	$15.000	29.7	Try
G Google	Gemini 2.5 Flash Thinking	$0.300	$2.500	29.7	Try
G Google	Gemini 2.5 Flash Thinking	$0.300	$2.500	29.7	Try
G Google	Gemini 2.5 Flash	$0.300	$2.500	29.7	Try
G Google	Gemini 2.5 Flash	$0.300	$2.500	29.7	Try
O OpenAI	GPT-OSS-120b	$0.039	$0.100	25.8	Try
O OpenAI	GPT-OSS-120b	$0.039	$0.100	25.8	Try
G Google	Gemma 3 27B	$0.080	$0.160	25.8	Try
MM MiniMax	MiniMax M2.1	$0.290	$0.950	25.7	Try
NV NVIDIA	Llama 3.3 Nemotron Super 49B V1.5 Thinking	$0.100	$0.400	25.3	Try
NV NVIDIA	Llama 3.3 Nemotron Super 49B V1.5 Thinking	$0.100	$0.400	25.3	Try
NV NVIDIA	Llama 3.3 Nemotron Super 49B V1.5	$0.100	$0.400	25.3	Try
NV NVIDIA	Llama 3.3 Nemotron Super 49B V1.5	$0.100	$0.400	25.3	Try
Z Z AI	GLM 4.6V Thinking	$0.300	$0.900	25.3	Try
Z Z AI	GLM 4.6V	$0.300	$0.900	25.3	Try
MI Mistral AI	Mistral Large 3 2512	$0.500	$1.500	25.0	Try
Z Z AI	GLM-4.7-Flash Thinking	$0.060	$0.400	25.0	Try
Z Z AI	GLM-4.7-Flash	$0.060	$0.400	25.0	Try
P Prime Intellect	INTELLECT-3	$0.200	$1.100	24.7	Try
NV NVIDIA	Nemotron 3 Nano 30B A3B Thinking	$0.050	$0.200	22.7	Try
NV NVIDIA	Nemotron 3 Nano 30B A3B	$0.050	$0.200	22.7	Try
BD Baidu	ERNIE 4.5 300B A47B	$0.900	$0.900	21.7	Try

Pricing from OpenRouter. Benchmarks from Artificial Analysis.

Get our weekly newsletter on pricing changes, new releases, and tools.

Join the Price Per Token Community

8 Ways to Use Fewer Tokens

About BIRD-CRITIC

BIRD-CRITIC — multi-turn benchmark testing SQL generation and database interaction.

This leaderboard shows all models with BIRD-CRITIC benchmark scores, ranked from highest to lowest. Pricing data is included to help you compare performance against cost.