/ LLM benchmarks / Language

Language benchmarks

Chat preference rankings (Text Arena Elo) and language comprehension (LiveBench).

DataText Arena2 Oct 2026LiveBenchrelease 2026-06-25fetched3 Oct 2026 10:46 UTC

Text Arena

Text Arena leaderboard, 413 models
#	Model	Score	Input $/M	Output $/M	Context	Votes
1	Gemini 4 Argon HighGoogle	1525Elo ±9	$2.00	$10.00	1M	4.9K
2	Claude Opus 4.6 HighAnthropic	1505Elo ±3	$5.00	$25.00	1M	77.6K
3	Claude Fable 5 HighAnthropic	1504Elo ±4	$10.00	$50.00	1M	38.4K
4	Claude Opus 5.5 HighAnthropic	1504Elo ±9	$4.00	$20.00	1M	4.6K
5	Claude Opus 4.7 HighAnthropic	1501Elo ±4	$5.00	$25.00	1M	64.9K
6	Claude Fable 5.1 MaxAnthropic	1501Elo ±6	$10.00	$50.00	1M	11.8K
7	Claude Opus 4.6Anthropic	1497Elo ±3	$5.00	$25.00	1M	82.2K
8	Gemini 3.8 Flash HighGoogle	1495Elo ±5	$0.75	$3.75	1M	26.3K
9	Muse Spark 1.3 MaxMeta	1494Elo ±6	$1.25	$4.25	1M	12.3K
10	Claude Opus 4.7Anthropic	1494Elo ±4	$5.00	$25.00	1M	66.1K
11	Muse Spark 1.2 (xHigh)Meta	1494Elo ±9	$1.25	$4.25	–	4.4K
12	Muse Spark 1.1Meta	1491Elo ±4	$1.25	$4.25	–	37.2K
13	Claude Opus 5 HighAnthropic	1490Elo ±4	$5.00	$25.00	1M	59.5K
14	Claude Opus 5 MaxAnthropic	1489Elo ±5	$5.00	$25.00	1M	28.9K
15	Muse SparkMeta	1489Elo ±6	–	–	–	14.1K
16	Kimi K3 MaxMoonshot AI	1488Elo ±5	–	–	–	28.3K
17	Gemini 3.7 Flash HighGoogle	1488Elo ±5	$0.75	$3.75	1M	21.5K
18	Gemini 3.1 Pro PreviewGoogle	1487Elo ±3	$1.00	$6.00	1M	121.8K
19	Gemini 3 ProGoogle	1485Elo ±4	$2.00	$12.00	1M	41.9K
20	GPT-5.6 Sol xHighOpenAI	1484Elo ±4	$4.00	$20.00	–	36.7K
21	GPT-6.1 Sol MaxOpenAI	1483Elo ±11	–	–	–	3.1K
22	Gemini 3.6 Flash HighGoogle	1483Elo ±4	$0.75	$3.75	1M	36.1K
23	Qwen 3.8 MaxAlibaba	1482Elo ±5	$2.00	$6.00	1M	23.4K
24	Claude Opus 4.8 HighAnthropic	1482Elo ±4	$5.00	$25.00	1M	64.0K
25	GPT-5.5 HighOpenAI	1481Elo ±4	$5.00	$30.00	1M	69.2K
26	MiMo V2.6 ProXiaomi	1480Elo ±9	$0.43	$0.87	1M	4.1K
27	GLM-5.3 MaxZ.AI	1478Elo ±6	$1.40	$4.40	1M	17.9K
28	Gemini 3.5 Flash HighGoogle	1477Elo ±4	$0.75	$4.50	1M	48.4K
29	GPT-6 Astra MaxOpenAI	1477Elo ±7	–	–	–	9.2K
30	GPT-5.5OpenAI	1477Elo ±4	$5.00	$30.00	1M	70.8K
31	Gemini 3.5 Flash MediumGoogle	1476Elo ±4	$0.75	$4.50	1M	47.2K
32	GLM-5.2 MaxZ.AI	1476Elo ±4	$1.40	$4.40	1M	45.4K
33	GPT-5.2 Chat Latest 20260210OpenAI	1476Elo ±4	$1.75	$14.00	128K	35.9K
34	GPT-5.4 HighOpenAI	1475Elo ±4	$2.50	$15.00	1M	64.6K
35	Qwen 3.7 Max PreviewAlibaba	1475Elo ±10	$1.48	$4.42	1M	3.9K
36	Grok 4.20 Beta1SpaceXAI	1475Elo ±5	–	–	–	27.8K
37	Claude Opus 4.8Anthropic	1475Elo ±4	$5.00	$25.00	1M	65.1K
38	DeepSeek V4.1 Flash MaxDeepSeek	1474Elo ±7	$0.30	$1.20	1M	8.7K
39	Claude Opus 4.5 20251101 High 32KAnthropic	1474Elo ±4	$5.00	$25.00	200K	37.4K
40	GPT-5.5 InstantOpenAI	1473Elo ±5	$5.00	$30.00	1M	27.1K
41	GLM-5.3 FlashZ.AI	1473Elo ±5	$0.06	$0.20	1M	23.0K
42	Gemini 3 FlashGoogle	1473Elo ±4	$0.50	$3.00	1M	31.3K
43	Claude Sonnet 4.6Anthropic	1472Elo ±4	$1.50	$7.50	1M	70.7K
44	Grok 4.20 Beta 0309 ReasoningSpaceXAI	1472Elo ±4	$1.25	$2.50	1M	66.3K
45	Claude Sonnet 5.5 xHighAnthropic	1471Elo ±10	$2.00	$10.00	1M	3.1K
46	Grok 4.20 Multi Agent Beta 0309SpaceXAI	1471Elo ±4	$1.25	$2.50	1M	64.8K
47	Claude Opus 4.5 20251101Anthropic	1470Elo ±3	$5.00	$25.00	200K	72.8K
48	ERNIE 5.1Baidu	1468Elo ±5	$0.56	$2.54	119K	39.4K
49	MiMo V2.5 ProXiaomi	1468Elo ±4	$0.43	$0.87	1M	70.9K
50	Grok 4.5SpaceXAI	1466Elo ±4	$2.00	$6.00	500K	39.8K
51	GPT-5.6 Terra xHighOpenAI	1465Elo ±4	$2.00	$12.00	–	37.7K
52	Grok 4.1 ThinkingSpaceXAI	1465Elo ±3	–	–	–	66.4K
53	GPT-5.4OpenAI	1465Elo ±4	$2.50	$15.00	1M	67.7K
54	Qwen 3.5 Max PreviewAlibaba	1465Elo ±5	$1.20	$6.00	–	22.6K
55	GLM-5.1Z.AI	1465Elo ±4	$1.40	$4.40	203K	58.4K
56	DeepSeek V4 Pro High 20260813DeepSeek	1464Elo ±7	$1.32	$3.96	–	9.8K
57	Claude Sonnet 5 HighAnthropic	1462Elo ±4	$2.00	$10.00	1M	45.7K
58	Kimi K2.6Moonshot AI	1461Elo ±4	$0.95	$4.00	262K	39.9K
59	Qwen 3.6 Max PreviewAlibaba	1460Elo ±8	$1.03	$6.16	262K	5.4K
60	Grok 4.1SpaceXAI	1459Elo ±3	–	–	–	68.5K
61	Gemini 3 Flash (thinking-minimal)Google	1458Elo ±3	$0.50	$3.00	1M	90.8K
62	DeepSeek V4 ProDeepSeek	1458Elo ±4	$1.32	$3.96	1M	57.5K
63	GLM-5Z.AI	1458Elo ±4	$1.00	$3.20	205K	29.2K
64	GPT-6 Sol MaxOpenAI	1457Elo ±7	$2.00	$10.00	1M	8.8K
65	Claude Sonnet 4.5 20250929 High 32KAnthropic	1457Elo ±3	$3.00	$15.00	1M	83.7K
66	Dola Seed 2.0 ProBytedance	1456Elo ±3	–	–	–	78.9K
67	Hy3Tencent	1456Elo ±7	$0.13	$0.53	262K	10.5K
68	Qwen 3.7 PlusAlibaba	1456Elo ±4	$0.32	$1.28	1M	41.9K
69	GPT-5.1 HighOpenAI	1456Elo ±4	$0.63	$5.00	400K	41.6K
70	Claude Sonnet 4.5 20250929Anthropic	1455Elo ±3	$3.00	$15.00	1M	82.4K
71	Gemini 3.5 Flash LiteGoogle	1455Elo ±4	$0.15	$1.25	1M	35.8K
72	DeepSeek V4 Pro High PreviewDeepSeek	1455Elo ±4	$1.32	$3.96	1M	54.8K
73	Grok 4.6 HighSpaceXAI	1454Elo ±5	$2.00	$6.00	500K	23.7K
74	Step 5 PreviewStepfun	1454Elo ±11	–	–	–	2.7K
75	GPT-5.6 Luna xHighOpenAI	1453Elo ±4	$0.20	$1.20	–	38.3K
76	Gemma 4 31BGoogle	1453Elo ±7	$0.99	$1.49	131K	6.1K
77	MiMo V2.6 FlashXiaomi	1452Elo ±8	$0.14	$0.28	1M	6.1K
78	Kimi K2.5 ThinkingMoonshot AI	1450Elo ±3	$0.60	$3.00	–	74.6K
79	GPT-5.3 Chat LatestOpenAI	1450Elo ±4	$1.75	$14.00	128K	34.3K
80	Claude Opus 4.1 20250805 Thinking 16KAnthropic	1450Elo ±3	$15.00	$75.00	200K	49.3K
81	ERNIE 5.0 Preview 1203Baidu	1449Elo ±7	–	–	–	9.8K
82	Claude Opus 4.1 20250805Anthropic	1448Elo ±3	$7.50	$37.50	200K	76.9K
83	MiMo V2 ProXiaomi	1448Elo ±5	$1.10	$3.30	1M	25.4K
84	GPT-5.4 Mini HighOpenAI	1447Elo ±4	$0.75	$4.50	400K	63.3K
85	ERNIE 5.0 0110Baidu	1446Elo ±4	–	–	–	36.4K
86	Gemini 2.5 ProGoogle	1446Elo ±2	$1.25	$10.00	1M	124.8K
87	GPT-4.5 Preview 2025-02-27OpenAI	1445Elo ±6	$75.00	$150.00	128K	14.5K
88	Qwen 3.6 PlusAlibaba	1443Elo ±4	$0.33	$1.95	1M	48.1K
89	ChatGPT-4o Latest 20250326OpenAI	1443Elo ±3	$5.00	$15.00	128K	81.6K
90	GPT-6 Luna MaxOpenAI	1443Elo ±7	$0.10	$0.50	1M	10.0K
91	Grok 4.7 xHighSpaceXAI	1442Elo ±8	$2.00	$6.00	500K	6.4K
92	Qwen 3.5 397B A17BAlibaba	1442Elo ±3	$0.55	$3.50	262K	88.7K
93	GLM-4.7Z.AI	1441Elo ±6	$0.60	$2.20	205K	12.2K
94	Grok 4.3SpaceXAI	1441Elo ±4	$1.25	$2.50	1M	71.2K
95	InklingThinking Machines	1441Elo ±5	$0.95	$4.05	524K	35.2K
96	MiniMax M3MiniMax	1440Elo ±4	$0.30	$1.20	524K	58.8K
97	GPT-5.1OpenAI	1439Elo ±4	$0.63	$5.00	400K	44.3K
98	DeepSeek V4 Flash High PreviewDeepSeek	1438Elo ±4	$0.30	$1.20	1M	51.6K
99	Qwen 3.8 27BAlibaba	1438Elo ±5	$0.40	$3.00	262K	18.5K
100	Gemma 4 26B A4BGoogle	1437Elo ±7	–	–	–	6.1K
101	GPT-5.2 HighOpenAI	1437Elo ±4	$0.88	$7.00	400K	49.5K
102	Longcat Flash Chat 2602 ExpMeituan	1437Elo ±5	–	–	–	29.2K
103	DeepSeek V4 FlashDeepSeek	1436Elo ±4	$0.30	$1.20	1M	51.9K
104	GPT-5.2OpenAI	1436Elo ±3	$0.88	$7.00	400K	83.7K
105	GPT-5 HighOpenAI	1435Elo ±5	$0.63	$5.00	400K	31.5K
106	Qwen 3 Max PreviewAlibaba	1434Elo ±5	$0.78	$3.90	262K	27.2K
107	MiMo V2.5Xiaomi	1434Elo ±4	$0.14	$0.28	1M	47.3K
108	GLM-5v TurboZ.AI	1433Elo ±6	$1.20	$4.00	203K	10.4K
109	Gemini 3.1 Flash Lite PreviewGoogle	1433Elo ±4	$0.25	$1.50	1M	64.0K
110	o3 2025-04-16OpenAI	1432Elo ±4	$2.00	$8.00	200K	58.6K
111	MiMo V2 OmniXiaomi	1431Elo ±6	$0.44	$2.20	256K	20.6K
112	Kimi K2.5 InstantMoonshot AI	1431Elo ±7	$0.45	$2.25	262K	8.4K
113	Grok 4.1 Fast ReasoningSpaceXAI	1430Elo ±3	$0.20	$0.50	128K	57.4K
114	Kimi K2 Thinking TurboMoonshot AI	1430Elo ±3	$0.57	$2.30	131K	63.2K
115	Mistral Medium 3.5Mistral	1427Elo ±6	$0.75	$3.75	262K	11.8K
116	GPT-5 ChatOpenAI	1427Elo ±4	$5.00	$30.00	–	31.0K
117	Amazon Nova Experimental Chat 26 02 10Amazon	1427Elo ±10	–	–	–	3.5K
118	Nvidia Nemotron 3 Ultra 550B A55B Nvfp4NVIDIA	1426Elo ±7	–	–	–	11.5K
119	Claude Opus 4 20250514 Thinking 16KAnthropic	1426Elo ±4	$15.00	$75.00	200K	35.7K
120	Muse GlimmerMeta	1425Elo ±10	–	–	–	3.9K
121	DeepSeek V3.2 Exp ThinkingDeepSeek	1425Elo ±7	$0.27	$0.41	164K	8.9K
122	DeepSeek V3.2DeepSeek	1425Elo ±3	$0.28	$0.42	164K	48.0K
123	GLM-4.6Z.AI	1424Elo ±4	$0.43	$1.75	205K	35.7K
124	Qwen 3 Max 2025-09-23Alibaba	1423Elo ±7	$0.78	$3.90	262K	9.0K
125	DeepSeek V3.2 ThinkingDeepSeek	1423Elo ±4	$0.28	$0.42	164K	42.0K
126	Qwen 3 235B A22B Instruct 2507Alibaba	1422Elo ±3	$0.26	$1.06	–	97.8K
127	DeepSeek V3.2 ExpDeepSeek	1422Elo ±6	$0.27	$0.41	164K	11.9K
128	DeepSeek R1 0528DeepSeek	1422Elo ±6	$0.50	$2.15	164K	18.1K
129	Grok 4 Fast ChatSpaceXAI	1419Elo ±8	$3.00	$15.00	256K	6.3K
130	ERNIE 5.0 Preview 1022Baidu	1419Elo ±9	–	–	–	4.7K
131	Kimi K2 0905 PreviewMoonshot AI	1419Elo ±7	$0.60	$2.50	262K	11.5K
132	Kimi K2 0711 PreviewMoonshot AI	1418Elo ±5	$0.60	$2.50	131K	27.0K
133	DeepSeek V3.1 Terminus ThinkingDeepSeek	1417Elo ±10	$0.27	$1.00	164K	3.4K
134	DeepSeek V3.1DeepSeek	1417Elo ±6	$1.23	$4.94	–	14.5K
135	Qwen 3.5 122B A10BAlibaba	1416Elo ±4	$0.26	$2.08	262K	29.7K
136	DeepSeek V3.1 ThinkingDeepSeek	1416Elo ±7	$1.23	$4.94	–	11.4K
137	MiniMax M2.7MiniMax	1415Elo ±3	$0.30	$1.20	205K	79.9K
138	DeepSeek V3.1 TerminusDeepSeek	1415Elo ±10	$0.27	$1.00	164K	3.6K
139	GPT-4.1 2025-04-14OpenAI	1415Elo ±4	$2.00	$8.00	1M	50.0K
140	Claude Opus 4 20250514Anthropic	1414Elo ±4	$5.00	$25.00	200K	42.8K
141	Mistral Large 3Mistral	1414Elo ±3	$0.50	$1.50	–	79.5K
142	Claude Haiku 4.5 20251001Anthropic	1414Elo ±2	$1.00	$5.00	200K	143.4K
143	Qwen 3 Vl 235B A22B InstructAlibaba	1413Elo ±7	$0.21	$1.90	262K	11.2K
144	Amazon Nova Experimental Chat 26 01 10Amazon	1413Elo ±10	–	–	–	3.5K
145	Grok 3 Preview 02 24SpaceXAI	1411Elo ±4	$3.00	$15.00	131K	32.4K
146	GLM-4.5Z.AI	1411Elo ±5	$0.60	$2.20	131K	23.7K
147	Grok 4 0709SpaceXAI	1411Elo ±4	$1.25	$2.50	256K	39.4K
148	Gemini 2.5 FlashGoogle	1409Elo ±2	$0.30	$2.50	1M	125.0K
149	Hunyuan Hy3 PreviewTencent	1409Elo ±7	$0.29	$1.17	262K	6.9K
150	Qwen 3.5 27BAlibaba	1409Elo ±4	$0.20	$1.56	262K	28.6K
151	Mistral Medium 2508Mistral	1408Elo ±3	$0.40	$2.00	131K	95.0K
152	Inkling SmallThinking Machines	1405Elo ±5	$0.45	$1.20	524K	27.1K
153	Grok 4 Fast ReasoningSpaceXAI	1405Elo ±5	$0.20	$0.50	–	18.1K
154	Gemini 2.5 Flash Preview 09 2025Google	1403Elo ±4	$0.30	$2.50	1M	32.8K
155	Qwen 3 235B A22B No ThinkingAlibaba	1403Elo ±5	$0.46	$1.82	131K	37.3K
156	o1 2024-12-17OpenAI	1402Elo ±4	$15.00	$60.00	200K	27.8K
157	Claude Sonnet 4 20250514 Thinking 32KAnthropic	1402Elo ±4	$3.00	$15.00	200K	33.9K
158	GPT-5.4 Nano HighOpenAI	1401Elo ±4	$0.20	$1.25	400K	62.2K
159	Longcat Flash ChatMeituan	1401Elo ±6	$0.20	$0.80	131K	11.1K
160	Qwen 3 235B A22B Thinking 2507Alibaba	1400Elo ±7	$0.23	$2.30	131K	8.8K
161	Qwen 3 Next 80B A3B InstructAlibaba	1399Elo ±5	$0.10	$1.10	262K	22.6K
162	DeepSeek R1DeepSeek	1398Elo ±5	$0.70	$2.50	64K	18.5K
163	Qwen 3.5 FlashAlibaba	1396Elo ±4	–	–	–	61.7K
164	DeepSeek V3 0324DeepSeek	1396Elo ±4	$1.14	$4.56	–	44.8K
165	Qwen 3 Vl 235B A22B ThinkingAlibaba	1395Elo ±7	$0.40	$4.00	131K	7.8K
166	Hunyuan Vision 1.5 ThinkingTencent	1395Elo ±12	–	–	–	2.2K
167	Amazon Nova Experimental Chat 12 10Amazon	1394Elo ±9	–	–	–	3.7K
168	Qwen 3.5 35B A3BAlibaba	1394Elo ±4	$0.15	$1.00	262K	30.4K
169	Step 3.5 FlashStepfun	1393Elo ±4	$0.10	$0.30	262K	60.2K
170	MiMo V2 Flash (non-thinking)Xiaomi	1392Elo ±3	$0.10	$0.30	262K	48.0K
171	MiniMax M2.5MiniMax	1391Elo ±4	$0.27	$1.08	205K	42.7K
172	o4 Mini 2025-04-16OpenAI	1391Elo ±4	$1.10	$4.40	200K	44.6K
173	Claude Sonnet 4 20250514Anthropic	1391Elo ±4	$3.00	$15.00	200K	38.9K
174	GPT-5 Mini HighOpenAI	1390Elo ±5	$0.13	$1.00	400K	26.6K
175	o1 PreviewOpenAI	1389Elo ±5	$15.00	$60.00	–	31.1K
176	Claude 3.7 Sonnet 20250219 Thinking 32KAnthropic	1388Elo ±4	$3.00	$15.00	200K	38.0K
177	Mistral Medium 2505Mistral	1388Elo ±5	$0.40	$2.00	131K	32.6K
178	Qwen 3 Coder 480B A35B InstructAlibaba	1387Elo ±5	$0.65	$3.25	1M	25.0K
179	Hunyuan T1 20250711Tencent	1387Elo ±9	–	–	–	4.6K
180	MiMo V2 Flash (thinking)Xiaomi	1387Elo ±6	$0.10	$0.30	262K	11.1K
181	Solar Pro4Upstage	1386Elo ±6	$0.09	$0.36	524K	15.8K
182	MiniMax M2.1 PreviewMiniMax	1385Elo ±5	$0.30	$1.20	205K	17.2K
183	GPT-4.1 Mini 2025-04-14OpenAI	1383Elo ±4	$0.40	$1.60	1M	38.5K
184	Hunyuan Turbos 20250416Tencent	1383Elo ±7	–	–	–	10.6K
185	Qwen 3 30B A3B Instruct 2507Alibaba	1383Elo ±5	$0.05	$0.19	262K	23.2K
186	Gemini 2.5 Flash Lite Preview 09 2025 No ThinkingGoogle	1379Elo ±3	$0.10	$0.40	1M	47.3K
187	GLM-4.6vZ.AI	1379Elo ±11	$0.30	$0.90	131K	2.8K
188	Trinity Large PreviewArcee AI	1379Elo ±4	$0.15	$0.45	131K	31.2K
189	Qwen 3 235B A22BAlibaba	1375Elo ±5	$0.46	$1.82	131K	25.8K
190	Gemini 2.5 Flash Lite Preview 06 17 ThinkingGoogle	1375Elo ±5	$0.10	$0.40	1M	32.2K
191	Claude 3.5 Sonnet 20241022Anthropic	1374Elo ±3	$3.00	$15.00	200K	87.6K
192	Qwen 2.5 MaxAlibaba	1374Elo ±4	–	–	–	32.4K
193	GLM-4.5 AirZ.AI	1373Elo ±4	$0.13	$0.85	131K	30.5K
194	Claude 3.7 Sonnet 20250219Anthropic	1373Elo ±4	$3.00	$15.00	200K	42.4K
195	Qwen 3 Next 80B A3B ThinkingAlibaba	1369Elo ±6	$0.15	$1.20	262K	13.4K
196	Trinity Large ThinkingArcee AI	1367Elo ±5	$0.25	$0.80	262K	30.3K
197	Gemma 3 27B ItGoogle	1365Elo ±4	$0.08	$0.45	131K	46.4K
198	GLM-4.7 FlashZ.AI	1365Elo ±6	$0.06	$0.40	200K	12.0K
199	Amazon Nova Experimental Chat 11 10Amazon	1364Elo ±4	–	–	–	26.0K
200	MiniMax M1MiniMax	1364Elo ±4	$0.55	$2.20	1M	34.0K
201	o3 Mini HighOpenAI	1364Elo ±5	$1.10	$4.40	200K	18.6K
202	Grok 3 Mini HighSpaceXAI	1363Elo ±5	$0.25	$1.27	–	15.5K
203	Nvidia Nemotron 3 Super 120B A12BNVIDIA	1360Elo ±7	–	–	–	7.9K
204	Gemini 2.0 Flash 001Google	1360Elo ±4	$0.10	$0.40	1M	43.3K
205	DeepSeek V3DeepSeek	1358Elo ±5	$1.14	$4.56	–	21.8K
206	Grok 3 Mini BetaSpaceXAI	1358Elo ±5	$1.25	$2.50	131K	20.8K
207	Mistral Small 2506Mistral	1356Elo ±5	$0.10	$0.30	32K	17.3K
208	Intellect 3Unknown	1356Elo ±8	$0.20	$1.10	131K	5.4K
209	Command A 03 2025Cohere	1354Elo ±3	$2.50	$10.00	256K	55.5K
210	Gemini 2.0 Flash Lite Preview 02 05Google	1354Elo ±4	$0.07	$0.30	1M	25.0K
211	GLM-4.5vZ.AI	1352Elo ±8	$0.60	$1.80	66K	4.8K
212	GPT-OSS 120BOpenAI	1352Elo ±4	$0.15	$0.60	131K	30.0K
213	Gemini 1.5 Pro 002Google	1351Elo ±3	$3.50	$10.50	2M	55.6K
214	Nvidia Nemotron 3.5 Lightning 30B A3B Nvfp4NVIDIA	1350Elo ±6	–	–	–	14.9K
215	Step 3Stepfun	1349Elo ±8	$0.57	$1.42	66K	6.3K
216	Hunyuan Turbos 20250226Tencent	1349Elo ±12	–	–	–	2.2K
217	Amazon Nova Experimental Chat 10 20Amazon	1348Elo ±6	–	–	–	11.6K
218	o3 MiniOpenAI	1348Elo ±4	$0.55	$2.20	200K	56.6K
219	Llama 3.1 Nemotron Ultra 253B V1NVIDIA	1348Elo ±12	$0.60	$1.80	131K	2.5K
220	Amazon Nova Experimental Chat 10 09Amazon	1347Elo ±11	–	–	–	2.8K
221	Qwen 3 32BAlibaba	1347Elo ±9	$0.08	$0.28	131K	3.9K
222	GPT-4o 2024-05-13OpenAI	1346Elo ±3	$5.00	$15.00	128K	112.9K
223	Qwen Plus 0125Alibaba	1346Elo ±8	$0.40	$1.20	131K	5.8K
224	Ling Flash 2.0Ant Group	1344Elo ±7	–	–	–	6.9K
225	MiniMax M2MiniMax	1343Elo ±8	$0.30	$1.20	205K	6.8K
226	Mercury 2Inception AI	1343Elo ±11	$0.25	$0.75	128K	3.2K
227	Claude 3.5 Sonnet 20240620Anthropic	1343Elo ±3	$3.00	$15.00	200K	82.4K
228	Nvidia Llama 3.3 Nemotron Super 49B V1.5NVIDIA	1343Elo ±10	$0.10	$0.40	131K	3.3K
229	GLM-4 Plus 0111Z.AI	1343Elo ±8	–	–	–	5.8K
230	Gemma 3 12B ItGoogle	1342Elo ±10	$0.05	$0.15	131K	3.8K
231	Hunyuan Turbo 0110Tencent	1341Elo ±12	–	–	–	2.3K
232	Granite 4.2 30BIBM	1340Elo ±10	–	–	–	3.4K
233	GPT-5 Nano HighOpenAI	1338Elo ±7	$0.03	$0.20	400K	8.1K
234	o1 MiniOpenAI	1337Elo ±4	$1.10	$4.40	–	52.0K
235	Gemini Advanced 0514Google	1336Elo ±5	–	–	–	50.1K
236	Qwq 32BAlibaba	1336Elo ±4	$0.50	$1.00	16K	25.1K
237	Grok 2 2024-08-13SpaceXAI	1336Elo ±4	$2.00	$10.00	131K	63.5K
238	GPT-4o 2024-08-06OpenAI	1336Elo ±4	$2.50	$10.00	128K	45.5K
239	Llama 3.1 405B Instruct Bf16Meta	1335Elo ±4	$4.00	$4.00	33K	41.4K
240	Nova 2 LiteAmazon	1335Elo ±6	$0.30	$2.50	1M	12.4K
241	Step 2 16K Exp 202412Stepfun	1334Elo ±9	–	–	–	4.8K
242	Llama 3.1 405B Instruct Fp8Meta	1334Elo ±4	$4.00	$4.00	33K	59.7K
243	Olmo 3.1 32B InstructAi2	1329Elo ±6	$0.20	$0.60	66K	11.8K
244	Yi LightningUnknown	1328Elo ±5	–	–	–	27.3K
245	Llama 3.3 Nemotron 49B Super V1NVIDIA	1328Elo ±12	–	–	–	2.2K
246	Llama 4 Maverick 17B 128e InstructMeta	1327Elo ±4	$0.63	$1.80	131K	39.3K
247	Qwen 3 30B A3BAlibaba	1326Elo ±5	$0.12	$0.50	131K	26.0K
248	Hunyuan Large 2025-02-10Tencent	1326Elo ±10	–	–	–	3.7K
249	Claude 3.5 Haiku 20241022Anthropic	1325Elo ±3	$1.00	$5.00	200K	68.9K
250	GPT-4 Turbo 2024-04-09OpenAI	1324Elo ±4	$10.00	$30.00	128K	98.1K
251	Gemini 1.5 Pro 001Google	1324Elo ±4	$3.50	$10.50	2M	79.1K
252	DeepSeek V2.5 1210DeepSeek	1323Elo ±8	–	–	–	6.8K
253	Ring Flash 2.0Ant Group	1323Elo ±7	–	–	–	6.9K
254	GPT-4.1 Nano 2025-04-14OpenAI	1322Elo ±8	$0.10	$0.40	1M	6.1K
255	Claude 3 Opus 20240229Anthropic	1322Elo ±3	$15.00	$75.00	200K	194.9K
256	Molmo 2 8BAi2	1322Elo ±21	$0.20	$0.20	37K	818
257	Llama 4 Scout 17B 16e InstructMeta	1322Elo ±5	$0.05	$0.10	16K	29.7K
258	Step 1o Turbo 202506Stepfun	1320Elo ±7	–	–	–	8.8K
259	GLM-4 PlusZ.AI	1319Elo ±5	$0.44	$1.76	205K	26.1K
260	Qwen Max 0919Alibaba	1318Elo ±6	$1.60	$6.40	33K	16.5K
261	Llama 3.3 70B InstructMeta	1318Elo ±4	$0.10	$0.32	131K	54.4K
262	GPT-4o Mini 2024-07-18OpenAI	1318Elo ±4	$0.15	$0.60	128K	68.7K
263	GPT-OSS 20BOpenAI	1318Elo ±6	$0.02	$0.11	131K	10.4K
264	Gemma 3n E4B ItGoogle	1317Elo ±5	$0.06	$0.12	33K	22.0K
265	Qwen 2.5 Plus 1127Alibaba	1315Elo ±6	–	–	–	10.2K
266	Mistral Large 2407Mistral	1314Elo ±4	$2.00	$6.00	131K	45.5K
267	Athene V2 ChatUnknown	1314Elo ±5	–	–	–	24.7K
268	Nvidia Nemotron 3 Nano 30B A3B Bf16NVIDIA	1314Elo ±5	$0.06	$0.24	262K	15.7K
269	GPT-4 0125 PreviewOpenAI	1313Elo ±4	$10.00	$30.00	128K	93.4K
270	GPT-4 1106 PreviewOpenAI	1313Elo ±4	$10.00	$30.00	128K	100.1K
271	Hunyuan Standard 2025-02-10Tencent	1311Elo ±10	–	–	–	3.9K
272	Gemini 1.5 Flash 002Google	1309Elo ±4	$0.07	$0.30	1M	34.9K
273	Grok 2 Mini 2024-08-13SpaceXAI	1308Elo ±4	$2.00	$10.00	131K	52.6K
274	DeepSeek V2.5DeepSeek	1307Elo ±5	–	–	–	24.6K
275	Athene 70B 0725Unknown	1307Elo ±6	–	–	–	19.6K
276	Olmo 3 32B ThinkAi2	1306Elo ±8	$0.15	$0.50	66K	5.8K
277	Mistral Large 2411Mistral	1306Elo ±4	$2.00	$6.00	128K	28.1K
278	MercuryInception AI	1305Elo ±14	$0.25	$0.75	128K	1.9K
279	Magistral Medium 2506Mistral	1305Elo ±6	$2.00	$5.00	40K	11.4K
280	Granite 4.1 8BIBM	1304Elo ±10	$0.05	$0.10	131K	4.2K
281	Gemma 3 4B ItGoogle	1303Elo ±9	$0.05	$0.10	131K	4.2K
282	Mistral Small 3.1 24B Instruct 2503Mistral	1303Elo ±5	$0.10	$0.30	32K	32.6K
283	Qwen 2.5 72B InstructAlibaba	1303Elo ±4	$1.20	$1.20	–	39.4K
284	Llama 3.1 Nemotron 70B InstructNVIDIA	1299Elo ±8	$1.20	$1.20	131K	7.1K
285	Hunyuan Large VisionTencent	1294Elo ±9	–	–	–	5.2K
286	Llama 3.1 70B InstructMeta	1293Elo ±4	$0.40	$0.40	131K	55.2K
287	Amazon Nova Pro V1.0Amazon	1290Elo ±5	$0.80	$3.20	300K	24.7K
288	Granite 4.2 3BIBM	1290Elo ±12	–	–	–	3.2K
289	Gemma 2 27B ItGoogle	1289Elo ±3	$0.65	$0.65	8K	75.8K
290	Jamba 1.5 LargeUnknown	1289Elo ±7	$2.00	$8.00	256K	8.7K
291	Granite 4.2 8BIBM	1288Elo ±11	$0.06	$0.25	131K	3.2K
292	Reka Core 20240904Unknown	1288Elo ±7	–	–	–	7.3K
293	GPT-4 0314OpenAI	1288Elo ±5	$30.00	$60.00	8K	54.2K
294	Ibm Granite H SmallIBM	1287Elo ±8	–	–	–	5.6K
295	Llama 3.1 Nemotron 51B InstructNVIDIA	1287Elo ±10	–	–	–	3.7K
296	Gemini 1.5 Flash 001Google	1286Elo ±5	$0.07	$0.30	1M	62.8K
297	Olmo 3.1 32B ThinkAi2	1286Elo ±7	$0.15	$0.50	66K	8.3K
298	Llama 3.1 Tulu 3 70BAi2	1286Elo ±10	–	–	–	2.8K
299	Claude 3 Sonnet 20240229Anthropic	1281Elo ±4	$3.00	$15.00	200K	109.3K
300	Gemma 2 9B It SimpoGoogle	1280Elo ±7	$0.03	$0.09	8K	10.1K
301	Nemotron 4 340B InstructNVIDIA	1277Elo ±5	–	–	–	19.7K
302	Llama 3 70B InstructMeta	1277Elo ±4	$0.51	$0.74	8K	156.9K
303	Command R Plus 08 2024Cohere	1276Elo ±7	$2.50	$10.00	128K	9.9K
304	GPT-4 0613OpenAI	1276Elo ±4	$30.00	$60.00	8K	88.7K
305	Mistral Small 24B Instruct 2501Mistral	1274Elo ±6	$0.05	$0.08	33K	14.7K
306	GLM-4 0520Z.AI	1273Elo ±7	–	–	–	9.8K
307	Reka Flash 20240904Unknown	1272Elo ±7	–	–	–	7.5K
308	Qwen 2.5 Coder 32B InstructAlibaba	1271Elo ±8	$0.87	$0.87	32K	5.4K
309	C4ai Aya Expanse 32BCohere	1267Elo ±5	$0.50	$1.50	128K	27.1K
310	Gemma 2 9B ItGoogle	1267Elo ±4	$0.03	$0.09	8K	54.6K
311	DeepSeek Coder V2DeepSeek	1265Elo ±6	$0.14	$0.28	128K	15.1K
312	Qwen 2 72B InstructAlibaba	1262Elo ±5	$0.90	$0.90	33K	37.3K
313	Command R PlusCohere	1262Elo ±4	$3.00	$15.00	128K	77.6K
314	Claude 3 Haiku 20240307Anthropic	1262Elo ±4	$0.25	$1.25	200K	117.7K
315	Amazon Nova Lite V1.0Amazon	1260Elo ±5	$0.06	$0.24	300K	19.4K
316	Gemini 1.5 Flash 8B 001Google	1259Elo ±4	$0.07	$0.30	1M	35.6K
317	Phi 4Microsoft	1256Elo ±5	$0.07	$0.14	16K	24.1K
318	Olmo 2 0325 32B InstructAi2	1252Elo ±11	$0.05	$0.20	128K	3.3K
319	Command R 08 2024Cohere	1250Elo ±7	$0.15	$0.60	128K	10.1K
320	Mistral Large 2402Mistral	1242Elo ±5	$8.00	$24.00	32K	62.4K
321	Amazon Nova Micro V1.0Amazon	1241Elo ±5	$0.04	$0.14	128K	19.4K
322	Jamba 1.5 MiniUnknown	1240Elo ±7	$0.20	$0.40	256K	8.9K
323	Ministral 8B 2410Mistral	1238Elo ±9	$0.10	$0.10	131K	4.8K
324	Gemini Pro Dev ApiGoogle	1237Elo ±7	$0.35	$1.05	33K	18.4K
325	Qwen 1.5 110B ChatAlibaba	1234Elo ±6	–	–	–	26.2K
326	Reka Flash 21B 20240226 OnlineUnknown	1233Elo ±7	–	–	–	15.4K
327	Qwen 1.5 72B ChatAlibaba	1233Elo ±5	–	–	–	39.3K
328	Hunyuan Standard 256KTencent	1233Elo ±12	–	–	–	2.7K
329	Mixtral 8x22b Instruct V0.1Mistral	1230Elo ±5	$0.90	$0.90	66K	51.4K
330	Command RCohere	1227Elo ±5	$0.15	$0.60	128K	54.0K
331	Reka Flash 21B 20240226Unknown	1227Elo ±6	–	–	–	24.8K
332	GPT-3.5 Turbo 0125OpenAI	1226Elo ±5	$0.50	$1.50	16K	66.2K
333	Llama 3 8B InstructMeta	1224Elo ±4	$0.14	$0.14	8K	104.6K
334	Gemini ProGoogle	1224Elo ±12	$0.35	$1.05	33K	6.4K
335	C4ai Aya Expanse 8BCohere	1223Elo ±7	–	–	–	9.8K
336	Mistral MediumMistral	1223Elo ±5	$1.50	$7.50	262K	34.5K
337	Llama 3.1 Tulu 3 8BAi2	1220Elo ±11	–	–	–	2.9K
338	Zephyr Orpo 141B A35B V0.1Unknown	1213Elo ±11	–	–	–	4.7K
339	Yi 1.5 34B ChatUnknown	1213Elo ±5	–	–	–	24.1K
340	Llama 3.1 8B InstructMeta	1211Elo ±4	$0.05	$0.08	131K	49.6K
341	Granite 3.1 8B InstructIBM	1208Elo ±11	–	–	–	3.1K
342	GPT-3.5 Turbo 1106OpenAI	1204Elo ±9	$1.00	$2.00	16K	16.6K
343	Qwen 1.5 32B ChatAlibaba	1204Elo ±6	–	–	–	21.7K
344	Gemma 2 2B ItGoogle	1200Elo ±4	–	–	–	46.6K
345	Phi 3 Medium 4K InstructMicrosoft	1198Elo ±5	$0.17	$0.68	–	25.1K
346	Mixtral 8x7b Instruct V0.1Mistral	1197Elo ±4	$0.63	$0.63	32K	73.5K
347	Dbrx Instruct PreviewUnknown	1195Elo ±6	$0.60	$0.60	33K	32.2K
348	Qwen 1.5 14B ChatAlibaba	1191Elo ±7	$0.30	$0.30	–	17.8K
349	Internlm2 5 20B ChatUnknown	1191Elo ±7	$0.00	$0.00	33K	9.9K
350	DeepSeek Llm 67B ChatDeepSeek	1185Elo ±11	–	–	–	4.9K
351	Wizardlm 70BMicrosoft	1185Elo ±9	–	–	–	8.2K
352	Yi 34B ChatUnknown	1184Elo ±7	$0.90	$0.90	4K	15.5K
353	Granite 3.0 8B InstructIBM	1183Elo ±9	–	–	–	6.6K
354	Openchat 3.5Unknown	1183Elo ±10	$0.20	$0.20	–	8.0K
355	Openchat 3.5 0106Unknown	1183Elo ±8	–	–	–	12.6K
356	Gemma 1.1 7B ItGoogle	1183Elo ±6	$0.03	$0.09	8K	23.9K
357	Snowflake Arctic InstructUnknown	1180Elo ±6	–	–	–	32.8K
358	Granite 3.1 2B InstructIBM	1179Elo ±11	–	–	–	3.2K
359	Tulu 2 Dpo 70BUnknown	1178Elo ±10	–	–	–	6.5K
360	Openhermes 2.5 Mistral 7BUnknown	1176Elo ±10	$0.17	$0.17	–	5.0K
361	Vicuna 33BUnknown	1173Elo ±6	$0.00	$0.00	2K	22.5K
362	Phi 3 Small 8K InstructMicrosoft	1171Elo ±6	$0.15	$0.60	–	17.8K
363	Starling Lm 7B BetaUnknown	1171Elo ±7	–	–	–	16.1K
364	Llama 2 70B ChatMeta	1171Elo ±5	$0.70	$2.80	4K	38.5K
365	Starling Lm 7B AlphaUnknown	1167Elo ±8	–	–	–	10.2K
366	Llama 3.2 3B InstructMeta	1167Elo ±8	$0.05	$0.33	131K	7.9K
367	Nous Hermes 2 Mixtral 8x7b DpoUnknown	1164Elo ±12	$0.90	$0.90	–	3.8K
368	Granite 3.0 2B InstructIBM	1157Elo ±8	–	–	–	6.8K
369	Llama2 70B Steerlm ChatNVIDIA	1155Elo ±13	–	–	–	3.6K
370	Qwq 32B PreviewAlibaba	1154Elo ±11	$0.50	$1.00	16K	3.2K
371	Solar 10.7B Instruct V1.0Unknown	1152Elo ±13	$0.30	$0.30	–	4.2K
372	Dolphin 2.2.1 Mistral 7BUnknown	1152Elo ±15	$0.50	$0.50	16K	1.7K
373	Mpt 30B ChatUnknown	1151Elo ±12	–	–	–	2.6K
374	Wizardlm 13BMicrosoft	1149Elo ±9	$0.30	$0.30	–	7.0K
375	Mistral 7B Instruct V0.2Mistral	1149Elo ±7	$0.20	$0.20	33K	19.4K
376	Falcon 180B ChatUnknown	1148Elo ±17	–	–	–	1.3K
377	Qwen 1.5 7B ChatAlibaba	1144Elo ±10	$0.20	$0.20	–	4.7K
378	Phi 3 Mini 4K Instruct June 2024Microsoft	1143Elo ±6	$0.13	$0.52	4K	12.3K
379	Vicuna 13BUnknown	1142Elo ±7	$0.30	$0.30	–	19.4K
380	Llama 2 13B ChatMeta	1141Elo ±7	$0.25	$0.25	4K	19.2K
381	Qwen 14B ChatAlibaba	1139Elo ±11	–	–	–	5.0K
382	Palm 2Google	1139Elo ±9	$0.50	$0.50	26K	8.6K
383	Gemma 7B ItGoogle	1138Elo ±9	$0.05	$0.08	8K	8.9K
384	Codellama 34B InstructMeta	1137Elo ±9	$0.35	$1.40	16K	7.4K
385	Zephyr 7B BetaUnknown	1131Elo ±9	$0.15	$0.15	16K	11.1K
386	Phi 3 Mini 128K InstructMicrosoft	1130Elo ±7	$0.13	$0.52	–	20.7K
387	Phi 3 Mini 4K InstructMicrosoft	1128Elo ±6	$0.13	$0.52	–	20.1K
388	Guanaco 33BUnknown	1127Elo ±12	–	–	–	2.9K
389	Zephyr 7B AlphaUnknown	1127Elo ±16	–	–	–	1.8K
390	Stripedhyena Nous 7BUnknown	1122Elo ±11	$0.20	$0.20	–	5.2K
391	Codellama 70B InstructMeta	1119Elo ±18	$0.70	$2.80	16K	1.1K
392	Gemma 1.1 2B ItGoogle	1117Elo ±8	–	–	–	10.9K
393	Vicuna 7BUnknown	1115Elo ±9	$0.20	$0.20	–	6.9K
394	Smollm2 1.7B InstructUnknown	1115Elo ±14	–	–	–	2.2K
395	Llama 3.2 1B InstructMeta	1111Elo ±8	$0.03	$0.20	60K	8.0K
396	Mistral 7B InstructMistral	1110Elo ±9	$0.07	$0.28	4K	9.0K
397	Llama 2 7B ChatMeta	1108Elo ±7	$0.15	$0.15	4K	14.1K
398	Gemma 2B ItGoogle	1094Elo ±11	$0.10	$0.10	–	4.8K
399	Qwen 1.5 4B ChatAlibaba	1091Elo ±9	$0.10	$0.10	–	7.6K
400	Olmo 7B InstructAi2	1074Elo ±11	$0.20	$0.20	–	6.3K
401	Koala 13BUnknown	1071Elo ±10	–	–	–	7.0K
402	Alpaca 13BUnknown	1070Elo ±11	–	–	–	5.7K
403	Gpt4all 13B SnoozyOpenAI	1068Elo ±15	–	–	–	1.7K
404	Mpt 7B ChatUnknown	1063Elo ±12	–	–	–	3.9K
405	Chatglm3 6BZ.AI	1057Elo ±12	–	–	–	4.7K
406	RWKV 4 Raven 14BUnknown	1042Elo ±11	–	–	–	4.8K
407	Chatglm2 6BZ.AI	1025Elo ±14	–	–	–	2.7K
408	Oasst Pythia 12BUnknown	1023Elo ±11	–	–	–	6.3K
409	Chatglm 6BZ.AI	996Elo ±12	–	–	–	4.9K
410	Fastchat T5 3BUnknown	992Elo ±12	–	–	–	4.2K
411	Dolly V2 12BUnknown	982Elo ±13	–	–	–	3.4K
412	Llama 13BMeta	975Elo ±16	$0.23	$0.23	–	2.4K
413	Stablelm Tuned Alpha 7BUnknown	953Elo ±13	–	–	–	3.3K

LiveBench Language · CC BY-SA 4.0

View original source

LiveBench Language leaderboard, 58 models
#	Model	Score	Cost/solved task
1	Claude Fable 5 Max EffortAnthropic	90.7%	$1.44
2	GPT-6.1 Sol Max EffortOpenAI	90.1%	$0.14
3	Claude Fable 5.1 Max EffortAnthropic	89.5%	$1.21
4	GPT-6 Astra Max EffortOpenAI	89.4%	$0.74
5	Claude 5 Opus Thinking Max EffortAnthropic	88.7%	$0.70
6	Gemini 3.8 Flash HighGoogle	87.8%	$0.31
7	GPT-5.6 Sol Max EffortOpenAI	87.7%	$0.52
8	GPT-5.5 Thinking xHigh EffortOpenAI	87.4%	$0.43
9	Claude 5.5 Opus Thinking Max EffortAnthropic	86.3%	$0.80
10	Kimi K3Moonshot AI · open weights	85.5%	$0.35
11	Gemini 3.7 Flash HighGoogle	85.5%	$0.16
12	Gemini 3.1 Pro Preview HighGoogle	85.4%	$0.29
13	GPT-6 Sol Max EffortOpenAI	85.3%	$0.27
14	Gemini 3.5 Flash HighGoogle	84.6%	$0.25
15	Gemini 3.6 Flash HighGoogle	83.9%	$0.23
16	Grok 4.6 xHighxAI	83.7%	$0.21
17	Claude Sonnet 5.5 xHigh EffortAnthropic	83.4%	$0.14
18	Claude 4.6 Opus Thinking High EffortAnthropic	83.3%	$0.40
19	GPT-5.6 Terra Max EffortOpenAI	82.9%	$0.35
20	Muse Spark 1.3 xHigh EffortMeta	82.8%	$0.22
21	Grok 4.5xAI	82.8%	$0.13
22	GPT-5.4 Thinking xHigh EffortOpenAI	82.6%	$0.39
23	DeepSeek V4 Pro 0813DeepSeek · open weights	82.1%	$0.044
24	Claude 4.5 Opus Thinking High EffortAnthropic	81.3%	$0.61
25	DeepSeek V4.1 Flash Max EffortDeepSeek · open weights	81.2%	$0.029
26	DeepSeek V4 Flash Vision ExpDeepSeek · open weights	80.4%	$0.051
27	Grok 4.7 xHighxAI	80.1%	$0.72
28	GLM-5.3Z.AI · open weights	79.9%	$0.45
29	GPT-5.2 HighOpenAI	79.8%	$0.23
30	Qwen 3.8 MaxAlibaba · open weights	79.7%	$0.28
31	Claude 4.8 Opus Thinking Max EffortAnthropic	79.7%	$0.98
32	Qwen 3.7 MaxAlibaba	79.7%	$0.18
33	DeepSeek V4 Flash 0731DeepSeek · open weights	79.2%	$0.060
34	Muse Spark 1.2 xHigh EffortMeta	78.6%	$0.38
35	Claude 4.7 Opus Thinking xHigh EffortAnthropic	77.9%	$0.53
36	Kimi K2.7 CodeMoonshot AI · open weights	77.9%	$0.10
37	GLM-5.3 FlashZ.AI · open weights	77.3%	$0.031
38	Minimax M3MiniMax	76.8%	$0.060
39	GLM-5.2Z.AI · open weights	76.2%	$0.23
40	Claude 4.6 Sonnet Thinking Medium EffortAnthropic	76.1%	$0.31
41	Kimi K2.6 ThinkingMoonshot AI · open weights	75.1%	$0.17
42	Claude Sonnet 5 xHigh EffortAnthropic	75.0%	$0.51
43	Qwen 3.6 PlusAlibaba	75.0%	$0.23
44	Qwen 3.8 Flash NextAlibaba · open weights	74.6%	$0.042
45	Muse Spark 1.1 xHigh EffortMeta	74.3%	$0.20
46	Qwen3.8 27BAlibaba · open weights	74.3%	$0.094
47	GPT-6 Luna Max EffortOpenAI	73.8%	$0.026
48	GPT-5.2 CodexOpenAI	73.7%	$0.19
49	Grok 4.3xAI	73.6%	$0.061
50	Inkling xHigh EffortThinking Machines · open weights	73.5%	$0.31
51	GPT-5.6 Luna Max EffortOpenAI	72.6%	$0.17
52	Grok Build 0.1xAI	72.5%	$0.024
53	Gemini 3.5 Flash-Lite HighGoogle	71.8%	$0.069
54	GPT-5.4 Mini xHighOpenAI	71.0%	$0.33
55	Nemotron 3 Ultra 550B A55BNVIDIA · open weights	70.8%	$0.37
56	Ox Alpha MaxStealth	66.1%	–
57	Qwen 3.6 27BAlibaba · open weights	63.3%	$0.20
58	GPT-5.4 Nano xHighOpenAI	62.5%	$0.091

Need a model picked for your use case?

Benchmarks rank models on other people's tasks. For a business workflow I test the shortlist on your own data, costs and privacy requirements, and recommend one.

AI consulting