Request a pilot
‹ PublicAI Index

The LLM benchmark aggregator.

GPT-6.1 Sol

OpenAI

Strongest in Language (#2 of 62), weakest in Legal (#100 of 164). Above par in 25 of 27 scopes. Among the models it meets almost everywhere, it finishes behind Claude Fable 5.1 and Claude Fable 5 and ahead of Gemini 4 Argon and Claude Opus 4.6.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Core abilities64.6#3/225
Language65.8#2/62
Data analysis62.9#3/48
General intelligence66.5#7/214
Instruction following61#12/62
Reasoning64.2#4/190
Reasoning65.8#4/144
Mathematics63.7#5/150
Agents63.3#7/289
Long-horizon work69.4#5/48
Web research58.9#9/49
Computer use60.2#12/81
Knowledge work66.1#15/198
Coding61.6#8/176
Agentic coding62.1#8/169
Knowledge57.3#22/191
Document parsing57.8#21/77
Human preference64.3#25/350
Human preference64.3#25/350
Professional54.4#37/188
IT operations73.8#2/31
Biology research66#2/28
Document design60.9#10/48
Medical57.5#24/149
Cybersecurity26.6#45/46
Finance52.9#75/161
Legal48#100/164

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for GPT-6.1 Sol, left for the other.

Beam 1.0won 17 · lost 0
DeepSeek V4 Flash Visionwon 17 · lost 0
GPT-5.4 miniwon 17 · lost 0
GPT-5.4 nanowon 19 · lost 0
Gemma 4 31Bwon 20 · lost 0
Claude Haiku 4.5won 22 · lost 0
Step 5won 20 · lost 1
Claude Sonnet 4won 16 · lost 1
Kimi K2.5won 16 · lost 1
GPT-6 Lunawon 25 · lost 2
Qwen3.8 27Bwon 23 · lost 2
Inklingwon 22 · lost 2
Mistral Large 4won 21 · lost 2
DeepSeek V4 Flashwon 18 · lost 2
Gemini 3.5 Flash-Litewon 18 · lost 2
GLM-5.2won 16 · lost 2
GPT-5.6 Lunawon 24 · lost 3
Inkling Smallwon 15 · lost 2
Qwen3.7 Maxwon 15 · lost 2
Grok 4.5won 22 · lost 3
MiniMax M3won 21 · lost 3
Claude Sonnet 4.6won 20 · lost 3
Claude Sonnet 5won 22 · lost 4
GPT-5.6 Terrawon 22 · lost 4
GPT-5.4won 16 · lost 3
GPT-5 miniwon 14 · lost 3
MiMo V2.6 Flashwon 14 · lost 3
Kimi K2.6won 14 · lost 3
GPT-6 Solwon 22 · lost 5
GLM-5.3 Flashwon 21 · lost 5
Claude Haiku 5.5won 20 · lost 5
Qwen3.8 Maxwon 19 · lost 5
GPT-5.2won 13 · lost 4
Grok 4.6won 19 · lost 6
GLM-5.3won 19 · lost 6
GPT-5.5won 19 · lost 6
Gemini 3.1 Prowon 19 · lost 6
DeepSeek V4.1 Flashwon 20 · lost 7
Kimi K3won 18 · lost 7
Claude Opus 4.8won 17 · lost 7
GPT-5.6 Solwon 19 · lost 8
Gemini 3.8 Flashwon 19 · lost 8
Muse Spark 1.3won 16 · lost 7
Gemini 3.5 Flashwon 13 · lost 6
Claude Opus 4.7won 13 · lost 6
MiMo V2.6 Prowon 15 · lost 7
Grok 4.7won 17 · lost 8
Muse Spark 1.2won 17 · lost 8
Gemini 3.7 Flashwon 17 · lost 9
Muse Wonderwon 15 · lost 8
Gemini 3.6 Flashwon 13 · lost 7
Muse Spark 1.1won 11 · lost 6
Claude Opus 4.6won 11 · lost 6
Gemini 4 Argonwon 12 · lost 11
Claude Opus 5won 12 · lost 14
Claude Sonnet 5.5won 12 · lost 15
GPT-6 Astrawon 7 · lost 20
Claude Opus 5.5won 7 · lost 20
Claude Fable 5won 6 · lost 18
Claude Fable 5.1won 6 · lost 20

§ 3 · Sources

Where the numbers come from

11 publications, 40 figures. Every one links to the page it was read from.

LMArena Text ↗1 measureread 2026-10-21
LMArena Text 1479
Artificial Analysis ↗1 measureread 2026-10-21
Artificial Analysis Intelligence Index 52
GDPval-AA ↗1 measureread 2026-10-21
GDPval-AA 1592
AA-Briefcase ↗1 measureread 2026-10-21
AA-Briefcase 1556
Terminal-Bench ↗1 measureread 2026-10-21
Terminal-Bench 58.2% (Codex)
ARC-AGI-2 ↗1 measureread 2026-10-21
ARC-AGI-2 94.2%
LiveBench ↗8 measuresread 2026-10-21
LiveBench 85.4LiveBench · Agentic 73LiveBench · Reasoning 92.6LiveBench · Coding 96LiveBench · Browser Use 88LiveBench · Data Analysis 82.7LiveBench · Research 83.5LiveBench · Design 82.1
LiveBench 1.0 ↗8 measuresread 2026-10-21
LiveBench 1.0 81.6LiveBench 1.0 · Reasoning 92.6LiveBench 1.0 · Coding 80.4LiveBench 1.0 · Agentic Coding 54.5LiveBench 1.0 · Mathematics 96.8LiveBench 1.0 · Data Analysis 82.7LiveBench 1.0 · Language 90.1LiveBench 1.0 · Instruction Following 74.2
SimpleBench ↗1 measureread 2026-10-21
SimpleBench 82.9%
Vals.ai ↗11 measuresread 2026-10-21
Vals · Legal Research Bench 38.46%Vals · Harvey Legal Agent Benchmark 6.25%Vals · Finance Agent 52.03%Vals · MedCode 48.84%Vals · MedScribe 86.45%Vals · BioMysteryBench 79.63%Vals · CyberBench 39.29%Vals · SRE Bench 50.76%Vals · Vibe Code Bench 88.93% (OpenHands)Vals · Code Migration 65.12%Vals · ProofBench 99%
ParseBench ↗6 measuresread 2026-10-21
ParseBench · Overall 70.48%ParseBench · Tables 92.44%ParseBench · Charts 37.16%ParseBench · Content faithfulness 89.25%ParseBench · Semantic formatting 74.78%ParseBench · Visual grounding 58.76%

Badge

PublicAI Index badge for GPT-6.1 Sol[![PublicAI Index](https://publicai.io/model-index/badge?model=gpt-6-1-sol)](https://publicai.io/model-index/m/gpt-6-1-sol)