Request a pilot
‹ PublicAI Index

The LLM benchmark aggregator.

Beam 1.0

Reflection

Strongest in Web research (#25 of 49, on 1 of its 2 boards), weakest in Agents (#186 of 289). Above par in 4 of 17 scopes. Among the models it meets almost everywhere, it finishes behind GPT-6 Astra and GPT-6.1 Sol and ahead of DeepSeek V3 and Mistral Large 3.

§ 1 · Profile

What it is good at

Bars run from 50 — the average of the models each source lists — so right of the line is above par. The middle column is the gap to whoever leads that scope.

Coding53.4#51/176
Agentic coding53.6#49/169
Reasoning43#151/190
Reasoning45.2#87/144
Mathematics39.2#121/150
Core abilities46#152/225
Data analysis42.4#37/48
General intelligence47#130/214
Professional42.4#165/188
Biology research26.1#28/28
Document design42#37/48
Legal43.7#125/164
Agents46.1#186/289
Web research51.7#25/49
Long-horizon work37#40/48
Knowledge work54.8#60/198
Computer use33.2#77/81

§ 2 · Head to head

What it beats, and what beats it

The same models turn up scope after scope. Counted once: where both were placed, who finished higher. Bars run right for Beam 1.0, left for the other.

GPT-4.1 nanowon 10 · lost 1
Gemma 4 31Bwon 13 · lost 2
Nemotron 3.5 Super VLwon 10 · lost 4
Claude Haiku 4.5won 11 · lost 5
GPT-5.4 nanowon 7 · lost 4
MiniMax M3won 10 · lost 6
GPT-5.4 miniwon 6 · lost 5
Gemini 3.5 Flash-Litewon 6 · lost 5
GPT OSS 120Bwon 6 · lost 5
Mistral Large 3won 6 · lost 5
DeepSeek V3won 6 · lost 5
Inklingwon 8 · lost 8
Mistral Large 4won 7 · lost 10
Gemini 3.1 Prowon 7 · lost 10
GPT-4.1 miniwon 4 · lost 7
Inkling Smallwon 4 · lost 7
DeepSeek V3.2won 4 · lost 7
DeepSeek R1won 4 · lost 7
GPT-5 miniwon 4 · lost 7
Gemini 2.5 Prowon 4 · lost 7
Gemini 3.5 Flashwon 4 · lost 7
Muse Spark Openwon 5 · lost 9
GPT-5won 3 · lost 8
Claude Sonnet 4won 3 · lost 9
Kimi K2.5won 3 · lost 9
GLM-5.3 Flashwon 4 · lost 12
DeepSeek V4 Flash Visionwon 3 · lost 12
Claude Sonnet 4.6won 3 · lost 13
Qwen3.8 Maxwon 3 · lost 13
GPT-5.4won 2 · lost 9
Gemini 3.6 Flashwon 2 · lost 9
GPT-5.6 Lunawon 3 · lost 14
GPT-6 Lunawon 3 · lost 14
Muse Spark 1.2won 3 · lost 14
Gemini 3.8 Flashwon 3 · lost 14
Qwen3.8 Flashwon 2 · lost 11
Gemini 3.7 Flashwon 2 · lost 14
Claude Haiku 5.5won 2 · lost 15
MiniMax M3.1 Flashwon 1 · lost 14
Qwen3.8 27Bwon 1 · lost 15
GPT-5.6 Terrawon 1 · lost 15
MiMo V2.6 Prowon 1 · lost 15
Claude Opus 4.8won 1 · lost 15
Muse Spark 1.3won 1 · lost 15
GPT-5.5won 1 · lost 15
Step 5won 1 · lost 16
Claude Sonnet 5.5won 1 · lost 16
Kimi K3won 1 · lost 16
GPT-6 Solwon 1 · lost 16
GPT-5.6 Solwon 1 · lost 16
GLM-5.2won 0 · lost 11
Claude Opus 4.7won 0 · lost 11
MiMo V2.6 Flashwon 0 · lost 11
O3won 0 · lost 11
Muse Wonder Fullwon 0 · lost 11
DeepSeek V4 Flashwon 0 · lost 12
Claude Sonnet 5won 0 · lost 16
GLM-5.3won 0 · lost 16
Grok 4.5won 0 · lost 16
Claude Fable 5.1won 0 · lost 16
Claude Fable 5won 0 · lost 16
Claude Opus 5won 0 · lost 17
Grok 4.6won 0 · lost 17
DeepSeek V4.1 Flashwon 0 · lost 17
Grok 4.7won 0 · lost 17
Claude Opus 5.5won 0 · lost 17
Muse Wonderwon 0 · lost 17
Gemini 4 Argonwon 0 · lost 17
GPT-6.1 Solwon 0 · lost 17
GPT-6 Astrawon 0 · lost 17

§ 3 · Sources

Where the numbers come from

6 publications, 17 figures. Every one links to the page it was read from.

Artificial Analysis ↗1 measureread 2026-10-21
Artificial Analysis Intelligence Index 30
GDPval-AA ↗1 measureread 2026-10-21
GDPval-AA 1177
AA-Briefcase ↗1 measureread 2026-10-21
AA-Briefcase 976
ARC-AGI-2 ↗1 measureread 2026-10-21
ARC-AGI-2 23.5%
LiveBench ↗8 measuresread 2026-10-21
LiveBench 55.5LiveBench · Agentic 17.3LiveBench · Reasoning 80.2LiveBench · Coding 83.9LiveBench · Browser Use 0LiveBench · Data Analysis 66.4LiveBench · Research 72.8LiveBench · Design 67.9
Vals.ai ↗5 measuresread 2026-10-21
Vals · Legal Research Bench 28.85%Vals · Harvey Legal Agent Benchmark 4.58%Vals · BioMysteryBench 42.59%Vals · Vibe Code Bench 66.44% (OpenHands)Vals · ProofBench 18%

Badge

PublicAI Index badge for Beam 1.0[![PublicAI Index](https://publicai.io/model-index/badge?model=beam-1-0)](https://publicai.io/model-index/m/beam-1-0)