Skip to content
Back to all stories
The Decoder

No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark

SemiAnalysis is putting AI agents through simulated knowledge work in its new GDPx benchmark, covering everything from chip design to quant trading. No model breaks 12 percent. Claude Opus 5.5 leads narrowly over Gemini 4 Carbon. Critics point to the small number of tasks per domain and uneven testing conditions.

By The Decoder

Excerpt shared by Lazyfounder

·Excerpt
No AI agent scores above 12 percent on SemiAnalysis' new real-world work benchmark
Image: The GDPx overall ranking averages results across eleven equally weighted domains. No model breaks 12 percent. | Image: SemiAnalysis

The new GDPx benchmark from SemiAnalysis drops AI agents into simulated knowledge work. No model scores above 12 percent. Some critics question how meaningful the test really is.

Analytics firm…

Continue reading on The Decoder ↗

Courtesy

This story was originally published by The Decoder. All rights belong to the original publisher.

Read the original on the-decoder.com ↗
Lazy Founder - Powered by Blogy.in

Contact us

Have a story tip, correction or partnership idea?

Write to us at tarun.kumar@blogy.in or talk to the founder directly. We read every message.

Contact us