SWE Atlas - Codebase QnA

Muse Wonder 1.0
Muse Wonder 1.0Max
56.5%
DeepSeek-V4.1-Flash
DeepSeek-V4.1-FlashMax
53.5%
Kimi K3
Kimi K3Max
52.7%
Qwen3.8-Max
Qwen3.8-MaxxHigh
50.5%
Opus 5
Opus 5Max
50.3%
Sonnet 5.5
Sonnet 5.5Max
50.3%
Grok 4.6
Grok 4.6xHigh
50.3%
Sonnet 5
Sonnet 5Max
49.5%
Opus 5.5
Opus 5.5Max
48.9%
Haiku 5.5
Haiku 5.5Max
48.7%
GPT-6.1 Sol
GPT-6.1 SolMax
48.4%
GPT-6 Astra
GPT-6 AstraMax
47.8%
Opus 4.7
Opus 4.7Max
47.0%
Grok 4.7
Grok 4.7xHigh
47.0%
GLM-5.2
GLM-5.2Max
46.0%
GPT-5.6 Luna
GPT-5.6 LunaMax
46.0%
GPT-5.5
GPT-5.5xHigh
45.2%
GPT-5.6 Terra
GPT-5.6 TerraMax
45.2%
DeepSeek-V4-Flash
DeepSeek-V4-FlashMax
44.9%
Opus 4.8
Opus 4.8Max
44.4%
GPT-6 Sol
GPT-6 SolMax
44.1%
Fable 5.1
Fable 5.1Max
43.3%
MiMo V2.6 Pro
MiMo V2.6 ProAuto
42.7%
Muse Spark Open
Muse Spark OpenxHigh
42.7%
GLM-5.3
GLM-5.3Max
42.5%
Grok 4.5
Grok 4.5High
41.9%
Gemini 3.8 Flash
Gemini 3.8 FlashHigh
40.6%
MiniMax-M3
MiniMax-M3High
37.9%
GPT-5.4
GPT-5.4xHigh
37.1%
Sonnet 4.6
Sonnet 4.6High
35.5%
GPT-6 Luna
GPT-6 LunaMax
33.9%
Kimi K2.7 Code
Kimi K2.7 CodeHigh
33.1%
Fable 5
Fable 5Max
33.1%
Gemini 3.6 Flash
Gemini 3.6 FlashHigh
32.0%
GPT-5.6 Sol
GPT-5.6 SolMax • Pro
30.9%
Beam
BeamMax
30.9%
DeepSeek-V4-Pro
DeepSeek-V4-ProMax
25.0%
Inkling
InklingHigh
21.2%
Gemini 3.5 Flash
Gemini 3.5 FlashHigh
19.6%
Gemini 3.1 Pro
Gemini 3.1 ProHigh
18.0%
DeepSeek-V3.2
DeepSeek-V3.2
5.9%
Muse Spark 1.1
Muse Spark 1.1xHigh
3.9%
0%
10%
20%
30%
40%
50%
60%
70%
80%

APEX NEWSLETTER

The latest on frontier AI performance, straight to your inbox.

New benchmarks, leaderboard shifts, and research from the APEX team.

By subscribing, you agree to receive updates from Mercor.
Unsubscribe anytime.