Real-world economically valuable knowledge work.
Evaluates models on real-world, economically valuable tasks spanning most BLS work activities for 44 occupations across nine major GDP sectors.
Model
Score
Opus 5.5Max
Score on the original open-source benchmark: 88.3% / Score on this Mercor-extended benchmark: 75.8%
Sonnet 5.5Max
Score on the original open-source benchmark: 86.5% / Score on this Mercor-extended benchmark: 70.9%
Fable 5.1Max
Score on the original open-source benchmark: 86.6% / Score on this Mercor-extended benchmark: 68.7%
Fable 5.1High
Score on the original open-source benchmark: 81.4% / Score on this Mercor-extended benchmark: 61.5%
Haiku 5.5Max
Score on the original open-source benchmark: 85.5% / Score on this Mercor-extended benchmark: 66.0%
Fable 5Max
Score on the original open-source benchmark: 78.6% / Score on this Mercor-extended benchmark: 65.3%
APEX NEWSLETTER
New benchmarks, leaderboard shifts, and research from the APEX team.
By subscribing, you agree to receive updates from Mercor.Unsubscribe anytime.