ProgramBench

Reverse engineering software from executables and specifications.

100Public tasks
4.3%Highest score

The ProgramBench leaderboard

Tests whether software-engineering agents can rebuild complete programs from scratch given only a program and its documentation, matching a reference executable via end-to-end testing (100 tasks, CLI tools to FFmpeg/SQLite/PHP).

APEX NEWSLETTER

The latest on frontier AI performance, straight to your inbox.

New benchmarks, leaderboard shifts, and research from the APEX team.

By subscribing you agree to receive updates from Mercor.
Unsubscribe anytime.