What AI says about ProgramBench

ProgramBench is a research project from Meta Superintelligence Labs, Stanford University, and Harvard University that provides a benchmark for evaluating language models on their ability to rebuild software programs from scratch. It tests AI agents on 200 tasks requiring them to architect and implement complete codebases based solely on compiled binaries and documentation.