Loading…
RepoBench is a benchmark framework for evaluating repository-level code auto-completion systems. It provides datasets for Python and Java (v1.1) and hosts these datasets on the HuggingFace Hub. The project includes installation instructions and defines evaluation settings such as cross_file_first, cross_file_random, and in_file to control masking during evaluation.
AI named RepoBench in February 2026.