NL2Repo-Bench

nl2repo · v1 · repo

104 long-horizon tasks: generate a complete, runnable Python repository from a natural-language document, graded by the original project's tests (pass rate). Official OpenHands 0.56 harness inside a Docker-capable Modal VM per task.

New run

Sign in to see estimates and start runs.

NL2Repo-Bench · EvalHub