SWE-sweep

100 real repositories in 22 languages, each at a commit holding many real bugs (4,068 in total). With no hints, the agent has 12 hours per repository to find and fix as many as it can; hidden per-bug tests decide, and any regression zeroes the repository. Official Harbor tasks on Modal with mini-swe-agent for every model, as on swesweep.com.