DeepSWE
deepswe · v1 · repo
113 original long-horizon software engineering tasks across 91 open-source repos (Go, Python, TypeScript, Rust, JavaScript), graded by hidden behavioural tests. Official Pier runner on Modal; mini-swe-agent for every model, as on the leaderboard.
New run
Sign in to see estimates and start runs.