SWE Atlas - Refactoring
swe_atlas · v1 · harbor · judge Claude Opus 4.5 (judge)
70 real-world refactoring tasks across 10 open-source repositories. A trial passes when the repository's tests still pass and an LLM judge confirms every must-have rubric. Official Harbor runner on Modal; Claude Code for Anthropic models, Codex for OpenAI models, mini-swe-agent otherwise, as on Scale's leaderboard.
New run
Sign in to see estimates and start runs.