SWE-bench Multimodal
swebench_multimodal · v1 · repo
Real GitHub issues with screenshots and diagrams from JavaScript/TypeScript repos, graded by the repos' tests (% resolved). SWE-agent's multimodal config for every model; images are shown to the model.
New run
Sign in to see estimates and start runs.