Benchmarks

Zapier's business-workflow benchmark: 600 public tasks (Sales, Marketing, Operations, Support, Finance, HR; 100 each) on 47 simulated SaaS apps, graded by deterministic end-state assertions (strict pass rate). Official auto-bench harness, API toolset, 50 steps. Public set only: the zapier.com leaderboard uses a private, harder held-out set, so scores are not directly comparable.