Problem
The first benchmark started both agents inside pre-created worktrees. The Stim arm also loaded Expo skills. The run did not test a warm main checkout followed by an agent-created isolated worktree.
Acceptance criteria
- Build the main checkout before either timed run.
- Start each fresh agent in the main checkout.
- Require each agent to create its own isolated worktree.
- Allow only Stim and Agent Device skills in the Stim arm.
- Disable all skills in the control arm, including Expo skills.
- Record commands, elapsed time, cache behavior, retries, and screenshot or recording evidence.
Problem
The first benchmark started both agents inside pre-created worktrees. The Stim arm also loaded Expo skills. The run did not test a warm main checkout followed by an agent-created isolated worktree.
Acceptance criteria