- At high volume, Poteto recommends sampling PRs rather than reviewing every one. Review samples rigorously, identify recurring shortcuts or inefficient patterns, then change the environment so future agents avoid them.
49:1549:3750:26 - The goal is not to stop looking at the work. Sampling provides feedback for changing skills, lint rules, constraints, and types; it does not mean treating quality as solved.
51:0451:32 - Poteto says he has more than 10 coordinator agents working across areas, including performance, user-reported bugs, and exploratory rewrites. He reviews their PRs after they land by inspecting commit history, then reverts or changes the environment when needed.
52:1153:32 - In Pstack's full-autopilot mode, each PR can go through verifier agents that run the app, click through it like a user, search for regressions, and ask the implementation agent to fix issues before landing. The process is token-intensive and can be tuned by changing the number of verifier agents.
52:3853:07 - Poteto credits trust in autopilot to the combination of verification and a constrained environment. He describes the transition as scary at first, and says it took sustained work to reach the point where agents could merge while he slept.
53:3254:1454:30
Chapter notes
7. Sampling, verification, and agent merges
Matt Pocock · 1:05:36 · English