- The speakers distinguish reversible changes from one-way changes such as data loss. Poteto's answer is that autonomous merging depends on whether verification can provide enough confidence; strong verification can make some risky actions easier to reverse or trust.
55:4056:30 - Domains that are difficult to verify programmatically are harder to automate safely. Poteto names verifiability as a key factor and says the industry still has to work out how to handle such domains.
56:5357:30 - He points to formal proofs as one way to verify some software or mathematical work. Proof-oriented languages and tools such as Lean and TLA+ let people express properties and check whether cases such as race conditions have been covered.
58:0458:34 - His criterion is practical: when an agent can demonstrate correctness through checks or proofs, merging becomes more defensible; when it cannot, automation should be limited by that uncertainty.
58:58
Chapter notes
8. Verifiability and one-way doors
Matt Pocock · 1:05:36 · English