Pattern 08 · After and over time
Provenance Log
Every action that changed the machine's state is recorded with who or what did it, in a way nobody can quietly alter. After Tempe, investigators rebuilt what the car detected and when from its own data.
The mechanism
action taken → open it to inspection
- 01Action takenOperator, remote party or machine
- 02Record the actorWho or what, and from where
- 03 · Key momentPut it beyond reachAppend-only, outside the actor's control
- 04Retain itThrough the life of a dispute
- 05Open it to inspectionA record the operator can read
At 02: The record has to name the party, not just the event. UN R157 requires each stored entry to carry its reason, the date, a timestamp accurate to within a second, and the software version that was running.
At 04: At Tempe the data was still retrievable after the crash: ATG supplied a playback of sensor and vehicle-dynamics information, and investigators built the event timeline from its output.
Without / with the pattern
Anti-pattern: The Unseen Hand
Change applied, then No trace of who, then The operator carries it
The Unseen Hand: the state changes and nothing records which party changed it. When the question is disputed later, the operator has only their word, and whoever built the system has everything else.
With the pattern
Change applied, then Actor recorded, then Responsibility traceable
Every state change carries its author and its time. At Tempe the ADS data held the detection times, the successive classifications and the suppressed brake command, so the sequence could be established rather than argued.
Related patterns
- Complements · 02The Glass BoxThe Glass Box logs the operator's decision and the reasons for it. This pattern covers every other state change, including the ones no operator made.
- Complements · 04Appropriate FrictionFriction makes a consequential action deliberate. The log is what makes it accountable once it has happened.
- Complements · 09Learning LoopThe log is the record of what the machine did; the loop is what carries what the operator noticed. Neither substitutes for the other, and an investigation usually needs both.
- Complements · 13Operator-to-Operator HandoverA handover is a state change with two actors, and worth recording as one. Who accepted the machine, and in what condition, is exactly the question asked afterwards.
Sources
Tempe is this pattern working, and it is worth being exact about why. The system recorded what it detected, how it reclassified the object as the seconds ran down, and the brake command it held back, so the sequence could be established afterwards from the machine's own account of itself rather than from anyone's recollection.3 The record outlived the event. That is the whole requirement. UN R157 now writes it into type approval for automated lane keeping: a data storage system that has to log activation and deactivation with their reasons, every transition demand, suppressed driver input, emergency manoeuvres, detected collisions, minimum risk manoeuvres and severe failures, each entry stamped with the software version that produced it.1
Horizon is the cautionary half, and it fails somewhere more specific than it is usually remembered as failing. The Post Office maintained in court that branch accounts could not be changed remotely.5 Fujitsu engineers could in fact change them, and an engineer's evidence to the inquiry was that such a change need not look any different from the subpostmaster's own entry.6 None of that is a storage problem; the data was all there. A log the other party to a dispute can write to on the same footing as the operator is not evidence of anything, which is why the useful version of this pattern puts the record outside the reach of everyone who can change the state. The second requirement is easier to miss: the record has to be legible to the person whose work it describes, while they can still remember the day in question. A log that only an investigator reads, years later, protects the institution rather than the operator.
- UN Regulation No. 157 — Automated Lane Keeping Systems (ALKS)Standard
- EU AI Act, Article 12 — Record-keepingStandard
- Collision Between Vehicle Controlled by Developmental Automated Driving System and Pedestrian, Tempe, ArizonaIncident
- Post Office Horizon IT Inquiry, Volume 1Incident
- Fujitsu engineers could access and change subpostmasters' accounts remotelyArticle
- Gareth Jenkins testimony to the Post Office Horizon IT InquiryArticle
- 2011 Ernst & Young report on Fujitsu access to subpostmasters' accountsArticle