Trust Layer Patterns
Patterns for autonomous machines that move, lift, cut, and fly, where a bad decision has physical consequences.
- Machine
- Human
- Solid = in control
- State or signal
Group by
Domain
Before
Before the machine acts, does the human agree?
- 04Appropriate FrictionBefore a high-stakes action, the interface makes the operator slow down and confirm.Intervene
- 06Intent PreviewThe machine shows what it is about to do, so a wrong plan is caught before it becomes a wrong action.Know
- 07Capability DisclosureThe machine says what it cannot do and where it will not run, then refuses to engage outside those limits.Know
- 11Readiness CheckThe system confirms the human can actually supervise, and escalates when they cannot.Intervene
During
While it runs, can the human see and predict it?
- 02The Glass BoxThe machine shows its reasoning, not just its output, so operators can trust or override it with context.Know
- 05Shared Mental ModelWhat the human believes about the system's state stays in sync with what that state actually is.Predict
- 14Alert TriageAlerts are ranked by how urgently a human must act, so the critical one isn't buried.Know
- 15Stop AnywhereAnyone near the machine can always stop it with one control, and the stop holds until released.Intervene
Transition
When control changes hands, is the human ready?
- 01The HandoffThe machine yields control on purpose and gives the human time to orient before they are accountable.Intervene
- 12Return of ControlThe machine takes control back visibly, only when conditions are right, and doesn't fight the human.Intervene
- 13Operator-to-Operator HandoverWhen responsibility passes between people, the system carries its true state across.Know
Failure
When it can't do the job, what happens?
After and over time
What happened, and what is it doing to us over time?