Holdouts
Examples of an asset, a verifier and an adjudicator
Asset: the thing judged, pinned to one exact version. Verifier: acts the claim out and collects proof. Adjudicator: rules pass or fail from that proof, against the claim's words. Any job can be a person or an agent.
Web flow
Given a user who was just invited, when they first log in, they see a tutorial.
- Asset
- The web app built from commit a1b2c3…, plus a mailbox inside the test environment.
- Verifier
- An agent invites the user as an admin, opens the email, accepts and logs in, screenshotting each step.
- Adjudicator
- A model reads the first screen after login and rules on "sees a tutorial".
API
Given a free-plan key, when it makes 101 requests in a minute, the 101st is refused.
- Asset
- The API image sha256:9f….
- Verifier
- A script signs up through the public flow for a free key, sends 101 requests and records each status.
- Adjudicator
- A fixed rule: "request 101 returned 429".
Document
The policy states the refund window in days and who approves exceptions.
- Asset
- Revision 7 of the policy.
- Verifier
- An agent pulls out the passages on refunds and exceptions.
- Adjudicator
- A person reads them and rules. That person can hold both verifier and adjudicator, and the record says so.
Physical or manual check
Every outgoing box includes the return label.
- Asset
- Shipment batch 2026-11-14-B.
- Verifier
- A warehouse worker photographs 20 boxes picked at random.
- Adjudicator
- A model checks each photo; a person rules on any it can't decide.