Holdouts

Examples of an asset, a verifier and an adjudicator

Asset: the thing judged, pinned to one exact version. Verifier: acts the claim out and collects proof. Adjudicator: rules pass or fail from that proof, against the claim's words. Any job can be a person or an agent.

Web flow

Given a user who was just invited, when they first log in, they see a tutorial.

Asset
The web app built from commit a1b2c3…, plus a mailbox inside the test environment.
Verifier
An agent invites the user as an admin, opens the email, accepts and logs in, screenshotting each step.
Adjudicator
A model reads the first screen after login and rules on "sees a tutorial".

API

Given a free-plan key, when it makes 101 requests in a minute, the 101st is refused.

Asset
The API image sha256:9f….
Verifier
A script signs up through the public flow for a free key, sends 101 requests and records each status.
Adjudicator
A fixed rule: "request 101 returned 429".

Document

The policy states the refund window in days and who approves exceptions.

Asset
Revision 7 of the policy.
Verifier
An agent pulls out the passages on refunds and exceptions.
Adjudicator
A person reads them and rules. That person can hold both verifier and adjudicator, and the record says so.

Physical or manual check

Every outgoing box includes the return label.

Asset
Shipment batch 2026-11-14-B.
Verifier
A warehouse worker photographs 20 boxes picked at random.
Adjudicator
A model checks each photo; a person rules on any it can't decide.