Third-party review

An independent review of someone else’s AI or system. Every finding is cited to evidence you can re-open, or refused by name. We say what we could measure and what we could not.

What a review of someone else’s system gives you

You are buying, funding, insuring or relying on an AI system you did not build. We read the documents its makers hand over — policies, model and system cards, evaluation reports, contracts — against the clauses you need checked, and give you one finding per clause: the evidence is present, absent or contradicted, or the documents do not answer it and we say so.

Every finding points at the passage it rests on, so you can open the document and check it yourself. A clause the documents do not answer is refused by name, never filled in. Findings are ranked on three axes: how serious, how thinly evidenced, and how cheap to fix. The Pareto frontier of those three, the findings no other finding beats on all three at once, is what to fix first, and the report opens on it.

Each report names every check it ran, the version of our engine that ran it and the date, and it carries a signed statement you can verify without contacting us.

What we check a system against

Beyond the clauses you choose, every review checks six properties of a system that keeps an honest account of itself:

And the clauses you send are read against the frameworks buyers and regulators are asking about this year:

How a review engagement runs

The same three shapes as every engagement. A diagnostic of about a week reads one system’s documents against the clauses you name and ends in the ranked report. A pilot repeats it on the systems you depend on most, with the clause list agreed in writing first. Build and hand over puts the review in your own hands: your team runs it on every new supplier through the professional API, as the assurance_review call.

The honest limit: what we are not, and what we have not measured

We are not a certification body, and this report does not say "compliant" or "certified". It says evidence present, absent or contradicted, at commit X on date Y, by instrument Z. Certification is the job of the bodies authorised to certify; a review from us is the evidence you take to one, or use to decide whether you need one.

All six properties can only be re-checked when the system runs on our platform. When it does not, those findings read “not measurable”, by name, and the clause findings carry what its own documents say. We hold no licensed copy of any regulation or standard: you send the clause wording you want checked.

The review’s accuracy on third-party documents is not yet measured. These are the bars it has to meet before we publish a figure, and each cell below changes only when a measured run fills it.

The review’s own bars, not yet measured
What is measuredThe barMeasured
Clauses the documents do answer, refused anywayat most one in tennot yet measured
Clauses refused once the passage that answers them is removedat least nine in tennot yet measured
False claims we planted, read as supportedat most one in tennot yet measured
The same ranked list on two runs over the same documentsevery timenot yet measured

Where this starts

A week-long diagnostic, fixed fee, ending in a written, ranked report on one system’s documents.

Start a conversation How engagements work