Quantile Labs

Findings

Full evaluations of named deployed systems, published quarterly with the method, the harness, the notebook, and the results file, whatever they conclude.

No published findings yet

The first evaluations are under way, and nothing is listed here until the organisation responsible for the system has had its right of reply and that window has closed.

Each entry will carry the system evaluated, the operator, the access tier, the sampling design, the report with intervals, and links to the harness, the notebook, and the results file.

Four kinds of publication, each on its own cadence

What we publish and how often
TypeCadenceWhat it is
Findings Quarterly Full evaluation of a named deployed system. Complete method, data, uncertainty, right of reply, notebook.
Notes Monthly Short empirical analyses. A single figure, a replication, a partial result, a methodological observation.
Methods As developed Harnesses, reference datasets, protocols, and the Quantile Report specification. Open licensed and citable.
Reviews Opportunistic Assessment of someone else's published evaluation. Did the study support its conclusion, and what did its access permit?
What every tier carries

Uncertainty on every figure, the access tier stated, the harm threshold fixed before analysis, the notebook and results file published alongside, at least twenty-one days of reply published unedited, and corrections as prominent as the original.