Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
132 changes: 132 additions & 0 deletions census.yaml

Large diffs are not rendered by default.

10 changes: 8 additions & 2 deletions claims.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -494,15 +494,21 @@ claims:
shared_basis: 14
threshold_not_contradicted: 12
threshold_documented_full_exposure: 0
last_reviewed: "2026-09-14"
last_reviewed: "2026-11-02"
review_window_days: 60
review_triggers:
- type: local_content_change
enforcement: executable
path: census.yaml
sha256: "68b14081b85e18ca1a7b5bce33bbf38fe3b8dafe876e7329057241404037b425"
sha256: "e392c61048ed6b15291661f68cc83d368713dd7bd67e1572beb598a41e828542"
note: >-
fires when the census changes without a claim re-review;
re-reviewed 2026-11-02 (America/New_York): the only change from the
previously pinned bytes is 33 appended entries under
unexamined_candidates (weekly sweeps discovered 2026-09-21 to
2026-11-02), transported unexamined. All classified content is
identical; verify_census.py confirms N/M/K 20/14/5 and M ladder
14/12/0. Transport, not verification: no candidate is examined.
re-reviewed 2026-09-14 (America/New_York), confirming the owner
report and independently comparing the bytes: the only change from the previously
pinned bytes is one appended AgentDrift / DriftNet entry under
Expand Down
2 changes: 1 addition & 1 deletion claims/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -293,7 +293,7 @@ <h1 class="q">Registered claims and their falsifiers</h1>
<main class="container" id="main">
<section class="gsec">
<div class="glabel"><span class="gno">01</span><span class="gname">The registry</span></div>
<ul class="idx"><li><a href="/claims/cc-001/"><span class="cid">CC-001</span><span class="ctitle">Frechet-Hoeffding endpoint bounds from declared marginals</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-002/"><span class="cid">CC-002</span><span class="ctitle">The claim-boundary manifest and its validation lanes</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-003/"><span class="cid">CC-003</span><span class="ctitle">Identical pairwise overlaps, different three-way probability</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-004/"><span class="cid">CC-004</span><span class="ctitle">The sharp interval for the both-fail query</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-005/"><span class="cid">CC-005</span><span class="ctitle">A measurement contract frozen before any dataset was inspected</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-006/"><span class="cid">CC-006</span><span class="ctitle">The E2 pipeline rehearsed on synthetic mechanisms</span><span class="cexp">expires 2027-01-05</span></a></li><li><a href="/claims/rel-001/"><span class="cid">REL-001</span><span class="ctitle">Preregistered hypothesis on dependence-aware presentation</span><span class="cexp">expires 2026-11-16</span></a></li><li><a href="/claims/mc-001/"><span class="cid">MC-001</span><span class="ctitle">Of 20 guardrail evaluations, 5 with joint-evidence artifacts</span><span class="cexp">expires 2026-11-13</span></a></li><li><a href="/claims/mc-002/"><span class="cid">MC-002</span><span class="ctitle">Five supervisors on BELLS against the independence plug-in</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/mc-003/"><span class="cid">MC-003</span><span class="ctitle">Marginals fix the all-miss rate only up to an interval</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/mc-004/"><span class="cid">MC-004</span><span class="ctitle">Multimodal Safeguard Bench, recomputed from per-item verdicts</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/af-001/"><span class="cid">AF-001</span><span class="ctitle">AI Fluency Index prevalences for 11 of 24 behaviours</span><span class="cexp">expires 2026-11-26</span></a></li><li><a href="/claims/ga-001/"><span class="cid">GA-001</span><span class="ctitle">Ghost-Ark, a verifier for the provenance limits of receipts</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/gv-001/"><span class="cid">GV-001</span><span class="ctitle">Ghost Visualizer, a visual essay that computes safety scores</span><span class="cexp">expires 2027-02-21</span></a></li><li><a href="/claims/gce-001/"><span class="cid">GCE-001</span><span class="ctitle">The Guardrail Composability Explorer, a coursework demo</span><span class="cexp">expires 2027-08-24</span></a></li><li><a href="/claims/site-001/"><span class="cid">SITE-001</span><span class="ctitle">The palette token pairs and their computed contrast</span><span class="cexp">expires 2026-12-29</span></a></li><li><a href="/claims/site-002/"><span class="cid">SITE-002</span><span class="ctitle">The claim registry, enforced in CI</span><span class="cexp">expires 2026-12-28</span></a></li><li><a href="/claims/e3-001/"><span class="cid">E3-001</span><span class="ctitle">Two ungated classifiers scored on harmful and benign items</span><span class="cexp">expires 2027-01-06</span></a></li><li><a href="/claims/e3b-001/"><span class="cid">E3B-001</span><span class="ctitle">The same classifiers on the attack family they were built for</span><span class="cexp">expires 2027-01-06</span></a></li><li><a href="/claims/e6-001/"><span class="cid">E6-001</span><span class="ctitle">Rejected: the permutation routine moves unequal-mass atoms</span><span class="cexp">expires 2027-01-08</span></a></li><li><a href="/claims/e7b-001/"><span class="cid">E7B-001</span><span class="ctitle">Rejected: calibration uses the shared pool for every judge</span><span class="cexp">expires 2027-01-08</span></a></li><li><a href="/claims/e9-001/"><span class="cid">E9-001</span><span class="ctitle">E9: both-miss measurement on 1,000 items</span><span class="cexp">expires 2027-02-14</span></a></li></ul>
<ul class="idx"><li><a href="/claims/cc-001/"><span class="cid">CC-001</span><span class="ctitle">Frechet-Hoeffding endpoint bounds from declared marginals</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-002/"><span class="cid">CC-002</span><span class="ctitle">The claim-boundary manifest and its validation lanes</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-003/"><span class="cid">CC-003</span><span class="ctitle">Identical pairwise overlaps, different three-way probability</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-004/"><span class="cid">CC-004</span><span class="ctitle">The sharp interval for the both-fail query</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-005/"><span class="cid">CC-005</span><span class="ctitle">A measurement contract frozen before any dataset was inspected</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/cc-006/"><span class="cid">CC-006</span><span class="ctitle">The E2 pipeline rehearsed on synthetic mechanisms</span><span class="cexp">expires 2027-01-05</span></a></li><li><a href="/claims/rel-001/"><span class="cid">REL-001</span><span class="ctitle">Preregistered hypothesis on dependence-aware presentation</span><span class="cexp">expires 2026-11-16</span></a></li><li><a href="/claims/mc-001/"><span class="cid">MC-001</span><span class="ctitle">Of 20 guardrail evaluations, 5 with joint-evidence artifacts</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/mc-002/"><span class="cid">MC-002</span><span class="ctitle">Five supervisors on BELLS against the independence plug-in</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/mc-003/"><span class="cid">MC-003</span><span class="ctitle">Marginals fix the all-miss rate only up to an interval</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/mc-004/"><span class="cid">MC-004</span><span class="ctitle">Multimodal Safeguard Bench, recomputed from per-item verdicts</span><span class="cexp">expires 2027-01-01</span></a></li><li><a href="/claims/af-001/"><span class="cid">AF-001</span><span class="ctitle">AI Fluency Index prevalences for 11 of 24 behaviours</span><span class="cexp">expires 2026-11-26</span></a></li><li><a href="/claims/ga-001/"><span class="cid">GA-001</span><span class="ctitle">Ghost-Ark, a verifier for the provenance limits of receipts</span><span class="cexp">expires 2026-12-22</span></a></li><li><a href="/claims/gv-001/"><span class="cid">GV-001</span><span class="ctitle">Ghost Visualizer, a visual essay that computes safety scores</span><span class="cexp">expires 2027-02-21</span></a></li><li><a href="/claims/gce-001/"><span class="cid">GCE-001</span><span class="ctitle">The Guardrail Composability Explorer, a coursework demo</span><span class="cexp">expires 2027-08-24</span></a></li><li><a href="/claims/site-001/"><span class="cid">SITE-001</span><span class="ctitle">The palette token pairs and their computed contrast</span><span class="cexp">expires 2026-12-29</span></a></li><li><a href="/claims/site-002/"><span class="cid">SITE-002</span><span class="ctitle">The claim registry, enforced in CI</span><span class="cexp">expires 2026-12-28</span></a></li><li><a href="/claims/e3-001/"><span class="cid">E3-001</span><span class="ctitle">Two ungated classifiers scored on harmful and benign items</span><span class="cexp">expires 2027-01-06</span></a></li><li><a href="/claims/e3b-001/"><span class="cid">E3B-001</span><span class="ctitle">The same classifiers on the attack family they were built for</span><span class="cexp">expires 2027-01-06</span></a></li><li><a href="/claims/e6-001/"><span class="cid">E6-001</span><span class="ctitle">Rejected: the permutation routine moves unequal-mass atoms</span><span class="cexp">expires 2027-01-08</span></a></li><li><a href="/claims/e7b-001/"><span class="cid">E7B-001</span><span class="ctitle">Rejected: calibration uses the shared pool for every judge</span><span class="cexp">expires 2027-01-08</span></a></li><li><a href="/claims/e9-001/"><span class="cid">E9-001</span><span class="ctitle">E9: both-miss measurement on 1,000 items</span><span class="cexp">expires 2027-02-14</span></a></li></ul>
</section>
<section class="gsec">
<div class="glabel"><span class="gno">02</span><span class="gname">How to read a date here</span></div>
Expand Down
6 changes: 3 additions & 3 deletions claims/index.json
Original file line number Diff line number Diff line change
Expand Up @@ -934,7 +934,7 @@
"name": "Cubits11 claim registry",
"url": "https://cubits11.github.io/ledger/"
},
"dateModified": "2026-09-14",
"dateModified": "2026-11-02",
"fw:scopeStatement": "A census claim about public reporting, bounded by the documented search protocol documented in census.yaml. Its literal inclusion wording is locked in repository history before row classification; that is a reproducibility lock, not an independent preregistration. It covers the artifacts that search found, not everything in existence; it says nothing about how well any evaluated system or stack performs, and nothing about what the unmeasured joint statistics would show. N, M, and K are recomputed mechanically from census.yaml by scripts/verify_census.py; this envelope's expected block is cross-checked against that computation in CI. Since census schema v3 the joint-evidence mode counts in this note are derived the same way, from a declared joint_scope_additional field, rather than counted by hand here; scripts/verify_facts.py binds every current census numeral on every public page, and on the deployed page after release, to the quantity it asserts. M is a ladder, not a comparability verdict: 14 document shared items and a common event definition, 12 have no stated threshold mismatch, and 0 document matched operating thresholds together with full exposure. Nothing here asserts that the 14 are interchangeable at a common operating point; the opposite is the finding. The 5 is an inclusive discovery count of noninterchangeable artifacts, not an all-miss rate or a deployment conclusion. Four artifacts print at least one composition result and two release aligned per-item outcomes from which joint statistics are directly computable; one artifact does both, so those descriptions intentionally overlap. The frozen phrase \"separately attributable\" did not specify whether a product or model name must be printed: the primary count treats systems a source distinguishes and reports consistently as separately attributable even when anonymized; the declared named-products-only sensitivity excludes Unit42 and mechanically yields N/M/K = 19/13/5. A drafted further clause — that no printed joint statistic among the then-four covers a commercial guardrail API — was withdrawn before publication when same-day adversarial review produced a live counterexample under one defensible reading (WAInjectBench's printed ensemble includes GPT-4o prompted as a detector); this claim's forbidden rescues bar narrowing \"commercial\" after the fact, so the clause was dropped rather than reinterpreted, and the event is recorded in the census revision history. On 2026-08-30, a post-release source audit found the distinct Multimodal Safeguard Bench repository, whose currently public Git history carries a pre-cutoff commit timestamp, and which the documented search had missed. That met this claim's prior REJECT falsifier: the 19/13/4 envelope is rejected and retained in census revision history. This 20/14/5 envelope is its corrected, superseding proposition, not a reinterpretation of the former count.",
"fw:falsifier": "A qualifying public evaluation meeting criteria v1 and published on or before 2026-08-27 is shown to be absent from this corrected census, or an examined row is shown to misreport its source such that recomputed N, M, or K differ from the stated 20/14/5.",
"fw:consequence": "REJECT",
Expand All @@ -950,9 +950,9 @@
"does not audit the quality of any per-system evaluation beyond the fields each row records",
"does not claim exhaustive coverage beyond the corrected, examined artifact set or coverage after the stated date"
],
"fw:lastReviewed": "2026-09-14",
"fw:lastReviewed": "2026-11-02",
"fw:reviewWindow": "P60D",
"fw:warrantExpires": "2026-11-13",
"fw:warrantExpires": "2027-01-01",
"fw:evidentialStatus": "supported_within_scope",
"fw:supportUrl": {
"@id": "https://github.com/Cubits11/cubits11.github.io/blob/main/census.yaml"
Expand Down
Loading
Loading