Skip to content

audit: the #76 claims, measured - 23/28 killed, zero new #115

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
thedavidmeister merged 2 commits into from
Sep 16, 2026
Merged

audit: the #76 claims, measured - 23/28 killed, zero new #115

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
c1d4f95
audit: record the #76 measurement, which adds no test
Sep 16, 2026
53f8d75
audit: the scan note names main's NatSpec move, not just the README one
Sep 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 23 additions & 0 deletions audit/mutation-test-scans.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,5 +21,28 @@
"filed": ["#20", "#21", "#22", "#23", "#24", "#25", "#26", "#27"],
"notes": "Library code: no miscomputation found; all four functions and HASH_NIL match cast keccak known answers. Survivors were the unasserted no-allocation / memory-safe promise (free memory pointer and zero slot). Filed issues are README/NatSpec/test-harness defects and one security-argument premise (#22, refs #7). testsAfterCommit is the merge commit of PR #19 on main."
}
},
{
"timestamp": "2026-09-16T11:37:04Z",
"commit": "f2a9f5f613a82752761c4a17d70597ece17adb97",
"testsAfterCommit": null,
"publishedTag": "sol-v0.1.25",
"commitsAheadOfTag": 0,
"scope": "src/lib/LibHashNoAlloc.sol, against the five documented claims of #76",
"tool": "mutation-probe (adversarial-mutation-test 4e59ec0c)",
"skillVersion": "0.34.0",
"summary": {
"behaviours": 28,
"mutantsKilledByPreExistingSuite": 28,
"mutantsSurvivedPreExistingSuite": 0,
"mutantsKilledAfter": 28,
"candidates": 0,
"confirmed": 0,
"testsBefore": 77,
"testsAfter": 77,
"coveragePRs": [],
"filed": [],
"notes": "Mutation probe only, no adversarial pass. 28 mutants over every behaviour the library has: the read offset and byte count of hashBytes and of both hashWords overloads, the two scratch writes and the hashed range of combineHashes, the HASH_NIL literal, and the no-allocation promise of all four. All 28 die to the suite as it stands. The seven tests #76 proposes were written and probed against the same 28: between them they kill 23, none of which the suite misses, and they miss the four no-allocation mutants and HASH_NIL. No test added. main has since moved to 092293e by a README-only commit and a NatSpec-only commit: test/ is byte-identical to the scanned commit and src/ differs from it only in /// lines, so every mutated line is unchanged."
}
}
]
Loading