Repository navigation
Add the stability report between runs (S8) - #12
Merged
Merged
Conversation
A new run of a kit should leave most people on the line they were on. compareRuns matches branch labels by overlap, so renumbering isn't counted as change, and assertStable stops when more than 5% of the people placed in both runs change line (side and branch). Deeper levels and groups are reported without stopping, since third-level splits are often borderline. Tested on made-up runs and a planted family. On the first finished kit's real data, outside the repo, the original run against OneFamily's came out stable at 1.9%. The app keeps one run per kit, so nothing calls it yet. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes K408. Replaces #11, rebased on main without force-pushing.
compareRuns/assertStablein onefamily-analysis: labels matched by overlap; stop when more than 5% of people placed in both runs change line at two levels; deeper levels, groups, newly placed and no longer placed reported. 'Too few' (under 50) is reported, not a stop, like S7's side check.Tested: 282 tests, typecheck, leak check. Real exercise outside the repo: original run vs OneFamily's on the first finished kit, 1.9% changed, stable. Not wired into the app (one run per kit so far).
🤖 Generated with Claude Code