Skip to content

feat: add scripts/analyze_cold_streaks.py for sterility log analysis - #876

Merged
devdanzin merged 1 commit into
mainfrom
feat/analyze-cold-streaks-script
Jun 30, 2026
Merged

devdanzin merged 1 commit into
mainfrom
feat/analyze-cold-streaks-script

Conversation

@devdanzin

Copy link
Copy Markdown
Owner

Summary

  • Adds scripts/analyze_cold_streaks.py to replay a deep_fuzzer_run_*.log and quantify cold-streak / sterility behavior.
  • Reports cold/warm/find/duplicate breakdown, what terminates each stone-cold run, the cold-streak distribution preceding finds, and a retirement-policy simulation across several K values — the empirical basis for re-tuning COLD_STERILITY_LIMIT.
  • Faithful to the implementation: per-parent streak, reset on warm/find, neutral on duplicate, negatives counted as cold.

Test plan

  • ruff check + ruff format clean.
  • Runs on a real 23 MB run log and produces the expected breakdown (78.7% stone-cold, 16.4% of cold runs end in a find, K=100 → 0.83% finds lost / 7.9% execs saved).

Closes #875

🤖 Generated with Claude Code

Replays a deep_fuzzer_run_*.log as a per-parent stream of child outcomes
(cold / warm / find / duplicate) and reports the cold breakdown, what ends
each stone-cold run, the cold-streak distribution before finds, and a
retirement-policy simulation across several K values so COLD_STERILITY_LIMIT
can be re-assessed empirically against real runs.

Closes #875

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@devdanzin
devdanzin merged commit 85bd578 into main Jun 30, 2026
0 of 2 checks passed
@devdanzin
devdanzin deleted the feat/analyze-cold-streaks-script branch June 30, 2026 23:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add scripts/analyze_cold_streaks.py to reassess COLD_STERILITY_LIMIT against real runs

1 participant