Repository navigation
feat(Circuits): cap entropy of overlapping actual features - #71
Merged
Merged
Conversation
SamuelSchlesinger
marked this pull request as ready for review
October 5, 2026 04:13
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Samuel’s dot here.
Scope
Add a reusable finite-weight certificate for two Boolean features dominated pointwise by signed two-primary conjunctions with overlapping supports. The features may include arbitrary predicates of all primary inputs, including internal-gate dependencies.
The joint natural-log cost is J = 3 log 2 − (5/8) log 5, the entropy of (5/8, 1/8, 1/8, 1/8). The strict saving over two quarter-biased marginal caps is proved by the exact integer inequality 3^12 < 2^8 · 5^5. Equal supports, opposite signs, and constant false features are covered. This is a joint-cost cap, not a mutual-information lower bound.
The implementation uses the existing WeightBound infrastructure, an elementary pointwise-weight transport, and exact two-/three-bit tables. No PMF dependency is added. A matching blueprint node records the result.
This PR is the local pair-certificate layer. Assembly into a matched circuit-feature budget and the full inversion coefficient remain separate work.
Verification
The exact published source tree 70cb27fa854b73f02e701999e250d1ed52eed6ef passed:
Independent review checked the statement, all overlap/sign cases, domination transport, and the unchanged pair patch after integrating dev be804d0. Fresh current-base CI passed every gate on integration commit ecbd7c4: https://github.com/SamuelSchlesinger/complexitylib/actions/runs/37262216960 .