Add shared BGE text map and verified graph provenance - #935
Draft
realmarcin wants to merge 13 commits into
Draft
realmarcin wants to merge 13 commits into
realmarcin wants to merge 13 commits into
Conversation
Refs #900; full verified graph regeneration remains tracked separately.
Addresses #910. Full 372-record semantic JSONL export is byte-identical.
Publish complete current-corpus graph coordinates, matching/omission ledgers, actual reducer provenance and output-bound receipts.
Addresses #911 and CultureBotAI/culturebotai-claw#435. Check both complete graph output sets and current community corpus without source vectors or projection libraries, and trigger publication checks on their validation dependencies.
Network integrity findingsWarnings only — a member with no interaction yet, or a participant matched by ontology id rather than by name, or one on a community-level interaction that resolves to no member. Reported, but does not fail the build. The full report is attached to the workflow run as an artifact. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
CommunityMech gains a semantic-text PaCMAP view of all 378 records in the validated source snapshot, including four isolates. It uses the fleet's pinned
BAAI/bge-large-en-v1.5revisiond4aa6901d3a41ba39fb536a557fa166f842b0e09, 1,024-dimensional normalized vectors and a 512-token window. Existing taxon-graph PaCMAP and Graphviz sfdp views remain available; both represent 373 of 374 communities, with the remaining omission and excluded isolate population explicitly recorded.Graph matching measures coverage over unique requested taxa and preserves partial coverage. Missing vectors no longer imply fabricated host classifications. Each regenerated graph binds the actual streamed source, current YAML bytes, matching ledger, matrix, reducer settings and output checksums. Publication validates both current graph receipts and freshly exported common-map inputs before staging. The runtime also rejects symlinked or misnamed generation paths. The common text maps share the pinned BGE model; their coordinates are fitted independently and are not aligned across repositories.
Validation against captured main
f7c8fae387add00eff6686716fcf06e29455bf2a: the current common build reused all 376 previous semantic vectors and encoded only the two incoming communities. Independent source and complete numerical reviews verified all 378 records, exact input/profile/cache bindings, and byte equality of the three map artifacts built with the prior canonical runtime and validated with the corrected runtime.Independent reviews accepted both 373-point graph layouts and all 417 installed site files, including 383 fresh renderer outputs. Every common and specialty destination resolves. The two new communities retain their actual 100% and 75% requested-taxon coverage; one separate no-vector omission and the four excluded isolates remain explicit. The exact local merge passed all 12 affected commands: strict validation, writer audit, fresh docs reproduction, paired publication, all 53 affected tests, schema/ontology/GTDB validation for both added records, and history validation. The previous maintained full QA remains evidence for unchanged implementation and prior records: 3,264 tests passed (99 skipped, 8 deselected), plus all configured ontology/term checks. Final-head GitHub CI passed on
91550e96300f805e08e8fb2a394a6abc7f33c9f7: all seven validation checks succeeded; the optional repair-suggestion job was skipped.Fixes #900, #905, #907, #909, #910, #911 and #936. Implements CommunityMech's portion of CultureBotAI/culturebotai-claw#426 and the reviewed runtime correction in CultureBotAI/culturebotai-claw#440.
Fleet rollout retains released pin
c8b8f89ecf29574d7e24f6c65cfd925aefbdd007. Additive governed files are verified against reviewed canonical candidate16ce0e452af975cdfe4acc181efb6bad4688f5b7. After all ten integration PRs land, CultureBotAI/culturebotai-claw#432 can register the complete fleet. Separate pin-only PRs will use its actual main-reachable squash merge commit after governed-byte verification. This draft remains for coordinated review.