fix: pick ring topics from what publishers file under, not the commonest word - #198
Merged
Conversation
…est word The first seed took the topics rollup's top of the table, which is the most common phrases in a hundred thousand feeds' prose: "one", "de", "episode", "time". A ring named after one of those is a ring of everything. Ring topics are now ranked by the feeds that carry the slug as their own category tag (feed_keywords.source = 'category'), counted only over feeds a ring can use, with a three-character minimum so stopwords and language codes are out. Bounded like the seed: the rollup names a pool, each candidate costs one range scan of its own rows. A topic ring made under the old ranking, with fewer than five active members, is dropped when its topic no longer qualifies; a ring people have linked to stays. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01XYae2mH3khdwiXUVzcVMDw
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ring topics from what publishers file under, not the commonest word
Follow-up to #196 and #197. The first seed created rings named
one,deandepisode: thetopicsrollup counts every phrase lifted from prose, so its top of the table is stopwords. NowtopRingTopicsranks candidates by feeds that carry the slug as their own category tag (feed_keywords.source = 'category'), counted only over active feeds with a site, with a three-character minimum. Bounded: the rollup names a pool (indexed), each candidate costs one range scan of its own keyword rows.dropStaleTopicRingsremoves a topic ring that no longer qualifies and has under five active members (the three junk rings); a ring people have linked to is never dropped. Test added for the ranking, the exclusions and the drop. db, ingest and poller suites pass.🤖 Generated with Claude Code
https://claude.ai/code/session_01XYae2mH3khdwiXUVzcVMDw