Skip to content

Implement config.splitting, including the 1.2.0 overlap field #72

Description

@jzonthemtn

config.splitting is not read anywhere, so a policy that asks for splitting is filtered as one piece: enabled, threshold, method, and the 1.2.0 overlap all have no effect.

Acceptance Criteria

  • A document over threshold is split by method.
  • Each chunk includes the trailing overlap characters of the previous chunk, defaulting to 0.
  • Spans duplicated at a seam are de-duplicated.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestphisqlCloses a gap against the PhiSQL specification

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions