Repository navigation
Improve sampler course: divide-with-edge-cases probeable + EiPL segmentation - #153
Merged
CoffeePoweredComputers merged 2 commits intoJul 14, 2026
Conversation
…ntation
Two fixes to the Question Types Sampler seed command:
Probeable Code problem: replace the "mystery transform" (3n+1) task with a
high-level "divide two numbers" task whose edge cases must be discovered by
probing. The description states the goal but not the tricky behavior, and the
oracle (a // b, guarded on b == 0) exposes three edge cases via hidden test
cases: floor division (7/2 = 3), floor toward negative infinity (-7/2 = -4),
and divide-by-zero returning 0. Renames the slug to
sampler-probeable-code-divide.
EiPL problem: add prompt segmentation analysis config, which was previously
empty ({}), leaving comprehension grading ungrounded. Adds relational and
multi_structural few-shot examples tailored to the sum_evens reference code,
matching the schema used by every other EiPL problem.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
Codecov Report❌ Patch coverage is
📢 Thoughts on this report? Let us know! |
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Two fixes to the Question Types Sampler seed command (
seed_sampler_course), aligning the committed source with content already corrected on production.1. Probeable Code → "divide two numbers" with edge cases
The old task was a
transform(3n+1) machine — too on-the-nose; probing basically handed over the answer's shape. Replaced with a high-level goal ("Implement a function that divides two numbers") where the edge cases must be discovered by probing. The oracle isa // b, guarded onb == 0, exposing three edge cases via hidden test cases:divide(7, 2) = 3— floor division, not 3.5divide(-7, 2) = -4— floor rounds toward −∞divide(5, 0) = 0— divide-by-zero returns 0 instead of crashingSlug renamed
sampler-probeable-code-transform→sampler-probeable-code-divide.2. EiPL → add prompt segmentation analysis
The sampler EiPL shipped with
segmentation_config = {}, so comprehension grading (relational vs. multi-structural) had no few-shot examples to ground it — unlike every other EiPL problem. Addedrelational+multi_structuralexamples tailored to thesum_evensreference code, matching the established schema (verbatim-substring segments, non-overlapping 1-indexedcode_lines, threshold 2).Notes
transform.get_or_create).🤖 Generated with Claude Code