Repository navigation
Add the shared harness of the state_prep_certification experiments - #914
Merged
Merged
Conversation
Add a harness that runs timed qLDPC experiments in bulk, on a workstation or offline on a Linux node, under experiments/state_prep_certification/: - common/: the task runner, which times the measured call in a child process with its limit, memory cap, start-up cap, and post-processing window, kills the run's process group, and writes one JSONL row per run; the result store, with recovery of a partial last line; task lists for GNU parallel with job slots pinned to physical cores and a ceiling of CPU-hours that needs an approval; the label and manifest; and the plug-in interface, with self-tests; - run_node.py: one experiment for its label, from the acceptance tests to the archive, with resume, status, and cleanup; - node.sh: the node's preflight, offline install, and entry point; - bundle.py and pins.json: the offline bundle, with hashed wheels for the pinned CPython and Linux platform, and GNU parallel. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
perlinm
force-pushed
the
ft-state-prep-harness
branch
from
November 16, 2026 21:59
f3b2167 to
8777f84
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This pull request adds
experiments/state_prep_certification/, a harness for running timed qLDPC experiments in bulk, on a workstation or offline on a Linux node. An experiment plugs in by defining its tasks, the call that each task measures, and its acceptance tests; the harness does the rest.Changes
common/runner.pyandcommon/run_task.pyrun each task in a child process with a time limit, memory cap, and start-up cap, kill the run's whole process group when it ends, and write one JSONL row per run.common/store.pyreads and appends those rows, recovering from a partial last line.common/tasks.pywrites the task lists for GNU parallel, pins each job slot to a physical core, and refuses to start unless an approved number of CPU-hours covers the worst case.common/manifest.pylabels each run by the hash of its pinned versions, its inputs, and the commit, and records the machine and packages.common/plugin.pydefines the plug-in interface.run_node.pyruns one experiment from its acceptance tests to an archive of the results, and can resume, report status, and clean up after a hard kill.bundle.py,pins.json, andnode.shbuild one offline bundle on a workstation (wheels, CPython, and GNU parallel, all hashed) and install and run it on the node.experiments/state_prep_certification/README.mddescribes the workflow.Validation
common/selftest.pytests each part with a stand-in plug-in, including timeouts that leave grandchildren, memouts, interrupted runs and their resume, and cleanup when a process id has been reused. On Linux,run_node.pyreruns these tests with process groups and real CPU pinning before each experiment. These tests do not run in CI, as for the code-annealing experiment.