docs: add an agent workflow laboratory and experiment playbook - #7
Conversation
Refs #6 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Reviewer's GuideThis documentation-only PR establishes an opt-in agent workflow laboratory: experiments run in isolated worktrees with verified loaded sources and recorded evidence, while validated capabilities are promoted via focused PRs with compatibility and rollback guidance. It also proposes a notebook pilot without claiming that the pilot has been run or adding runtime behavior. Flow diagram for the agent workflow laboratoryflowchart LR
Start["Start from clean checkout"] --> Lab["Create or reuse isolated lab worktree"]
Lab --> Verify["Verify loaded skill source and commit"]
Verify --> Record["Record hypothesis, baseline, evidence, and rollback"]
Record --> Evaluate["Run experiment and document failures or recovery"]
Evaluate --> Decision{"Validated?"}
Decision -->|No| Reject["Record rejection or next hypothesis"]
Decision -->|Yes| Promote["Create focused promotion branch or PR"]
Promote --> Checks["Revalidate checks, behavior, compatibility, and rollback"]
Checks --> Merge["Review and merge through normal protection"]
File-Level Changes
Tips and commandsInteracting with Sourcery
Customizing Your ExperienceAccess your dashboard to:
Getting Help
|
| ```bash | ||
| git status --short | ||
| git fetch origin | ||
| git worktree add -b lab/agent-workflows ../project-kit-agent-lab origin/main |
There was a problem hiding this comment.
git worktree add -b lab/agent-workflows ../project-kit-agent-lab origin/main makes the lab branch track origin/main (branch.autoSetupMerge default; verified: @{upstream} = origin/main).
In the lab worktree, the repo's mandatory session-close steps (git pull --rebase then git push, CLAUDE.md) rebase the lab branch onto main, which rewrites the history this guide says not to rewrite. git push then fails under the default push.default=simple because the upstream name doesn't match. With push.default=upstream it would push to main. Fix: add --no-track, and publish with git push -u origin lab/agent-workflows.
Automated review (Claude Code, AI-generated). Validate before acting.
There was a problem hiding this comment.
Fixed in 1643e95: added --no-track and git push -u origin lab/agent-workflows, with the reason. (Claude Opus 5.5, on behalf of Rody)
| Run experiments against disposable fixtures or a dedicated consumer worktree. | ||
| An agent may read the checked-out documentation immediately, while an installed | ||
| plugin may still be loading its cached release. Record the actual source path | ||
| and commit used. Follow the host's reload procedure in a fresh session and |
There was a problem hiding this comment.
"Follow the host's reload procedure" can't load the experimental skill. The installed plugin comes from the project-kit-local marketplace (the main checkout), cached under .../project-kit/0.1.0/, so the ../project-kit-agent-lab worktree is never read.
A fresh session keeps loading the cached 0.1.0 skills (install record: gitCommitSha b9818bf), so the "verify the experimental skill is loaded" check fails, or the release gets evaluated by mistake. The guide should name the real mechanism: start the session with claude --plugin-dir ../project-kit-agent-lab, or bump a prerelease version in the worktree and point a separate marketplace at it.
Automated review (Claude Code, AI-generated). Validate before acting.
There was a problem hiding this comment.
Fixed in 1643e95: the guide explains that the plugin is served from its cache and loads the lab copy with claude --plugin-dir ../project-kit-agent-lab. (Claude Opus 5.5, on behalf of Rody)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Why
Project-kit needs an explicit place to experiment with agent workflows and a repeatable route to promote validated changes.
Changes
docs/agent-workflow-lab.md: laboratory playbook. Covers isolated worktrees, verifying the skill source actually loaded, promotion through small PRs, failed experiments and a proposed notebook pilot.docs/experiments/TEMPLATE.md: experiment record (evidence) template.README.md: short pointer section.Refs #6 (the proposed pilot). It does not close it: the pilot has not run.
Validation
git diff --checkpasses.main(b9818bf) and merges with docs: define capability versions, consumer pins and rollback #8 without conflicts.Limits
The pilot has not run. This documents the first workflow; it adds no CLI command, and scaffolding does not create branches.
🤖 Generated with Claude Code
Summary by Sourcery
Establish a documented workflow laboratory for safely evaluating and promoting agent capabilities.
New Features:
Enhancements:
Documentation: