feat(E01): fail-closed execution preflight scaffold for the first records baseline (#21) #22
Closed
eido
wants to merge 0 commits from
E01/execution-scaffold into main
pull from: E01/execution-scaffold
merge into: smolmodelco:main
smolmodelco:main
smolmodelco:research/session-checkpoint-20261025
smolmodelco:research/budgeted-post-repair-audit-v1-20261025
smolmodelco:research/sensor-mapping-reference-v2-20261025
smolmodelco:research/posterior-diagnosis-20261024
smolmodelco:research/manual-examples-20261024
smolmodelco:research/diagnostic-control-20261023
smolmodelco:research/lantern-model-20261021
smolmodelco:research/night-breadth-20261021
smolmodelco:research/informative-probing-20261021
smolmodelco:research/source-structure-transfer-20261021
smolmodelco:research/aet-baseline-diagnostic-20261021
smolmodelco:research/action-effects-transfer-20261021
smolmodelco:research/online-workflow-recovery-20261021
smolmodelco:research/online-recovery-prep-20261021
smolmodelco:research/synthetic-workspace-c-20261021
smolmodelco:research/stale-memory-retest-20261021
smolmodelco:research/continuum-workspace-memory-20261021
smolmodelco:research/continuum-binary-recovery-20261020
smolmodelco:research/continuum-recovery-policy-20261020
smolmodelco:research/continuum-task-loop-20261020
smolmodelco:research/continuum-projection-20261020
smolmodelco:research/continuum-bnd1-trace-20261020
smolmodelco:research/continuum-boundary-20261020
smolmodelco:research/continuum-halting-20261020
smolmodelco:research/continuum-selector-20261020
smolmodelco:research/continuum-routing-20261020
smolmodelco:research/smc-lrm1-osd1-20261020
smolmodelco:research/f3-and-not-pair-20261020
smolmodelco:research/f3-interference-study-card-20261020
smolmodelco:research/f3-cache-fidelity-20261020
smolmodelco:research/f3-cache-fidelity-scope-20261020
smolmodelco:research/f3-saved-diagnosis-20261020
smolmodelco:research/f3-full-fit-20261020
smolmodelco:research/f3-runner-20261020
smolmodelco:research/f2-saved-diagnosis-20261020
smolmodelco:research/f3-reference-20261020
smolmodelco:research/f2-prerequisite-20261020
smolmodelco:research/action-predicate-discovery-20261019
smolmodelco:research/capacity-effects-spec-20261019
smolmodelco:research/copy-move-qualification-20261019
smolmodelco:research/artifact-handoff-20261019
smolmodelco:research/qonly-heldout-confirmation-20261019
smolmodelco:research/new-rule-qualification-20261019
smolmodelco:research/adaptation-retention-final-20261019
smolmodelco:research/adaptation-retention-pilot-20261019
smolmodelco:research/confirmation-prep-20261019
smolmodelco:artifacts/binding-2026-10-18
smolmodelco:research/gobig4-dense-val-20261018
smolmodelco:research/gobig3-val78-20261018
smolmodelco:research/gobig3-scratch-val-20261018
smolmodelco:research/gobig3-len4r-20261018
smolmodelco:research/gobig2-c-diag-20261018
smolmodelco:research/gobig2-b-valmargin-20261018
smolmodelco:research/gobig2-a-len4-20261018
smolmodelco:research/gobig-s3-long-lengths-20261018
smolmodelco:research/gobig-s2-big-graphs-20261018
smolmodelco:research/gobig-s5-margin-20261018
smolmodelco:research/gobig-s4-baseline-long-20261018
smolmodelco:research/gobig-s1-seeds-20261018
smolmodelco:research/sharp-variant-20261018
smolmodelco:research/cpu-lab-20261018
smolmodelco:docs/weekend-brief-historical
smolmodelco:research/size-diagnostic-20261018
smolmodelco:chore/ledger-x14-census
smolmodelco:research/composition-size-20261018
smolmodelco:research/composition-extend-20261018
smolmodelco:research/composition-fit-20261018
smolmodelco:research/autonomous-composition-results-20261018
smolmodelco:research/autonomous-composition-prep-20261018
smolmodelco:research/binding-interface-audit-20261018
smolmodelco:governance/research-reset
smolmodelco:preservation/pyrrha-inventory-20261004
smolmodelco:preservation/vesper-inventory-20261004
smolmodelco:docs/accordion-research-20260927
smolmodelco:research/c1-parity-freeze-92
smolmodelco:research/c1-consolidation-stream
smolmodelco:research/c1-gpu-guide
smolmodelco:dms003/r4-bare-label-sidecar
smolmodelco:dms003/pre-run-rulings
smolmodelco:X-DS-001/census
smolmodelco:exploration/e01-withheld-ops-metadata
smolmodelco:census/t2-eido-half
smolmodelco:docs/smc-research-lab-operating-contract
smolmodelco:lab/state-validation-machinery
smolmodelco:E01/surface-semantics
smolmodelco:R02/preflight-corrections
smolmodelco:R03-records-generator-reference
smolmodelco:R03-episode-foundation
smolmodelco:site/public-research-site
smolmodelco:plan/minimum-apparatus
smolmodelco:R03-generator-scorer-split-protocol
smolmodelco:docs/forgejo-canonical-collaboration
No reviewers
Labels
No labels
R03
research-b
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set
Reference
smolmodelco/thesmolmodelcompany!22
Loading…
Reference in a new issue
No description provided.
Delete branch "E01/execution-scaffold"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Task / experiment ID
E01 — issue #21. Preflight only: this PR does not execute a run, and contains no result.
What changed
Adds the execution-side seam for the first controlled records baseline as three stdlib-only
modules plus tests, and the declared plan they assert against:
scripts/e01_gate.pye01-executionscope, run-target layout, exit codesscripts/e01_identity.pyscripts/e01_preflight.pytests/test_e01_{gate,identity,preflight}.pyconfigs/e01-execution-plan.jsonartifacts.*andresources.*value isUNSETconfigs/e01-execution-scaffold.mdThree design points worth the reviewer's attention:
load_pinreadsresults/R02/r02-smoke-001/and requiresthat record's run manifest and artifact manifest to agree on
source,repo_id,precisionand
revision. A record whose own two files disagree is refused. There is no module-levelconstant to drift, and every identity field is pinned — not the revision alone — so a plan
cannot swap
precisionorsourceunder a matching revision.freeze_problemsrefuses whilegenerator_revision,scorer_revision,episode_manifest_sha256orreference_answers_sha256isUNSET. On themerged state the committed plan carries all four as
UNSET, so the preflight refuses. That isthe intended behaviour, not a defect: it is the code form of "protocol freeze" in issue #21.
scripts/r02_gate.pycloses itsown
KNOWN_SCOPESand refuses an unknown scope at parse time. Addinge01-executionto thatmerged, reviewed grant surface would weaken it, so E01 owns its gate and the two modules share
only the sentinel and redaction helpers. The merged
r02-readiness-smokegrant therefore cannotbe spent here — matching its own recorded note, "Not authorization for training, tuning,
evaluation, or any experiment".
Deliberately absent: the generator, scorer, split and reference-answer apparatus (Research B's
per
docs/R03-generator-scorer-split-protocol.md), and any transport for artifact retrieval, whichstays in
scripts/r02_artifacts.py. A test asserts no such seam exists here.Exact evidence path
Repository checks, from the repository root:
Fresh virtual environment, nothing installed (
python3 -m venv --without-pip), Python 3.12.3,pip present? no:Full suite on the branch versus the base commit
a3f9819, in agit worktree:f107175a3f9819The same three errors occur on the unmodified base:
tests.test_episode,tests.test_finite_state,tests.test_records, eachModuleNotFoundError: No module named 'smolmodelcompany'— thesrc/package is not installed inthis host interpreter. This PR adds 59 tests and introduces zero new failures. It does not touch
those files.
Fail-closed CLI paths, each run for real. Every one created nothing:
What was verified
mainata3f9819e180d693b5e22bd153d9beec753f4443e, confirmed bygit rev-parse HEADin a fresh clone and bygit ls-remote origin refs/heads/main.f1071758c52e2f3aceaec2b59f0817a629151bb0, equal to local head.should be shown by measurement.
results/is unchanged andresults/E01does not exist after every CLI invocation above.What was not verified
Read this first:
--without-pip; no package was fetched./tmp;configs/e01-execution-plan.jsonvalidates against the merged readiness record only as a pinassertion, and its own
artifacts.*values areUNSET.docs/results.mdis untouched and still reads"No experiment runs have been recorded yet."
exit=0in case 4g is a preflight pass on a synthetic frozen-plan fixture, not a run andnot an authorization. It proves the success path is reachable; it asserts nothing about E01.
Resource usage
N/A — no compute. No wall time on a GPU, no VRAM, no billed cost. The only host resource used was
CPU time for a 59-test stdlib suite (0.024 s) and
check_docs.Remaining uncertainty
templates/approval-record.jsondoes not exist onmain, so theoperator-record shape this validator accepts is derived from the merged records under
results/R02/. If the repository wants one canonical authorization schema,e01_gate.pyis wherethe field set should be reconciled. I have not invented policy here beyond requiring
run_idtoname the run and
procedure_reviewer_onlyto betrue.diff to new files while the protocol PR is in flight. That costs discoverability and should be
fixed once the protocol lands.
produced;
docs/coordination.mdstill governs the run manifest itself.the pin are consistent — not that E01 will produce a usable baseline.
Next owner / action
Research A (Vesper): review the gate boundary — specifically that
e01-executionbeing a separateclosed scope is the right containment, and that the two-decision requirement
(
procedure_reviewer_only+operator_go) is the shape this repository wants recorded.Then Research B (Pyrrha): the protocol PR that sets
generator_revision,scorer_revisionand thetwo pre-invocation digests. Until those are frozen this preflight refuses by design.
Then, and only then, an operator go/no-go naming the run, and Eido executes.
Author checklist
three pre-existing base errors are reported above rather than hidden.
reviewer — it deliberately does not; Research B's apparatus is out of scope and absent.
results/<experiment>/<run-id>/report.mdand the ledgerwas regenerated — not a run; no report and no ledger entry, and the ledger check passes at 0 runs.
docs/compute.md).Pull request closed