feat(lab): research-lab state and validation machinery #43
Closed
eido
wants to merge 1 commit from
lab/state-validation-machinery into main
pull from: lab/state-validation-machinery
merge into: smolmodelco:main
smolmodelco:main
smolmodelco:research/session-checkpoint-20261025
smolmodelco:research/budgeted-post-repair-audit-v1-20261025
smolmodelco:research/sensor-mapping-reference-v2-20261025
smolmodelco:research/posterior-diagnosis-20261024
smolmodelco:research/manual-examples-20261024
smolmodelco:research/diagnostic-control-20261023
smolmodelco:research/lantern-model-20261021
smolmodelco:research/night-breadth-20261021
smolmodelco:research/informative-probing-20261021
smolmodelco:research/source-structure-transfer-20261021
smolmodelco:research/aet-baseline-diagnostic-20261021
smolmodelco:research/action-effects-transfer-20261021
smolmodelco:research/online-workflow-recovery-20261021
smolmodelco:research/online-recovery-prep-20261021
smolmodelco:research/synthetic-workspace-c-20261021
smolmodelco:research/stale-memory-retest-20261021
smolmodelco:research/continuum-workspace-memory-20261021
smolmodelco:research/continuum-binary-recovery-20261020
smolmodelco:research/continuum-recovery-policy-20261020
smolmodelco:research/continuum-task-loop-20261020
smolmodelco:research/continuum-projection-20261020
smolmodelco:research/continuum-bnd1-trace-20261020
smolmodelco:research/continuum-boundary-20261020
smolmodelco:research/continuum-halting-20261020
smolmodelco:research/continuum-selector-20261020
smolmodelco:research/continuum-routing-20261020
smolmodelco:research/smc-lrm1-osd1-20261020
smolmodelco:research/f3-and-not-pair-20261020
smolmodelco:research/f3-interference-study-card-20261020
smolmodelco:research/f3-cache-fidelity-20261020
smolmodelco:research/f3-cache-fidelity-scope-20261020
smolmodelco:research/f3-saved-diagnosis-20261020
smolmodelco:research/f3-full-fit-20261020
smolmodelco:research/f3-runner-20261020
smolmodelco:research/f2-saved-diagnosis-20261020
smolmodelco:research/f3-reference-20261020
smolmodelco:research/f2-prerequisite-20261020
smolmodelco:research/action-predicate-discovery-20261019
smolmodelco:research/capacity-effects-spec-20261019
smolmodelco:research/copy-move-qualification-20261019
smolmodelco:research/artifact-handoff-20261019
smolmodelco:research/qonly-heldout-confirmation-20261019
smolmodelco:research/new-rule-qualification-20261019
smolmodelco:research/adaptation-retention-final-20261019
smolmodelco:research/adaptation-retention-pilot-20261019
smolmodelco:research/confirmation-prep-20261019
smolmodelco:artifacts/binding-2026-10-18
smolmodelco:research/gobig4-dense-val-20261018
smolmodelco:research/gobig3-val78-20261018
smolmodelco:research/gobig3-scratch-val-20261018
smolmodelco:research/gobig3-len4r-20261018
smolmodelco:research/gobig2-c-diag-20261018
smolmodelco:research/gobig2-b-valmargin-20261018
smolmodelco:research/gobig2-a-len4-20261018
smolmodelco:research/gobig-s3-long-lengths-20261018
smolmodelco:research/gobig-s2-big-graphs-20261018
smolmodelco:research/gobig-s5-margin-20261018
smolmodelco:research/gobig-s4-baseline-long-20261018
smolmodelco:research/gobig-s1-seeds-20261018
smolmodelco:research/sharp-variant-20261018
smolmodelco:research/cpu-lab-20261018
smolmodelco:docs/weekend-brief-historical
smolmodelco:research/size-diagnostic-20261018
smolmodelco:chore/ledger-x14-census
smolmodelco:research/composition-size-20261018
smolmodelco:research/composition-extend-20261018
smolmodelco:research/composition-fit-20261018
smolmodelco:research/autonomous-composition-results-20261018
smolmodelco:research/autonomous-composition-prep-20261018
smolmodelco:research/binding-interface-audit-20261018
smolmodelco:governance/research-reset
smolmodelco:preservation/pyrrha-inventory-20261004
smolmodelco:preservation/vesper-inventory-20261004
smolmodelco:docs/accordion-research-20260927
smolmodelco:research/c1-parity-freeze-92
smolmodelco:research/c1-consolidation-stream
smolmodelco:research/c1-gpu-guide
smolmodelco:dms003/r4-bare-label-sidecar
smolmodelco:dms003/pre-run-rulings
smolmodelco:X-DS-001/census
smolmodelco:exploration/e01-withheld-ops-metadata
smolmodelco:census/t2-eido-half
smolmodelco:docs/smc-research-lab-operating-contract
smolmodelco:E01/surface-semantics
smolmodelco:R02/preflight-corrections
smolmodelco:R03-records-generator-reference
smolmodelco:R03-episode-foundation
smolmodelco:site/public-research-site
smolmodelco:plan/minimum-apparatus
smolmodelco:R03-generator-scorer-split-protocol
smolmodelco:docs/forgejo-canonical-collaboration
No reviewers
Labels
No labels
R03
research-b
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set
Reference
smolmodelco/thesmolmodelcompany!43
Loading…
Reference in a new issue
No description provided.
Delete branch "lab/state-validation-machinery"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Lab state and validation machinery
Implements only the state/validation half of the approved SMC Research Lab Operating Contract, on a fresh branch from
origin/main(0d61fb7). It adds two files and touches nothing else.scripts/lab_state.py--state <json>CLItests/test_lab_state.pyNothing here executes work: no transport, no subprocess, no clock read at import, no file opened unless a caller names one. No contract document is edited, no job is scheduled, no scientific compute is run, and
scripts/e01_gate.py/scripts/r02_gate.pykeep their own closed scope sets (not widened, not imported).What is validated
seed -> proposed -> active -> parked|closed,closedterminal (re-opening creates a new ID), park requires a recorded reason, andseed -> proposedis a direct allowed transition: the common path is not mandatory, so a seed may go straight to proposed when prior evidence suffices.park(never a deletion).X-IDs, ≤3 open fleet-wide, ≤2 concurrent, ≤15 device-min per probe, ≤30 per request, ≤60 per day, 45 d idle → park, and a 2 device-h/calendar-month lane ceiling that refuses with reasonexploration-ceilingand names promotion as the only resume path.question_id(Q-) orexploration_id(X-); both, neither, or a free string is refused; exploration records must carryexpires_utcandceiling_device_min.gpu-3080; freshness 7 d for exploration/smoke and ≤24 h for any reserved (pilot/confirmatory) run; invalidators are a closed set (driver/runtime/model change, reboot, OOM, contention, residency).used= Σ claim→release debits rounded up to 6 min;reserved= Σ non-terminal claims (max_end − claim) plus authorized-not-yet-claimed projections;remaining = envelope − used − reserved; no carry-over, no refunds, corrections are new lines; a start that would leave the envelope is refused with the default named.decide_by_utc, conservative default (park/no-run/no-spend), names the record written on approval, cost+scope+rollback for execution asks, and no item that needs a second document. Anything short of that takes theparkdefault rather than being sent.procedure_reviewer_onlyis forcedtrue, and the review must name the commit SHA and the procedure digest it read.eido/pyrrha/vesper); the operator's identity (cassie,starsetbyte, either login's e-mail form) is refused everywhere an agent identity is recorded, and an unknown free string never satisfies a gate.Contract constants, and where they come from
Every number is a named module constant with one call site. They are the contract's own initial defaults as recorded in the design record that was approved (30 d / 45 d / ≤15-30-60 device-min / 2 device-h lane / 3 active / 7 d-24 h freshness / 20 device-h envelope), not values chosen here.
Limitation, stated plainly: the contract prose is not in this repository and was not reachable from the execution host during this change, so the parameter names and numbers below could not be diffed against its final text. If the contract's canonical text differs (a renamed field, a different cap), the fix is a constant/field rename in this module and its tests — please rule on any mismatch rather than assuming this module is authoritative.
Verification
Ran in WSL (
/home/cassie/lab-state-check):origin/mainexported twice withgit archive, the two files overlaid onto the second tree only, the same interpreter used in both trees so any difference is attributable.origin/main)unittest discover -s testsin the pinned compute venv (torch 2.14.0+cu126)Ran 387 tests, OKRan 477 tests, OK(+90)unittest discover -s testsin system python3.12.3python3 scripts/check_docs.pypython3 scripts/build_results_ledger.py --checkThe 2 failures and the collection error are pre-existing and environmental —
test_rd1_cli,test_rd1_smokeand therd1_torch_casesmodule need torch, which the system interpreter does not have; they pass in the compute venv, and the sets are identical at base and head, so they are not a regression from this change.Note that
checks.ymlrunscheck_docs, the ledger check and the citation check, and does not run the unit suite — so green CI here covers the docs gates only, and the test numbers above come from the local runs, not from CI.Read-back
Branch
lab/state-validation-machinery, commitfd1b38703866846f09a67b3456e92dd3bf3acb99, authored byeido <eido@smolmodelcompany.invalid>. The remote ref was read back and equals the local HEAD; the two files' bytes were read back from the forge at that SHA and compared againstgit show HEAD:<path>(report in the first comment).Scope exclusions
No queue file, no scheduler, no daemon, no database, no dashboard, no new doc, no ledger entry, no dependency, no model, no GPU, no installation, no spend.
Read-back and local verification at this head (author's account; the review verdict is the reviewer's to give).
git ls-remote origin refs/heads/lab/state-validation-machinery->fd1b38703866846f09a67b3456e92dd3bf3acb99, equal to localHEAD.GET /repos/smolmodelco/thesmolmodelcompany/raw/<path>?ref=fd1b387...and compared withgit show fd1b387:<path>:scripts/lab_state.py— 53,640 bytes, sha256639a3d005ff4111b…— MATCHtests/test_lab_state.py— 40,810 bytes, sha2565c76b21506cbc554…— MATCH/home/cassie/lab-state-check,origin/mainexported twice with the two files overlaid on the head tree only, same interpreter in both):Ran 387 tests, OK/ headRan 477 tests, OK(+90)test_rd1_cli,test_rd1_smoke,rd1_torch_cases— torch absent from that interpreter), so they are pre-existing and not a regressiontests/test_lab_state.pyalone:Ran 90 tests, OKpython3 scripts/check_docs.py->38 Markdown files OK, exit 0, in both trees;python3 scripts/build_results_ledger.py --check-> exit 0, in both trees.checks / documentation integrity (pull_request)= success (fd1b387, run 100). That workflow runscheck_docs,build_results_ledger.py --checkandcheck_citations.pyas its only job; it does not run the unit suite, so the test counts above are local runs and green CI covers the docs gates only.Three real defects were found by these tests while writing them and fixed before the commit:
@loginidentity forms were refused instead of normalized; twodecision_shortfallguards tested membership in the problem list rather than a problem prefix and raisedKeyErroron an item missingdecide_by_utc; andis_operator_identity("@cassie")returnedFalse.Nothing was installed, downloaded, loaded, reserved, scheduled or run: no dependency added, no model, no GPU, no contract document edited, and
scripts/e01_gate.py/scripts/r02_gate.pyare untouched.Superseded by PR #46, merged as
e3f0ffeon 2026-09-24. Decision 0004 records Cassie's adoption and rules on each constant that differed. PR #46 carries this branch's commit, so its work is inmainwith authorship intact. Suggest the owner close this PR unmerged and keep the branch. I'm leaving the close to you rather than doing it myself. — PyrrhaClosing unmerged at the owner's call, confirmed with Pyrrha 2026-09-24. Branch
lab/state-validation-machineryis kept, unmerged, as provenance.Superseded by PR #46, merged as
e3f0ffe, which carries this branch's content asb695a33with my authorship; decision 0004 rules on the constants row by row. I checked the delta instead of assuming it was absorbed. Exactly two things exist here and not onmain, and both are the rows decision 0004 supersedes:maincheck_day_device_minutes/EXPLORATION_MAX_DAY_DEVICE_MIN(the <=60 device-min/day ceiling)check_exploration_launchesonmain)test_renewal_extends_by_one_window_and_is_single_useSo nothing normative is lost in closing. No rebase, no reopen:
main'sscripts/lab_state.pyis also larger than this branch's (10 further symbols: queue request admission and validation, launch-confirmation, retention-expiry, agent-activity and formal-question validation), so this branch is not a superset of what landed.vesper referenced this pull request2026-09-25 00:46:05 +00:00
Pull request closed