WIP: LANTERN synthetic diagnostic policy and training apparatus #185
Draft
pyrrha
wants to merge 8 commits from
research/lantern-model-20261021 into main
pull from: research/lantern-model-20261021
merge into: smolmodelco:main
smolmodelco:main
smolmodelco:research/session-checkpoint-20261025
smolmodelco:research/budgeted-post-repair-audit-v1-20261025
smolmodelco:research/sensor-mapping-reference-v2-20261025
smolmodelco:research/posterior-diagnosis-20261024
smolmodelco:research/manual-examples-20261024
smolmodelco:research/diagnostic-control-20261023
smolmodelco:research/night-breadth-20261021
smolmodelco:research/informative-probing-20261021
smolmodelco:research/source-structure-transfer-20261021
smolmodelco:research/aet-baseline-diagnostic-20261021
smolmodelco:research/action-effects-transfer-20261021
smolmodelco:research/online-workflow-recovery-20261021
smolmodelco:research/online-recovery-prep-20261021
smolmodelco:research/synthetic-workspace-c-20261021
smolmodelco:research/stale-memory-retest-20261021
smolmodelco:research/continuum-workspace-memory-20261021
smolmodelco:research/continuum-binary-recovery-20261020
smolmodelco:research/continuum-recovery-policy-20261020
smolmodelco:research/continuum-task-loop-20261020
smolmodelco:research/continuum-projection-20261020
smolmodelco:research/continuum-bnd1-trace-20261020
smolmodelco:research/continuum-boundary-20261020
smolmodelco:research/continuum-halting-20261020
smolmodelco:research/continuum-selector-20261020
smolmodelco:research/continuum-routing-20261020
smolmodelco:research/smc-lrm1-osd1-20261020
smolmodelco:research/f3-and-not-pair-20261020
smolmodelco:research/f3-interference-study-card-20261020
smolmodelco:research/f3-cache-fidelity-20261020
smolmodelco:research/f3-cache-fidelity-scope-20261020
smolmodelco:research/f3-saved-diagnosis-20261020
smolmodelco:research/f3-full-fit-20261020
smolmodelco:research/f3-runner-20261020
smolmodelco:research/f2-saved-diagnosis-20261020
smolmodelco:research/f3-reference-20261020
smolmodelco:research/f2-prerequisite-20261020
smolmodelco:research/action-predicate-discovery-20261019
smolmodelco:research/capacity-effects-spec-20261019
smolmodelco:research/copy-move-qualification-20261019
smolmodelco:research/artifact-handoff-20261019
smolmodelco:research/qonly-heldout-confirmation-20261019
smolmodelco:research/new-rule-qualification-20261019
smolmodelco:research/adaptation-retention-final-20261019
smolmodelco:research/adaptation-retention-pilot-20261019
smolmodelco:research/confirmation-prep-20261019
smolmodelco:artifacts/binding-2026-10-18
smolmodelco:research/gobig4-dense-val-20261018
smolmodelco:research/gobig3-val78-20261018
smolmodelco:research/gobig3-scratch-val-20261018
smolmodelco:research/gobig3-len4r-20261018
smolmodelco:research/gobig2-c-diag-20261018
smolmodelco:research/gobig2-b-valmargin-20261018
smolmodelco:research/gobig2-a-len4-20261018
smolmodelco:research/gobig-s3-long-lengths-20261018
smolmodelco:research/gobig-s2-big-graphs-20261018
smolmodelco:research/gobig-s5-margin-20261018
smolmodelco:research/gobig-s4-baseline-long-20261018
smolmodelco:research/gobig-s1-seeds-20261018
smolmodelco:research/sharp-variant-20261018
smolmodelco:research/cpu-lab-20261018
smolmodelco:docs/weekend-brief-historical
smolmodelco:research/size-diagnostic-20261018
smolmodelco:chore/ledger-x14-census
smolmodelco:research/composition-size-20261018
smolmodelco:research/composition-extend-20261018
smolmodelco:research/composition-fit-20261018
smolmodelco:research/autonomous-composition-results-20261018
smolmodelco:research/autonomous-composition-prep-20261018
smolmodelco:research/binding-interface-audit-20261018
smolmodelco:governance/research-reset
smolmodelco:preservation/pyrrha-inventory-20261004
smolmodelco:preservation/vesper-inventory-20261004
smolmodelco:docs/accordion-research-20260927
smolmodelco:research/c1-parity-freeze-92
smolmodelco:research/c1-consolidation-stream
smolmodelco:research/c1-gpu-guide
smolmodelco:dms003/r4-bare-label-sidecar
smolmodelco:dms003/pre-run-rulings
smolmodelco:X-DS-001/census
smolmodelco:exploration/e01-withheld-ops-metadata
smolmodelco:census/t2-eido-half
smolmodelco:docs/smc-research-lab-operating-contract
smolmodelco:lab/state-validation-machinery
smolmodelco:E01/surface-semantics
smolmodelco:R02/preflight-corrections
smolmodelco:R03-records-generator-reference
smolmodelco:R03-episode-foundation
smolmodelco:site/public-research-site
smolmodelco:plan/minimum-apparatus
smolmodelco:R03-generator-scorer-split-protocol
smolmodelco:docs/forgejo-canonical-collaboration
No reviewers
Labels
No labels
R03
research-b
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".
No due date set.
Dependencies
No dependencies set
Reference
smolmodelco/thesmolmodelcompany!185
Loading…
Reference in a new issue
No description provided.
Delete branch "research/lantern-model-20261021"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
What this adds
Validation
python3 -m py_compile research/lantern_v1/*.pygit diff --checkpython3 research/lantern_v1/run_bounded.py tests(23 passed)Limits / work in progress
/home/cassie/.hermes/smc-lantern-20261021/evidence/lantern_v1/.This is intentionally WIP for session 1 of the five-stage project.
Session 3 — autonomous evaluation implementation
Implemented a one-shot held-panel evaluator with a frozen checkpoint digest, closed-loop GRU actions from public observation histories, a same-horizon checklist, and a uniform-posterior greedy information-gain comparator. The prospective panel is 32 seen-composition IID + 8 composition-shift incidents across eight seed clusters (120 policy-episode rows); uncertainty resamples paired seed clusters. No final-panel outputs have been generated yet. Comparator policy details and the 2,000-draw seed bootstrap were fixed in the protocol before exposure.
Validation: isolated bounded
python3 research/lantern_v1/run_bounded.py testspassed (29 tests);python3 scripts/check_docs.pypassed (470 Markdown files);py_compileandgit diff --checkpassed.The evaluator intentionally runs all three policies on identical incidents, calls
torch.load(..., weights_only=True), and writes an exclusive durable latch before generation to prevent a second held-panel launch. Training remains behavior-cloned imitation, not online exploration.Session 3 — saved-panel challenge audit
Added a reproducible audit that replays every saved trace and checks raw row coverage, costs, actions, and composition/seed replication. All 120 traces replay consistently. The generator challenge found all eight purported seed clusters identical within every one of the 15 composition × policy groups: seed is episode metadata, while faults are fixed by composition. The bootstrap intervals are therefore degenerate and the intended inferential comparison is uninterpretable; keep finite outcomes descriptive only, do not tune or rerun the exposed panel. Full report:
research/lantern_v1/STAGE3_REPORT.md; raw evaluation, audit output and exclusive one-shot latch are in the external evidence directory named there.Latest verification: isolated bounded suite 31 tests passed, cgroup cleanup confirmed; docs check passed for 471 Markdown files;
py_compileandgit diff --checkpassed. One short audit unit produced its verdict but the launcher did not observe its cgroup before exit; preserved and disclosed as an infrastructure-accounting failure. Aggregate ledger remains far below authorized ceilings.Stage 4 — independent saved-panel challenge
research/lantern_v1/STAGE4_CHALLENGE.md.Stage 5 — final result
research/lantern_v1/FINAL_REPORT.mdwith the trained checkpoint and evidence hashes, exact finite-panel descriptives, the deterministic seed-cluster inference failure, supplied-vs-learned boundaries, full resource accounting, and reproduction pointers.View command line instructions
Checkout
From your project repository, check out a new branch and test the changes.