size_diagnostic_v1: size failure = 1/N dilution of soft edge weights (0 updates) #131

Open
starsetbyte wants to merge 19 commits from research/size-diagnostic-20261018 into main
Owner

Stacked on #128. SIZE-DIAGNOSTIC-FROZEN-001 93a60e16...a0a. Pre-freeze stdlib tests + dummy pipeline PASS (not charged).

0-update diagnostic of the six #128 checkpoints on new 4-8 node panels (16 graphs/size, lengths 0-4). Step-by-step reimplementation reproduced model logits bitwise; all weights bitwise unchanged.

Receipts: calibration 4.93 s / 4.91 s CPU / 324 MiB; run 50.43 s / 50.38 s CPU / 331 MiB.

Findings:

  • Soft weight on the true edge falls ~1/N in every checkpoint (e.g. gated 619721: .446 at N4 -> .257 at N8), because relation weights are normalized over all N nodes. The target-vs-nontarget incoming contrast shrinks accordingly and the pooled mean shifts with N.
  • First errors occur while states are still inside the trained range; out-of-range saturation and uniform selection (entropy -> 1, gap -> 0) follow the collapse.
  • Counterfactual exact one-hot edges (weights untouched): gated 619721 (positive-edge convention) goes from 35% to 100% exact on 8-node graphs through length 4. Checkpoints that learned an anti-edge convention break under hard edges, as expected.

Implication: size-invariant (sharp or count-independent) relation aggregation should remove the size dependence. Not merged.

Stacked on #128. SIZE-DIAGNOSTIC-FROZEN-001 `93a60e16...a0a`. Pre-freeze stdlib tests + dummy pipeline PASS (not charged). 0-update diagnostic of the six #128 checkpoints on new 4-8 node panels (16 graphs/size, lengths 0-4). Step-by-step reimplementation reproduced model logits bitwise; all weights bitwise unchanged. Receipts: calibration 4.93 s / 4.91 s CPU / 324 MiB; run 50.43 s / 50.38 s CPU / 331 MiB. Findings: - Soft weight on the true edge falls ~1/N in every checkpoint (e.g. gated 619721: .446 at N4 -> .257 at N8), because relation weights are normalized over all N nodes. The target-vs-nontarget incoming contrast shrinks accordingly and the pooled mean shifts with N. - First errors occur while states are still inside the trained range; out-of-range saturation and uniform selection (entropy -> 1, gap -> 0) follow the collapse. - Counterfactual exact one-hot edges (weights untouched): gated 619721 (positive-edge convention) goes from 35% to **100% exact on 8-node graphs through length 4**. Checkpoints that learned an anti-edge convention break under hard edges, as expected. Implication: size-invariant (sharp or count-independent) relation aggregation should remove the size dependence. Not merged.
Composition study: read-only inspection-001 results; evaluation not admitted
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
4817b5d908
COMPOSITION-FROZEN-002: sign-aware drift, wall-only reserve, 250 s CPU cap
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
a4f0a9453f
Composition eval-001 under FROZEN-002: NO_RELIABLE_AUTONOMOUS_COMPOSITION (strict depth 1/1/1)
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
8db16bfdde
composition_fit_v1: calibration-001 failed before any update (batch cap 128); stopped
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
21ab06372d
composition_fit_v1 FROZEN-002: fit + eval: MIXED_PARTIAL_COMPOSITION (strict depth 4/4/2)
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 6s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
5f8ddb027a
composition_extend_v1: calibration-001 failed (TypeError); stopped
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
9def66822e
composition_extend_v1 FROZEN-002: smoke CPU stop, calibration KeyError; stopped
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 6s
84eba19e9f
composition_extend_v1 FROZEN-003: smoke+calibration pass; admission script NameError; stopped
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 6s
73ff1eb3c1
composition_extend_v1 FROZEN-004: baseline refit + extension eval
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
6337e6842f
composition_size_v1: calibration, admission, fit, evaluation
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
3c195b2d9c
size_diagnostic_v1: calibration, admission, run (0 updates)
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 8s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
1f038c6692
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 8s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
Required
Details
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin research/size-diagnostic-20261018:research/size-diagnostic-20261018
git switch research/size-diagnostic-20261018
Sign in to join this conversation.
No reviewers
No labels
R03
research-b
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
smolmodelco/thesmolmodelcompany!131
No description provided.