research: gobig round 3 (3) — held-out L7-8 stop for sharp-max (frozen, run) #143

Open
starsetbyte wants to merge 2 commits from research/gobig3-val78-20261018 into research/gobig3-scratch-val-20261018
Owner

gobig_v2 round 3, study 3 (val78) — held-out lengths 7-8 stop for sharp-max seeds at PL16 depth 5-8

Continue the #139 (valmargin/fit-001) gated_sharp_max checkpoints for seeds 619719, 619720, 619721, 619723, 619724, 619725 on the original 840 rows until train strict AND VAL78 (N=4/6/8, 4 graphs each, 8 random words of length 7 and 8 per start, base+fresh, 2260 rows, new seeds, names disjoint from VAL56/train/eval) all-correct with min margin >= 0.001; cap 100. Eval PL16.

  • Freeze GOBIG3-VAL78-FROZEN-001 f33f346d…395d. Pre-freeze tests + dummy pipeline PASS.
  • Receipts: calibration 5.28 s / 5.27 s / 370 MiB; fit 3.38 s / 3.34 s / 314 MiB; eval 25.91 s / 25.89 s / 398 MiB. All exit 0.
  • Fit: 5 of 6 already met VAL78 (margins 0.045-2.93) -> 0 updates; only 619719 trained (5 updates, val margin 0.005 -> 1.87).
  • PL16 depth (from #139 -> now): 619719 5 -> 15 (L16 exact 0.971 -> 0.999, graphs 35 -> 47/48); the other five unchanged (5, 6, 5, 8, 5).
  • Reading: an 8-word-per-length validation set at lengths 7-8 is too small to catch the rare words that cap PL16 depth; the failures that remain are sparse (L16 exact 0.969-0.987) rather than systematic. A denser validation panel (e.g. all words of length 5-6 at N4, or more words at lengths 9-12) is the obvious next lever.

Base: #142 branch. Do not merge.

## gobig_v2 round 3, study 3 (val78) — held-out lengths 7-8 stop for sharp-max seeds at PL16 depth 5-8 Continue the #139 (valmargin/fit-001) gated_sharp_max checkpoints for seeds 619719, 619720, 619721, 619723, 619724, 619725 on the original 840 rows until train strict AND VAL78 (N=4/6/8, 4 graphs each, 8 random words of length 7 and 8 per start, base+fresh, 2260 rows, new seeds, names disjoint from VAL56/train/eval) all-correct with min margin >= 0.001; cap 100. Eval PL16. - Freeze GOBIG3-VAL78-FROZEN-001 `f33f346d…395d`. Pre-freeze tests + dummy pipeline PASS. - Receipts: calibration 5.28 s / 5.27 s / 370 MiB; fit 3.38 s / 3.34 s / 314 MiB; eval 25.91 s / 25.89 s / 398 MiB. All exit 0. - Fit: 5 of 6 already met VAL78 (margins 0.045-2.93) -> 0 updates; only 619719 trained (5 updates, val margin 0.005 -> 1.87). - PL16 depth (from #139 -> now): 619719 5 -> 15 (L16 exact 0.971 -> 0.999, graphs 35 -> 47/48); the other five unchanged (5, 6, 5, 8, 5). - Reading: an 8-word-per-length validation set at lengths 7-8 is too small to catch the rare words that cap PL16 depth; the failures that remain are sparse (L16 exact 0.969-0.987) rather than systematic. A denser validation panel (e.g. all words of length 5-6 at N4, or more words at lengths 9-12) is the obvious next lever. Base: #142 branch. Do not merge.
gobig_v2/val78: fit + eval
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
6f8bbfb82a
All checks were successful
checks / select relevant integrity checks (pull_request) Successful in 7s
checks / E01 candidate surface sufficiency (pull_request) Has been skipped
checks / DMS-003 protocol freeze integrity (pull_request) Has been skipped
checks / DMS-003 CPU successor integrity (pull_request) Has been skipped
checks / resource accounting and workflow consistency (pull_request) Has been skipped
checks / documentation integrity (pull_request) Successful in 7s
This pull request can be merged automatically.
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin research/gobig3-val78-20261018:research/gobig3-val78-20261018
git switch research/gobig3-val78-20261018

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch research/gobig3-scratch-val-20261018
git merge --no-ff research/gobig3-val78-20261018
git switch research/gobig3-val78-20261018
git rebase research/gobig3-scratch-val-20261018
git switch research/gobig3-scratch-val-20261018
git merge --ff-only research/gobig3-val78-20261018
git switch research/gobig3-val78-20261018
git rebase research/gobig3-scratch-val-20261018
git switch research/gobig3-scratch-val-20261018
git merge --no-ff research/gobig3-val78-20261018
git switch research/gobig3-scratch-val-20261018
git merge --squash research/gobig3-val78-20261018
git switch research/gobig3-scratch-val-20261018
git merge --ff-only research/gobig3-val78-20261018
git switch research/gobig3-scratch-val-20261018
git merge research/gobig3-val78-20261018
git push origin research/gobig3-scratch-val-20261018
Sign in to join this conversation.
No reviewers
No labels
R03
research-b
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
smolmodelco/thesmolmodelcompany!143
No description provided.