Small-model reasoning and adaptation research
  • CSS 35.9%
  • Python 32%
  • Astro 31.5%
  • JavaScript 0.6%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Pyrrha 9c4948fedf
All checks were successful
checks / documentation integrity (push) Successful in 7s
site: establish public research homepage (#9)
site: establish public research homepage (#9)
2026-09-20 22:37:34 +00:00
.github Repository governance, CI checks, and generated results ledger (#2) 2026-09-20 15:57:39 -04:00
agents Repository governance, CI checks, and generated results ledger (#2) 2026-09-20 15:57:39 -04:00
docs docs: plan the minimum evaluation apparatus (#6) 2026-09-20 21:22:32 +00:00
experiments docs(R03): specify generators, scorers, and splits (#5) 2026-09-20 21:16:56 +00:00
results Repository governance, CI checks, and generated results ledger (#2) 2026-09-20 15:57:39 -04:00
scripts Repository governance, CI checks, and generated results ledger (#2) 2026-09-20 15:57:39 -04:00
site site: establish public research homepage (#9) 2026-09-20 22:37:34 +00:00
templates Define small-model reasoning and adaptation research program (#1) 2026-09-20 15:51:22 -04:00
.gitignore Repository governance, CI checks, and generated results ledger (#2) 2026-09-20 15:57:39 -04:00
AGENTS.md docs: establish Forgejo as canonical collaboration forge (#4) 2026-09-20 20:48:48 +00:00
LICENSE Initial commit 2026-09-20 15:09:11 -04:00
README.md site: establish public research homepage (#9) 2026-09-20 22:37:34 +00:00

The Smol Model Company

Research small models that reason, compose skills, and adapt to unfamiliar tasks under practical local-compute limits. Transfer successful mechanisms into a useful local assistant.

Public site: thesmolmodel.co

Primary goal: demonstrate stronger reasoning and adaptation, with evidence about where the improvement comes from. Transfer goal: preserve those gains in an everyday local system.

Status: research design prepared for Cassie's review. No implementation, model download, training, benchmark result, or rental is included in this change. The research direction is agreed; the written design and numerical experiment budgets are proposals.

Collaboration

The canonical collaboration forge is Forgejo: active issues, branches, pull requests, reviews, and merges happen there. GitHub remains a public mirror for discovery, not the active task queue or review surface. Read the Forgejo workflow and decision 0003 before contributing.

Start here

  1. Read AGENTS.md.
  2. Read the research design and evaluation protocol.
  3. Select your agent role and claim a task in the initial backlog.
  4. Follow the compute policy and coordination protocol.
  5. Use the experiment template before running a candidate and the result template afterward.

Initial research portfolio

Track Question Starting experiment
Representation and reusable skills Can a small model compose verified operations on unfamiliar problems? E01
Recurrent computation Can reusing parameters improve reasoning beyond simply generating more candidates? E02
Temporary adaptation Can a bounded update learn a new rule more efficiently than prompting or search? E03

Maintain at most one main GPU experiment and one CPU/evaluation task concurrently. E03 starts after the first two tracks have produced baseline evidence and a capacity review.

The research map records additional directions and primary sources. The results ledger contains no experimental findings and is generated from run reports under results/. Governance and protocol changes are recorded in decision records.

Existing small-model checkpoints are practical starting points. Tiny controlled training runs test mechanisms. Cactus/Needle is an optional comparison, and the PSTV is an optional later target; neither defines this project's scope.

Reproducibility and licensing

Record exact code, model, tokenizer, dataset, environment, and hardware identities with every run. Store large weights and datasets outside Git; commit manifests and evidence references. The repository's MIT license does not relicense third-party weights, datasets, or dependencies.