Skip to content

feat: trainable biases + real-task generalization for the GF-T trainer - #1867

Merged
gHashTag merged 1 commit into
masterfrom
feat/trainable-bias
Aug 7, 2026
Merged

feat: trainable biases + real-task generalization for the GF-T trainer#1867
gHashTag merged 1 commit into
masterfrom
feat/trainable-bias

Conversation

@gHashTag

@gHashTag gHashTag commented Aug 7, 2026

Copy link
Copy Markdown
Owner

gen() now emits TRAINABLE hidden + output biases (a proper general 2-layer net). Self-tests PASS: generated XOR microcode trains 4/4; a (2,4,1) net trains a NOISY NONLINEAR 2D task and generalizes to held-out 58/60 (~97%) — real learning, not toy XOR. Same shared smul+sadd datapath, ~constant area. A proper programmable ternary NN trainer that learns real nonlinear tasks with generalization. docs/NOW.md updated. Refs #1764

gen() now emits TRAINABLE hidden biases b_j and output biases bo_o (a proper
general 2-layer net, not the XOR-specific fixed-bias hack): forward z_j=W_j.x+b_j,
y_o=v_o.relu(z)+bo_o; backprop adds bias grads/updates.

Self-tests PASS: (a) generated XOR microcode trains 4/4; (b) a (2,4,1) net trains
a NOISY NONLINEAR 2D task (XOR-region, real-valued points) and generalizes to
held-out 58/60 (~97%) -- real learning + generalization, not toy XOR. Still one
shared smul+sadd datapath, ~constant area. A proper programmable ternary NN
trainer that learns real nonlinear tasks with generalization.

Refs #1764

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

📓 NotebookLM Notebook linked to this PR

This notebook contains session context, decisions, and artifacts for this work.

@github-actions

github-actions Bot commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

PR Dashboard

Generated at: 2026-08-07 12:22:49 UTC

Summary

Status Count
Total Open PRs 12
PRs with Failing Checks 0
PRs with All Checks Green 12
READY 5
FAILING 0
PENDING 0

Seal Status

  • ⚠️ STALE -- sha256(compiler.rs)=4c1aaad5309a != manifest seal=87e5cbd3ad94.
    The committed NMSE numbers were certified against an older compiler.rs.
    Run scripts/reseal-check.sh locally for the two-step reseal command (advisory; not a merge gate).

@gHashTag
gHashTag merged commit 8a1a3a1 into master Aug 7, 2026
17 checks passed
@gHashTag
gHashTag deleted the feat/trainable-bias branch August 7, 2026 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant