Skip to content

docs: complete optimizer variants map and dose semantics - #37

Merged
charlesmartin14 merged 2 commits into
mainfrom
agent/optimizer-variants-map-v2
Aug 9, 2026
Merged

docs: complete optimizer variants map and dose semantics#37
charlesmartin14 merged 2 commits into
mainfrom
agent/optimizer-variants-map-v2

Conversation

@charlesmartin14

@charlesmartin14 charlesmartin14 commented Aug 9, 2026

Copy link
Copy Markdown
Member

Status

Ready to merge. This PR supersedes #31.

PR #34 has been merged. This branch was rebuilt directly from the resulting main tip, so the effective diff is documentation-only and contains exactly:

  • OPTIMIZER_VARIANTS.md
  • README.md

What changed

  • Adds an authoritative optimizer map covering all seven current experiment packages.
  • Separates actuator, support/spectral geometry, and intervention cadence.
  • Adds the current full_matrix_log_rg active-set cone projector and projected Nesterov-state semantics.
  • Corrects the trace-log description: the actuator removes flow along a trace-log normal evaluated on retained support; it does not project accumulated weights into an ECS.
  • Replaces the ambiguous rank exponent q with mu_rank, reserving q/Q for the Marchenko–Pastur aspect ratio.
  • States the density-to-rank exponent correspondence with its assumptions and finite-size qualifications.
  • Documents the exact wwpgd_local_delta realized dose:
||Delta_removed||_F / max(||Delta_epoch||_F, eps)
  • Distinguishes realized dose from controls and caps such as correction_fraction and projection_strength.
  • Replaces the stale partial optimizer list in the root README with a link to the complete authoritative map.
  • Removes undocumented claims about external nanoGPT or WW-PGD adapter telemetry.

Scope

Documentation only. No optimizer code, ECS selection, defaults, hyperparameters, experiment recipes, or efficacy claims are changed.

@charlesmartin14
charlesmartin14 changed the base branch from fix/pr30-local-delta-provenance to main August 9, 2026 03:12
@charlesmartin14
charlesmartin14 force-pushed the agent/optimizer-variants-map-v2 branch from d04e6ab to 7f03b58 Compare August 9, 2026 03:13
@charlesmartin14
charlesmartin14 marked this pull request as ready for review August 9, 2026 03:14
@charlesmartin14
charlesmartin14 merged commit 099a3b0 into main Aug 9, 2026
charlesmartin14 added a commit that referenced this pull request Aug 9, 2026
Restore the WW-PGD local-delta telemetry and lifecycle fixes, their regression tests, and the optimizer variants documentation lost when main was force-pushed to add the executed baseline notebooks.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant