Skip to content

Add SLIME per-token loss option - #337

Merged
Legendarylibr merged 1 commit into
mainfrom
codex/slime-per-token-loss
Jul 14, 2026
Merged

Add SLIME per-token loss option#337
Legendarylibr merged 1 commit into
mainfrom
codex/slime-per-token-loss

Conversation

@Legendarylibr

Copy link
Copy Markdown
Owner

Summary

  • add calculate_per_token_loss support to local SLIME config, manifest, trainer, and Forge UI
  • store token-level rollout logprobs for opt-in token-weighted PPO loss while preserving default per-sample loss
  • document the upstream-style option and add focused tests for config projection and loss normalization

Validation

  • make ci-fast (1322 passed, 17 deselected, 1 existing Python 3.14 aiosqlite warning)
  • .venv/bin/ruff check seiso/slime_single_gpu/config.py seiso/slime_single_gpu/trainer.py seiso/training/config.py tests/test_slime_single_gpu.py tests/test_training_config.py
  • .venv/bin/python -m pytest tests/test_slime_single_gpu.py tests/test_training_config.py tests/test_multi_gpu.py -q
  • cd forge-ui && npm run build

@Legendarylibr
Legendarylibr force-pushed the codex/slime-per-token-loss branch from b44934d to 2b5ba04 Compare July 14, 2026 07:13
@Legendarylibr
Legendarylibr merged commit 5d6c5f5 into main Jul 14, 2026
8 checks passed
@Legendarylibr
Legendarylibr deleted the codex/slime-per-token-loss branch July 14, 2026 07:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant