Skip to content

Add SFT+GRPO interpretability report and sync COMMAND_SPEC - #4

Merged
zzzhangstat merged 2 commits into
mainfrom
docs/update-readme
Jun 29, 2026
Merged

Add SFT+GRPO interpretability report and sync COMMAND_SPEC#4
zzzhangstat merged 2 commits into
mainfrom
docs/update-readme

Conversation

@zzzhangstat

Copy link
Copy Markdown
Collaborator

What's changed

  • Add SFT+GRPO interpretability report (EN/zh) with SwanLab training curves
    • Per-sample paired analysis over 6,733 test samples explaining why the
      two-stage training works: SFT does the main capability acquisition
      (training reward saturates at ~0.999), while GRPO performs targeted
      long-tail refinement (canonicalization + hallucinated-slot suppression,
      fix:break ≈ 6:1)
  • Sync COMMAND_SPEC (EN/zh) to the latest tool_schema version

New files

  • GRPO_Interpretability_Report.md / _zh.md
  • assets/SwanLab-Chart_SlotAccuracy.png / SlotFormat.png

zzzhangstat and others added 2 commits June 29, 2026 16:05
Sync both COMMAND_SPEC.md and COMMAND_SPEC_zh.md with the canonical
command specification from the tool schema source.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: zzzhang20 <zzzhang20@iflytek.com>
Post-hoc analysis of why the two-stage SFT+GRPO training works: SFT does
the main capability acquisition (training reward saturates at ~0.999),
while GRPO performs targeted long-tail refinement (canonicalization and
hallucinated-slot suppression, fix:break ~6:1 on the paired test set).
Includes SwanLab reward curves and reproducibility notes.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: zzzhang20 <zzzhang20@iflytek.com>
@zzzhangstat
zzzhangstat merged commit 98ee788 into main Jun 29, 2026
1 check passed
@zzzhangstat
zzzhangstat deleted the docs/update-readme branch June 29, 2026 08:07
dongjiang1989 pushed a commit that referenced this pull request Aug 24, 2026
* docs: add customized HER Hack-Astron issue template

Signed-off-by: FenjuFu <fufenjupku@gmail.com>

* feat: add Domux HER Hack-Astron case framework

Signed-off-by: FenjuFu <92919259+FenjuFu@users.noreply.github.com>

* docs: remove internal campaign metrics

Signed-off-by: FenjuFu <92919259+FenjuFu@users.noreply.github.com>

---------

Signed-off-by: FenjuFu <fufenjupku@gmail.com>
Signed-off-by: FenjuFu <92919259+FenjuFu@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant