Skip to content

Use shared tokenizer save helper in exporters#1951

Merged
changwangss merged 3 commits into
mainfrom
wangchang/logger
Jun 25, 2026
Merged

Use shared tokenizer save helper in exporters#1951
changwangss merged 3 commits into
mainfrom
wangchang/logger

Conversation

@changwangss

@changwangss changwangss commented Jun 25, 2026

Copy link
Copy Markdown
Contributor

Description

This PR makes tokenizer saving simpler and more consistent.

Type of Change

Refactor

Related Issues

Fixes or relates to #

Checklist Before Submitting

  • My code has been tested locally.
  • Documentation has been updated as needed.
  • New or updated tests are included where applicable.
  • The CUDA CI has passed. You can trigger it by commenting /azp run Unit-Test-CUDA-AutoRound.

Signed-off-by: changwangss <chang1.wang@intel.com>
@changwangss changwangss requested a review from wenhuach21 June 25, 2026 02:33
Comment thread auto_round/export/export_to_autoround/export_to_fp8.py Outdated
Comment thread auto_round/export/export_to_autoround/export_to_nvfp_mx.py Outdated
@chensuyue

Copy link
Copy Markdown
Contributor

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@changwangss changwangss changed the title improve print to logger Use shared tokenizer save helper in exporters Jun 25, 2026
@changwangss changwangss requested a review from wenhuach21 June 25, 2026 03:12
@wenhuach21

Copy link
Copy Markdown
Contributor

Thank you for the refinement

@chensuyue

Copy link
Copy Markdown
Contributor

/azp run Unit-Test-CUDA-AutoRound

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines successfully started running 1 pipeline(s).

@changwangss changwangss merged commit 436b9db into main Jun 25, 2026
47 checks passed
@changwangss changwangss deleted the wangchang/logger branch June 25, 2026 05:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants