add IntxUnpackedToInt8Tensor to safetensors #3065

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

liangel-02 merged 24 commits into main from gh/liangel/4/head

Sep 26, 2025

Contributor

liangel-02 commented Sep 25, 2025 •

edited

Loading

adding IntxUnpackedToInt8Tensor‎ to safetensors (IntxWeightOnlyConfig)

modified unit test, python test/prototype/safetensors/test_safetensors_support.py

Stack from ghstack (oldest at bottom):

-> add IntxUnpackedToInt8Tensor to safetensors #3065

liangel-02 added 14 commits

September 24, 2025 14:09


          add int4tensor support for safetensors

e212a84

[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

7c82d4d

[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

bbeaf52

[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

0200ad1

[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

60c5de9

[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

6e31683

**Summary**
adding `Int4Tensor` support for safetensors (`Int4WeightOnlyConfig`)

**Test plan**
modified unit test to include `Int4WeightOnlyConfig`
`python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

86d7fcf

**Summary**
adding `Int4Tensor` support for safetensors (`Int4WeightOnlyConfig`)

**Test plan**
modified unit test to include `Int4WeightOnlyConfig`
`python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update base for Update on "add int4tensor support for safetensors"

512f9ed

**Summary**
adding `Int4Tensor` support for safetensors (`Int4WeightOnlyConfig`)

**Test plan**
modified unit test to include `Int4WeightOnlyConfig`
`python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add int4tensor support for safetensors"

f7b8068

**Summary**
adding `Int4Tensor` support for safetensors (`Int4WeightOnlyConfig`)

**Test plan**
modified unit test to include `Int4WeightOnlyConfig`
`python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          add int4preshuffledtensor to safetensors

9395b3f

[ghstack-poisoned]


          Update on "add int4preshuffledtensor to safetensors"

585afe2

adding `Int4PreshuffledTensor` to safetensors 

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          add int4tilepackedto4dtensor subclass to safetensors

87d2e18

[ghstack-poisoned]


          Update on "add int4tilepackedto4dtensor subclass to safetensors"

6007af3

[ghstack-poisoned]


          add IntxUnpackedToInt8Tensor to safetensors

ce346e7

[ghstack-poisoned]

This was referenced Sep 25, 2025

add int4tensor support for safetensors #3056

Merged

add int4preshuffledtensor to safetensors #3063

Closed

add int4tilepackedto4dtensor subclass to safetensors #3064

Merged

meta-cla bot added the CLA Signed label

liangel-02 added a commit that referenced this pull request


          add IntxUnpackedToInt8Tensor to safetensors

dc1d510

ghstack-source-id: 51d6a48
Pull Request resolved: #3065

pytorch-bot bot commented Sep 25, 2025 •

edited

Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/3065

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 4ebc5cd with merge base fd06151 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

liangel-02 added the topic: new feature label

liangel-02 requested a review from jerryzh168

September 25, 2025 14:18

jerryzh168 approved these changes

View reviewed changes

Contributor

jerryzh168 left a comment

thanks, please add a test for Int8DynamicActivationIntxWeightConfig as well

liangel-02 added 2 commits

September 25, 2025 12:16


          Update base for Update on "add IntxUnpackedToInt8Tensor to safetensors"

b53afbe

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add IntxUnpackedToInt8Tensor to safetensors"

7eda61b

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]

liangel-02 added a commit that referenced this pull request


          add IntxUnpackedToInt8Tensor to safetensors

65745af

ghstack-source-id: 6e87bec
Pull Request resolved: #3065

liangel-02 added 2 commits

September 25, 2025 12:52


          Update base for Update on "add IntxUnpackedToInt8Tensor to safetensors"

bc69d4f

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add IntxUnpackedToInt8Tensor to safetensors"

ae4ffdc

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]

liangel-02 added a commit that referenced this pull request


          add IntxUnpackedToInt8Tensor to safetensors

84c0b7f

ghstack-source-id: 956bb30
Pull Request resolved: #3065


          Update base for Update on "add IntxUnpackedToInt8Tensor to safetensors"

4914d68

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add IntxUnpackedToInt8Tensor to safetensors"

9c0b4de

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]

liangel-02 added a commit that referenced this pull request


          add IntxUnpackedToInt8Tensor to safetensors

480f073

ghstack-source-id: 7f1fbe3
Pull Request resolved: #3065

liangel-02 added 2 commits

September 25, 2025 17:35


          Update base for Update on "add IntxUnpackedToInt8Tensor to safetensors"

5884d16

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add IntxUnpackedToInt8Tensor to safetensors"

13768b1

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]

liangel-02 added a commit that referenced this pull request


          add IntxUnpackedToInt8Tensor to safetensors

2ea7eff

ghstack-source-id: d74d535
Pull Request resolved: #3065

liangel-02 changed the base branch from gh/liangel/4/base to main

September 26, 2025 14:31

liangel-02 added 2 commits

September 26, 2025 07:32


          Update base for Update on "add IntxUnpackedToInt8Tensor to safetensors"

7e1857c

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]


          Update on "add IntxUnpackedToInt8Tensor to safetensors"

4ebc5cd

adding `IntxUnpackedToInt8Tensor‎` to safetensors (`IntxWeightOnlyConfig`)

modified unit test, `python test/prototype/safetensors/test_safetensors_support.py`




[ghstack-poisoned]

liangel-02 added a commit that referenced this pull request


          add IntxUnpackedToInt8Tensor to safetensors

dc3b17b

ghstack-source-id: fe092a0
Pull Request resolved: #3065

liangel-02 merged commit 7dd7183 into main

41 of 42 checks passed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed topic: new feature