Skip to content

Issues: pytorch/ao

[RFC] Plans for torchao
#47 opened Mar 12, 2024 by supriyar
Open 21
float8 upcoming feature tracker
#556 opened Jul 30, 2024 by vkuzo
Open
[Tracker] WIP features for torchao 0.5
#667 opened Aug 13, 2024 by supriyar
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

91 Open 56 Closed
91 Open 56 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Question: How to use Float8InferenceLinear with FSDP1/2? float8 inference
#704 opened Aug 19, 2024 by qingquansong
5
[AQT-bug] AffineQuantizedTensor raises error with .cuda()
#698 opened Aug 17, 2024 by gau-nernst
@jerryzh168
1
[RFC] Which low bit CUDA kernels should we merge or write?
#697 opened Aug 17, 2024 by msaroufim
5
unskip test_dynamic_quant_per_channel_numerics_cuda(self):
#687 opened Aug 15, 2024 by msaroufim
[FP8] performance degradation in speed and memory without compile float8 performance
#685 opened Aug 15, 2024 by leeeizhang
1
Tutorial "run_vit_b_quant.py" cannot run bug Something isn't working
#675 opened Aug 14, 2024 by relaxtheo
@jerryzh168
7
[Llama] Make Llama in torchao trainable enhancement New feature or request
#674 opened Aug 14, 2024 by gau-nernst
get_block_size function supports different granularities
#669 opened Aug 13, 2024 by jerryzh168
[Tracker] WIP features for torchao 0.5
#667 opened Aug 13, 2024 by supriyar
1 of 15 tasks
high throughput inference inference rfc
#663 opened Aug 12, 2024 by msaroufim
3
Self compressing neural networks good first issue Good for newcomers qat
#658 opened Aug 12, 2024 by msaroufim
autoquant api sharp edges autoquant
#657 opened Aug 12, 2024 by msaroufim
FSDP 2 low bit optim broken on pytorch nightlies
#652 opened Aug 10, 2024 by msaroufim
@gau-nernst
11
NF4 quantization slower on 0.3 vs 0.1 bug Something isn't working
#642 opened Aug 8, 2024 by ebsmothers
13
Replace flash_4 with FlexAttention good first issue Good for newcomers
#639 opened Aug 8, 2024 by cpuhrsch
[RFC] Add LayerSkip to AO enhancement New feature or request
#633 opened Aug 8, 2024 by jcaip
3
aqt peak memory performance worse than subclass apis
#624 opened Aug 7, 2024 by HDCharles
Update the CI/CD to use AWS G6 instance ci
#611 opened Aug 6, 2024 by jainapurva
9 tasks
[llama] Use horizontal fusion trick from Attention for FeedForward good first issue Good for newcomers
#606 opened Aug 6, 2024 by cpuhrsch
1
torchao install error from torchchat in Google colab binaries
#589 opened Aug 1, 2024 by sunshinesfbay
3
Spin Quant in TorchAO good first issue Good for newcomers
#579 opened Jul 30, 2024 by HDCharles
Llama 3.1 support in torchao/_models
#578 opened Jul 30, 2024 by HDCharles
1
GPTQ implementation with tensor subclasses good first issue Good for newcomers
#577 opened Jul 30, 2024 by HDCharles
1
[RFC]: Float8 Inference float8 rfc
#574 opened Jul 30, 2024 by drisspg
1
Float8Tensor.to_original_precision() returns wrong dtype float8
#573 opened Jul 30, 2024 by vkuzo
ProTip! Add no:assignee to see everything that’s not assigned.