Skip to content

Issues: Lightning-AI/lightning-thunder

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

133 Open 92 Closed
133 Open 92 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

cuDNN errors on CI with PyTorch dev branch bug Something isn't working
#567 opened Jun 10, 2024 by t-vi
[distributed] Enable transformed modules to load state dicts of the originals distributed enhancement New feature or request tensor parallel distributed - tensor parallel transforms
#564 opened Jun 10, 2024 by crcrpar
@crcrpar @t-vi
2
TransformerEngine: Communication and Computation is not overlapped in backward pass with FSDP Zero3 bug Something isn't working TransformerEngine
#557 opened Jun 7, 2024 by kshitij12345
@kshitij12345
3
TypeError: Missing a required argument with thunder.jit in NeMo SD ResBlock bug Something isn't working nemo Issues needed to support NVIDIA NeMo models.
#548 opened Jun 6, 2024 by athitten
@t-vi @athitten
3
grad transform forward_and_backward_from_trace is not handling NumberProxy properly in saved_for_backward bug Something isn't working
#541 opened Jun 6, 2024 by jjsjann123
@jjsjann123 @IvanYashchuk
7
[distributed][Tensor Parallelism] Support meta device params tensor parallel distributed - tensor parallel
#540 opened Jun 6, 2024 by crcrpar
1
@crcrpar
Applying Thunder on torch.fx.GraphModule from Dynamo fails bug Something isn't working jit
#539 opened Jun 5, 2024 by IvanYashchuk
math.xxx calls in function on NumberProxy is not being traced. bug Something isn't working dynamic constraints symbolic values
#526 opened Jun 5, 2024 by jjsjann123
@jjsjann123
NVFuser error adding thunder.jit to UNet model of NeMo Stable Diffusion bug Something isn't working nemo Issues needed to support NVIDIA NeMo models.
#525 opened Jun 4, 2024 by athitten
@athitten
6
Thunder object's __repr__ should indicate what object they are (TensorProxy and others) enhancement New feature or request tracing architecture
#510 opened Jun 3, 2024 by t-vi
[RFC] Option to make a trace easier to interpret enhancement New feature or request
#507 opened Jun 2, 2024 by crcrpar
5
Distill API for module transformations from distributed / quantization uses of ThunderModule attributes enhancement New feature or request module
#497 opened May 31, 2024 by t-vi
1
Support RN50 BatchNorm fusions with cudnn cudnn enhancement New feature or request
#487 opened May 29, 2024 by vedaanta
@vedaanta
FP8 Linear and conv with cudnn cudnn enhancement New feature or request
#486 opened May 29, 2024 by vedaanta
@vedaanta
1
load/save_state_dict hooks for early transforms enhancement New feature or request module
#483 opened May 29, 2024 by t-vi
4
fsdp(jit(...)) transform can use more memory compared to jit(fsdp(...)) bug Something isn't working distributed
#478 opened May 29, 2024 by kshitij12345
2
OOM errors for Gemma-7, pythia-12b, Llama-2-13b-hf and Nous-Hermes-13b with FSDP zero3 and 2x8 H100 bug Something isn't working memory use
#474 opened May 29, 2024 by mpatel31415
@kiya00
5
Dynamic shape needs to be modeled in trace bug Something isn't working dynamic constraints
#471 opened May 29, 2024 by jjsjann123
8 tasks
@jjsjann123
Implement GroupNorm to invoke APEX GroupNorm for NeMo Stable Diffusion AutoEncoder performance bug Something isn't working nemo Issues needed to support NVIDIA NeMo models. performance
#468 opened May 29, 2024 by athitten
15
dtype inconsistencies when dividing/rounding tensors bug Something isn't working
#467 opened May 29, 2024 by k223kim
CI: Re-Enable torchrun call in Zero to Thunder notebook bug Something isn't working ci / tests ci
#465 opened May 27, 2024 by t-vi
Constraints to insert static numbers enhancement New feature or request
#463 opened May 26, 2024 by jjsjann123
@jjsjann123
Hang using thunder.jit with tokenizer in NeMo Stable Diffusion bug Something isn't working nemo Issues needed to support NVIDIA NeMo models.
#462 opened May 26, 2024 by athitten
7
Recursion error in transformer module with NeMo Stable Diffusion bug Something isn't working nemo Issues needed to support NVIDIA NeMo models. triage review
#461 opened May 26, 2024 by athitten
@t-vi
3
'NoneType' object error using thunder.jit with NeMo Stable Diffusion bug Something isn't working nemo Issues needed to support NVIDIA NeMo models. triage review
#460 opened May 25, 2024 by athitten
2
ProTip! Adding no:label will show everything without a label.