Skip to content

Issues: aws-neuron/transformers-neuronx

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

19 Open 44 Closed
19 Open 44 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Latest changes introduced for continuous batching break Mixtral model bug Something isn't working
#84 opened Apr 15, 2024 by dacorvo
3
Add support for Baichuan-13B model
#83 opened Apr 9, 2024 by cszhz
Add support for gemma models
#82 opened Apr 2, 2024 by benglewis
Improve Neuron model loading time
#80 opened Mar 13, 2024 by dacorvo
4
NaN outputs when masking llama model inputs
#79 opened Feb 13, 2024 by dacorvo
6
Backward compatibility with saved llama 2 compiled artifacts enhancement New feature or request
#78 opened Jan 18, 2024 by dacorvo
1
User feedback when compiling and reloading a large model enhancement New feature or request
#76 opened Jan 17, 2024 by dacorvo
1
Support for MPT model
#74 opened Jan 11, 2024 by klutzDrawers
1
Infering logits from model.forward for the entire batch instead of the last forward's output. documentation Improvements or additions to documentation
#73 opened Jan 10, 2024 by michaelfeil
5
Generate Llama 2 from Embeddings
#72 opened Jan 8, 2024 by liechtym
5
Vicuna13B model support
#66 opened Dec 19, 2023 by petrovicu
Can't save/serialize any models except GPT2
#58 opened Nov 17, 2023 by awskila
3
Serving Throughput Optimizations (e.g. PagedAttention)
#52 opened Oct 12, 2023 by vigneshv59
2
Any solution to save the converted model? enhancement New feature or request
#29 opened Aug 14, 2023 by aliseyfi
3
Discrepancies Between GPU and Neuron-based Outputs for GPTJ Model on inf2.24xlarge
#28 opened Aug 13, 2023 by ho4040
2
gpt2_demo @ d3f6e49 (latest) breaks
#27 opened Aug 7, 2023 by supersat
3
Running GPT-NeoX on inf2.24xlarge kills kernel
#24 opened Jul 22, 2023 by aliseyfi
2
Support for Falcon models
#18 opened Jul 9, 2023 by Mehdi-Aiyad
3
BART support
#11 opened Jun 23, 2023 by sinking-point
1
ProTip! Add no:assignee to see everything that’s not assigned.