Pull requests: pytorch-labs/gpt-fast
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Add support for DBRX
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#174
opened May 7, 2024 by
yanboliang
Loading…
[example] Added (hacky) Grok1 support
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#171
opened May 5, 2024 by
Chillee
Loading…
Making TokenizerInterface more usable for the user's code.
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#170
opened Apr 30, 2024 by
Artyom17
Loading…
unify llama 3 support
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#169
opened Apr 29, 2024 by
nivibilla
Loading…
Llama3 8b perf numbers on A100
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#166
opened Apr 29, 2024 by
yanboliang
Loading…
Remove used empty variable
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#164
opened Apr 26, 2024 by
yncxcw
Loading…
Add download script for tinyllamas
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#163
opened Apr 24, 2024 by
yiliu30
Loading…
Optimize Int8 Woq for CPU
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#161
opened Apr 23, 2024 by
yanbing-j
Loading…
Fixing quantize in int4 mode
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#159
opened Apr 19, 2024 by
Artyom17
Loading…
fix input_pos shape in comment
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#157
opened Apr 18, 2024 by
YassineYousfi
Loading…
testing HQQ [not for land]
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#155
opened Apr 9, 2024 by
HDCharles
Loading…
Fix compile_prefill to prevent CUDA error
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#153
opened Apr 7, 2024 by
PasserBy4
Loading…
fixing GPTQ
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#148
opened Mar 28, 2024 by
HDCharles
Loading…
fixing GPTQ
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#147
opened Mar 26, 2024 by
HDCharles
Loading…
Fixing block size for Mistral-7B.
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#141
opened Mar 19, 2024 by
Artyom17
Loading…
GGUF fp32/fp16 conversion to checkpoint
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#134
opened Mar 12, 2024 by
mergennachin
Loading…
Optimized the process of loading PyTorch state dictionaries, merging …
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#133
opened Mar 12, 2024 by
hvaria
Loading…
Update to use torch.nn.attention.sdpa_kernel
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#131
opened Mar 11, 2024 by
yanboliang
Loading…
Updating requirements.txt and .gitignore
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#119
opened Feb 29, 2024 by
Artyom17
Loading…
[example] Added gemma support
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#115
opened Feb 29, 2024 by
Chillee
Loading…
[quant] Add int8 per token dynamic quant + int4 per group quant for ExecuTorch
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#102
opened Feb 8, 2024 by
jerryzh168
Loading…
[not for land] Temp fix to make GPTQ work
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#83
opened Jan 13, 2024 by
HDCharles
Loading…
generate.py: do not use args in function main
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#80
opened Jan 10, 2024 by
guoyejun
Loading…
intel gpu : enable intel gpu
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#79
opened Jan 10, 2024 by
xiaowangintel
Loading…
Check PyTorch version
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#67
opened Dec 22, 2023 by
yifuwang
Loading…
Previous Next
ProTip!
no:milestone will show everything without a milestone.