Repository navigation
Massively Speeding up LLM inference with Speculative Diffusion Decoding | Ferdinando (Nando) Fioretto #3699
Replies: 1 comment
|
? |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Massively Speeding up LLM inference with Speculative Diffusion Decoding | Ferdinando (Nando) Fioretto
Faster LLM inference with discrete diffusion drafting and alignment.
https://nandofioretto.github.io/projects/speculative-diffusion-decoding/
All reactions