Demonstration of lookahead decoding technique:
https://lmsys.org/blog/2023-11-21-lookahead-decoding/
More info: #4207
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||
Demonstration of lookahead decoding technique:
https://lmsys.org/blog/2023-11-21-lookahead-decoding/
More info: #4207