branch: v1
The basic GPT2 Inference implemtation:
See this: [古法编程] GPT2 Inference from Scratch / 从头实现 GPT2 的推理.
branch: kvcache
Add kvcache support.
solofox/gpt2
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
| Name | Name | Last commit date | ||
|---|---|---|---|---|
branch: v1
The basic GPT2 Inference implemtation:
See this: [古法编程] GPT2 Inference from Scratch / 从头实现 GPT2 的推理.
branch: kvcache
Add kvcache support.