Name		Name	Last commit message	Last commit date
data		data
Dockerfile		Dockerfile
README.md		README.md
build.sh		build.sh
generate.py		generate.py
requirements.txt		requirements.txt
run.sh		run.sh
server.py		server.py
train.py		train.py

Repository files navigation

llama-fastapi

Train and inference llama from scratch

Requirements

Linux
Docker
Nvidia GPU
Python3

Install

git clone https://github.com/format37/llama-fastapi.git
cd llama-fastapi
sh build.sh

Server start

sh run.sh

Call train

python3 train.py

Call inference

python3 generate.py

Credits

About

train and inference llama from scratch

0 stars

1 watching

Report repository

Releases

Packages

Used by

Contributors

Languages