Skip to content

LauraRuis/trl_template

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

# Quick start

## Training env
```bash
ENVNAME=venvname
uv venv $ENVNAME --python 3.10
source $ENVNAME/bin/activate
uv pip install torch --index-url https://download.pytorch.org/whl/cu124
uv pip install transformers[torch] datasets tokenizers peft accelerate trl wandb hydra-core

hf auth login
wandb login
```

## Inference env
trl breaks if vllm is installed, so make a separate env.
```bash
ENVNAME=venvname
uv venv $ENVNAME --python 3.12
source $ENVNAME/bin/activate
uv pip install torch --index-url https://download.pytorch.org/whl/cu124
uv pip install transformers[torch] datasets tokenizers peft accelerate wandb hydra-core
uv pip install vllm --torch-backend=auto
hf auth login
wandb login
```

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages