Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Change Llama tokenizer from LlamaTokenizer to AutoTokenizer #380

Merged
merged 4 commits into from
May 31, 2024
Merged

Change Llama tokenizer from LlamaTokenizer to AutoTokenizer #380

merged 4 commits into from
May 31, 2024

Commits on May 31, 2024

  1. Update supervised_finetuning.py

    @princepride
    princepride authored May 31, 2024
    Configuration menu
    Copy the full SHA
    28bb732 View commit details
    Browse the repository at this point in the history

  2. Update pretraining.py

    @princepride
    princepride authored May 31, 2024
    Configuration menu
    Copy the full SHA
    f7dcb46 View commit details
    Browse the repository at this point in the history

  3. Update orpo_training.py

    @princepride
    princepride authored May 31, 2024
    Configuration menu
    Copy the full SHA
    04d217b View commit details
    Browse the repository at this point in the history

  4. Update ppo_training.py

    @princepride
    princepride authored May 31, 2024
    Configuration menu
    Copy the full SHA
    f2cf523 View commit details
    Browse the repository at this point in the history