Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fsdp inference checkpoints #39

Merged
merged 22 commits into from
Jul 31, 2023
Merged

Fsdp inference checkpoints #39

merged 22 commits into from
Jul 31, 2023

Commits on Jul 19, 2023

  1. adding fsdp checkpoint loading

    @HamidShojanazeri
    HamidShojanazeri committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    25b60ee View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. adding dist checkpoint handler for signle gpu

    @HamidShojanazeri
    HamidShojanazeri committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    1505326 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2023

  1. adding inference updates

    @HamidShojanazeri
    HamidShojanazeri committed Jul 22, 2023
    Configuration menu
    Copy the full SHA
    7ad5bd5 View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. clean up

    @HamidShojanazeri
    HamidShojanazeri committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    76a187c View commit details
    Browse the repository at this point in the history

  2. update to main

    @HamidShojanazeri
    HamidShojanazeri committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    a7fe039 View commit details
    Browse the repository at this point in the history

  3. adding checkpoint conversion

    @HamidShojanazeri
    HamidShojanazeri committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    3c84962 View commit details
    Browse the repository at this point in the history

  4. remove the unused code

    @HamidShojanazeri
    HamidShojanazeri committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    ceaf630 View commit details
    Browse the repository at this point in the history

  5. add converter script

    @HamidShojanazeri
    HamidShojanazeri committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    171c358 View commit details
    Browse the repository at this point in the history

  6. clean up

    @HamidShojanazeri
    HamidShojanazeri committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    4320528 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. added steps for conversion of fsdp to Hf

    @HamidShojanazeri
    HamidShojanazeri committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    4b18e49 View commit details
    Browse the repository at this point in the history

  2. fixed arg names

    @HamidShojanazeri
    HamidShojanazeri committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    9e3b1b7 View commit details
    Browse the repository at this point in the history

  3. fixed arg names

    @HamidShojanazeri
    HamidShojanazeri committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    569f8b7 View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2023

  1. add the default option for find the HF model_name/path from train_par… 

    …am.yaml
    @HamidShojanazeri
    HamidShojanazeri committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    50e9d17 View commit details
    Browse the repository at this point in the history

  2. clean up

    @HamidShojanazeri
    HamidShojanazeri committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    475e67b View commit details
    Browse the repository at this point in the history

  3. adding train_param.yaml saving for fsdp checkpoint loading for inference

    @HamidShojanazeri
    HamidShojanazeri committed Jul 30, 2023
    Configuration menu
    Copy the full SHA
    231c9e7 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. add rank to save_train_params

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    668c364 View commit details
    Browse the repository at this point in the history

  2. merge main branch

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    5b91611 View commit details
    Browse the repository at this point in the history

  3. add notes for train_param.yaml

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    311a5c1 View commit details
    Browse the repository at this point in the history

  4. clean up

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    9c95ed4 View commit details
    Browse the repository at this point in the history

  5. fix spell check word list

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    5f97db8 View commit details
    Browse the repository at this point in the history

  6. fixing the path to script

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    7d2e068 View commit details
    Browse the repository at this point in the history

  7. clean up

    @HamidShojanazeri
    HamidShojanazeri committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    c4e96af View commit details
    Browse the repository at this point in the history