Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

if dreambooth lora #3360

Merged
merged 15 commits into from
May 9, 2023
Merged

if dreambooth lora #3360

merged 15 commits into from
May 9, 2023

Commits on May 8, 2023

  1. update IF stage I pipelines 

    add fixed variance schedulers and lora loading
    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    5d9315f View commit details
    Browse the repository at this point in the history

  2. added kv lora attn processor

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    d8a7aec View commit details
    Browse the repository at this point in the history

  3. allow loading into alternative lora attn processor

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    88d0746 View commit details
    Browse the repository at this point in the history

  4. make vae optional

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    f0e9c56 View commit details
    Browse the repository at this point in the history

  5. throw away predicted variance

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    547bd15 View commit details
    Browse the repository at this point in the history

  6. allow loading into added kv lora layer

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    b6b74e6 View commit details
    Browse the repository at this point in the history

  7. allow load T5

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    945ced5 View commit details
    Browse the repository at this point in the history

  8. allow pre compute text embeddings

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    ce91895 View commit details
    Browse the repository at this point in the history

  9. set new variance type in schedulers

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    08fafee View commit details
    Browse the repository at this point in the history

  10. fix copies

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    b86ddc4 View commit details
    Browse the repository at this point in the history

  11. refactor all prompt embedding code 

    class prompts are now included in pre-encoding code
max tokenizer length is now configurable
embedding attention mask is now configurable
    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    4042274 View commit details
    Browse the repository at this point in the history

  12. fix for when variance type is not defined on scheduler

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    c10918d View commit details
    Browse the repository at this point in the history

  13. do not pre compute validation prompt if not present

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    a9fae92 View commit details
    Browse the repository at this point in the history

  14. add example test for if lora dreambooth

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    1ea1da8 View commit details
    Browse the repository at this point in the history

  15. add check for train text encoder and pre compute text embeddings

    @williamberman
    williamberman committed May 8, 2023
    Configuration menu
    Copy the full SHA
    1c40a33 View commit details
    Browse the repository at this point in the history