Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Falcon support #499

Merged
merged 12 commits into from
Sep 3, 2023
Merged

Add Falcon support #499

merged 12 commits into from
Sep 3, 2023

Commits on Sep 2, 2023

  1. Draft Falcon support

    @borzunov
    borzunov committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    15fed1e View commit details
    Browse the repository at this point in the history

  2. Support --throughput dry_run

    @borzunov
    borzunov committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    bd6aa23 View commit details
    Browse the repository at this point in the history

  3. Fix comment

    @borzunov
    borzunov committed Sep 2, 2023
    Configuration menu
    Copy the full SHA
    cc234c5 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2023

  1. Fix DistrtibutedFalconModel.word_embeddings_layernorm

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    ff83e7c View commit details
    Browse the repository at this point in the history

  2. Use NF4 for all models on CUDA

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    012ae0e View commit details
    Browse the repository at this point in the history

  3. Use safetensors float32 model

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    8d78cf2 View commit details
    Browse the repository at this point in the history

  4. Set default pad_token_id

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    97dd376 View commit details
    Browse the repository at this point in the history

  5. Set default revision for tiiuae/* repos to models in the in-library 

    format
    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    cac654a View commit details
    Browse the repository at this point in the history

  6. Fix num_key_value_groups

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    cda4fe8 View commit details
    Browse the repository at this point in the history

  7. Expand/collapse KV caches when config.new_decoder_architecture is True

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    4537c77 View commit details
    Browse the repository at this point in the history

  8. Fix cache reordering with seq_len = 0

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    f6553ad View commit details
    Browse the repository at this point in the history

  9. Fix dim order

    @borzunov
    borzunov committed Sep 3, 2023
    Configuration menu
    Copy the full SHA
    1d865d1 View commit details
    Browse the repository at this point in the history