Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

Standalone loader #125

Merged
merged 46 commits into from
Apr 22, 2023
Merged

Standalone loader #125

merged 46 commits into from
Apr 22, 2023

Commits on Apr 8, 2023

  1. Add loader stub for GGJT

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    bdbea68 View commit details
    Browse the repository at this point in the history

  2. Add loading code for ggjt 

    Now it can load the model, but it's not working
    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    b0a666f View commit details
    Browse the repository at this point in the history

  3. code cleanup that doesn't change anything

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    9eefdc5 View commit details
    Browse the repository at this point in the history

  4. more code cleanup

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    c212c53 View commit details
    Browse the repository at this point in the history

  5. minor change 

    in math, tensor loading
    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    bfaec3a View commit details
    Browse the repository at this point in the history

  6. Add non-mmap loader for GGJT

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    b6044ee View commit details
    Browse the repository at this point in the history

  7. Prefer traits in loader.rs

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    1872dda View commit details
    Browse the repository at this point in the history

  8. cargo fmt

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    ec1fca7 View commit details
    Browse the repository at this point in the history

  9. cargo clippy --fix

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    cc846ae View commit details
    Browse the repository at this point in the history

  10. Remove ggml::Tensor::set_data

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    bf847dd View commit details
    Browse the repository at this point in the history

  11. fix(llama): buffer tokens until valid UTF-8

    @philpax @iacore
    philpax authored and iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    ea7094c View commit details
    Browse the repository at this point in the history

  12. Add standalone loader

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    c848d5e View commit details
    Browse the repository at this point in the history

  13. Move loader to standalone crate llama-loader

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    8390593 View commit details
    Browse the repository at this point in the history

  14. [llama-loader] Support non-copy loader

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    15fe19b View commit details
    Browse the repository at this point in the history

  15. Use functions from the new crate

    @iacore
    iacore committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    2e9311d View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. Merge branch 'main' into llama-loader

    @philpax
    philpax committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    4dd0fc5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:rustformers/llama-rs into llama-loader

    @philpax
    philpax committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    c40e36e View commit details
    Browse the repository at this point in the history

  3. refactor(llama): pass mut tensors down

    @philpax
    philpax committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    34429e0 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. feat/loader Make hparams configurable

    @iacore
    iacore committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    38e7d58 View commit details
    Browse the repository at this point in the history

  2. feat/loader Add hook to support multi-part model loading

    @iacore
    iacore committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    5dfc55d View commit details
    Browse the repository at this point in the history

  3. rename llama-loader to ggml-loader

    @iacore
    iacore committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    48efd74 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Merge branch 'main' into llama-loader

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    0fbbedd View commit details
    Browse the repository at this point in the history

  2. fix

    @jon-chuang @philpax
    jon-chuang authored and philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    d65996d View commit details
    Browse the repository at this point in the history

  3. no_alloc

    @jon-chuang @philpax
    jon-chuang authored and philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    267d8ae View commit details
    Browse the repository at this point in the history

  4. chore: fix clippy

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    81a6979 View commit details
    Browse the repository at this point in the history

  5. refactor(util): make find_all_model_files error

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    80d189e View commit details
    Browse the repository at this point in the history

  6. UnsupportedElementtype -> UnsupportedElementType

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    85e1148 View commit details
    Browse the repository at this point in the history

  7. feat: experimental loader2 wire-up (incomplete)

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    3f29992 View commit details
    Browse the repository at this point in the history

  8. fix dead doc link

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    94951c4 View commit details
    Browse the repository at this point in the history

  9. feat: turn mmap on by default, add --no-mmap

    @philpax
    philpax committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    69f355b View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. Fix loading GGJT

    @iacore
    iacore committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    17bc0cc View commit details
    Browse the repository at this point in the history

  2. minor fix

    @iacore
    iacore committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    6641ae9 View commit details
    Browse the repository at this point in the history

  3. Add mmap

    @iacore
    iacore committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    3910b6a View commit details
    Browse the repository at this point in the history

  4. cargo fmt

    @iacore
    iacore committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    e4834bd View commit details
    Browse the repository at this point in the history

  5. Make loader2 default

    @iacore
    iacore committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    c380cee View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2023

  1. fix: remove dbg!(start_pos)

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    5b9788b View commit details
    Browse the repository at this point in the history

  2. fix: respect --no-mmap

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    cbf0756 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:rustformers/llama-rs into llama-loader

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    8813b0f View commit details
    Browse the repository at this point in the history

  4. chore: remove old comments

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    430abfe View commit details
    Browse the repository at this point in the history

  5. chore: remove unused error case

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    bf6a917 View commit details
    Browse the repository at this point in the history

  6. fix: remove some panics

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    9b908ae View commit details
    Browse the repository at this point in the history

  7. feat: remove AlreadyAdded error 

    Apparently some models just have token dupes? /shrug
    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    d8c4ca6 View commit details
    Browse the repository at this point in the history

  8. minor fix

    @iacore
    iacore committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    cabc4c9 View commit details
    Browse the repository at this point in the history

  9. fix: Vocabulary::push_token is infallible

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    1930496 View commit details
    Browse the repository at this point in the history

  10. fix: bail on multipart models with loader2

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    bdb9856 View commit details
    Browse the repository at this point in the history

  11. refactor: make Vocabulary::push_token pub(crate)

    @philpax
    philpax committed Apr 22, 2023
    Configuration menu
    Copy the full SHA
    b41fe14 View commit details
    Browse the repository at this point in the history