Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

remove pre/post callbacks #92

Merged
merged 43 commits into from
Apr 12, 2024
Merged

remove pre/post callbacks #92

merged 43 commits into from
Apr 12, 2024

Commits on Mar 27, 2024

  1. removing pre/post - WIP

    @mmoskal
    mmoskal committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    cb95bf8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into pre_post

    @mmoskal
    mmoskal committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    ae92ea2 View commit details
    Browse the repository at this point in the history

  3. pre/post code complete

    @mmoskal
    mmoskal committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    c6dc3fb View commit details
    Browse the repository at this point in the history

  4. error fixes

    @mmoskal
    mmoskal committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    239d1d9 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. fix warnings

    @mmoskal
    mmoskal committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    4740c6e View commit details
    Browse the repository at this point in the history

  2. working on pyctrl

    @mmoskal
    mmoskal committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    0f651a9 View commit details
    Browse the repository at this point in the history

  3. bring prompt APIs back in {js,py}ctrl 

    partially reverts 593e575
    @mmoskal
    mmoskal committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    d8b70f6 View commit details
    Browse the repository at this point in the history

  4. re-work to only use mid

    @mmoskal
    mmoskal committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    67ad78f View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. add tokens_repr(); bugfix

    @mmoskal
    mmoskal committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    6a7f8cb View commit details
    Browse the repository at this point in the history

  2. add post_process back

    @mmoskal
    mmoskal committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    874f6b2 View commit details
    Browse the repository at this point in the history

  3. re-gen files

    @mmoskal
    mmoskal committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    8754af3 View commit details
    Browse the repository at this point in the history

  4. add limited forking

    @mmoskal
    mmoskal committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    7af1d6f View commit details
    Browse the repository at this point in the history

  5. fork fixes

    @mmoskal
    mmoskal committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    abf446a View commit details
    Browse the repository at this point in the history

  6. don't do the EOS->space auto-replacement

    @mmoskal
    mmoskal committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    74de675 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. make jsctrl work with only mid callback 

    also fixes #77
    @mmoskal
    mmoskal committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    b6c443a View commit details
    Browse the repository at this point in the history

  2. install guidance (for deps) in docker

    @mmoskal
    mmoskal committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    ef7c9dd View commit details
    Browse the repository at this point in the history

  3. Add wasm timer resolution option to server.sh script

    @mmoskal
    mmoskal committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    c3ab1c1 View commit details
    Browse the repository at this point in the history

  4. make the gctrl work again

    @mmoskal
    mmoskal committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    dfe5755 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. add aici_native crate

    @mmoskal
    mmoskal committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    ebf3dab View commit details
    Browse the repository at this point in the history

  2. remove unused deps 

    use rustc-hash not fxhash everywhere
    @mmoskal
    mmoskal committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    75313a0 View commit details
    Browse the repository at this point in the history

  3. fix build

    @mmoskal
    mmoskal committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    3f01040 View commit details
    Browse the repository at this point in the history

  4. move core parser to library

    @mmoskal
    mmoskal committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    f764fc8 View commit details
    Browse the repository at this point in the history

  5. cleanup

    @mmoskal
    mmoskal committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    53a4658 View commit details
    Browse the repository at this point in the history

  6. add TokenizerEnv

    @mmoskal
    mmoskal committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    a436181 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2024

  1. minor

    @mmoskal
    mmoskal committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    75829d1 View commit details
    Browse the repository at this point in the history

  2. Update TokenParser struct to make token_env field public

    @mmoskal
    mmoskal committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    a724889 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. improvements to byte forcing

    @mmoskal
    mmoskal committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    b1b9b4d View commit details
    Browse the repository at this point in the history

  2. fix comment

    @mmoskal
    mmoskal committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    213b7b3 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. implement max_tokens

    @mmoskal
    mmoskal committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    c02454a View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. updating python code to deal with no pre/post

    @mmoskal
    mmoskal committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    9f27a0e View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. token splicing in vllm

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    c299820 View commit details
    Browse the repository at this point in the history

  2. update vllm

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    df5a541 View commit details
    Browse the repository at this point in the history

  3. add --skip and --only to test driver

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7ec0488 View commit details
    Browse the repository at this point in the history

  4. start declctrl port to pre/post removal branch

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    6a48502 View commit details
    Browse the repository at this point in the history

  5. add get_config() host API (fork support detection so far)

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    c6a51e6 View commit details
    Browse the repository at this point in the history

  6. add "inference_caps" LLM->aicirt

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    a885ba4 View commit details
    Browse the repository at this point in the history

  7. add fork_supported() function; fix tests

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    4c079a2 View commit details
    Browse the repository at this point in the history

  8. test noops

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    9479488 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'pre_post' into declctrl_pre_post

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7b8aa6d View commit details
    Browse the repository at this point in the history

  10. add aicirt --cap-fork; drop inference_cap req

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    08f21d1 View commit details
    Browse the repository at this point in the history

  11. fix typo

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    2d58639 View commit details
    Browse the repository at this point in the history

  12. fix declctrl

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    7804d11 View commit details
    Browse the repository at this point in the history

  13. enable submodules in actions

    @mmoskal
    mmoskal committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    2f655cd View commit details
    Browse the repository at this point in the history