Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Inference Cache #802

Merged
merged 28 commits into from
Apr 23, 2024
Merged

Inference Cache #802

merged 28 commits into from
Apr 23, 2024

Commits on Apr 10, 2024

  1. Finish inference cache

    @wanliAlex
    wanliAlex committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    0d555b8 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Add extra test in vectorise inference cache

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    061b2ce View commit details
    Browse the repository at this point in the history

  2. Add docstring for abstract cache

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    45f26c6 View commit details
    Browse the repository at this point in the history

  3. Catch mainline

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    610fa6b View commit details
    Browse the repository at this point in the history

  4. Finish unit tests

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    1f1f8a0 View commit details
    Browse the repository at this point in the history

  5. Add requirements for cachetools, readerwriterlock

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    3ff8cee View commit details
    Browse the repository at this point in the history

  6. add Reload the module to apply the new environment variables

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    2add027 View commit details
    Browse the repository at this point in the history

  7. add Reload the module to apply the new environment variables

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    1be6057 View commit details
    Browse the repository at this point in the history

  8. Add a warm-up call to concurrency tests

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    0fad6c7 View commit details
    Browse the repository at this point in the history

  9. Ensure we remove cache after the test cache class

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    196168a View commit details
    Browse the repository at this point in the history

  10. Ensure we remove cache after the test cache class

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    049b2ee View commit details
    Browse the repository at this point in the history

  11. Add a get_available_models() function in s2_inference

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    ba377ef View commit details
    Browse the repository at this point in the history

  12. Remove unnecessary print

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    8a1439a View commit details
    Browse the repository at this point in the history

  13. Add get_marqo_inference_cache()

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    5ea06b1 View commit details
    Browse the repository at this point in the history

  14. Change name to _marqo_inference_cache

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    90d4ee0 View commit details
    Browse the repository at this point in the history

  15. Make available model private module variables

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    167288c View commit details
    Browse the repository at this point in the history

  16. Refactor available_models to _available_models

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    8d5c06f View commit details
    Browse the repository at this point in the history

  17. Fix tests

    @wanliAlex
    wanliAlex committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    3063d21 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Update the Marqo Inference Cache doc

    @wanliAlex
    wanliAlex committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    50bcb2f View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2024

  1. Merge branch 'mainline' into li/inference-cache

    @wanliAlex
    wanliAlex authored Apr 19, 2024
    Configuration menu
    Copy the full SHA
    1c672d7 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Respond to comments

    @wanliAlex
    wanliAlex committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    605a0e0 View commit details
    Browse the repository at this point in the history

  2. Update vectorise function

    @wanliAlex
    wanliAlex committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    01be581 View commit details
    Browse the repository at this point in the history

  3. Fix a unit test

    @wanliAlex
    wanliAlex committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    0c84b50 View commit details
    Browse the repository at this point in the history

  4. Fix a unit test

    @wanliAlex
    wanliAlex committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    7e675c7 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. Add cachetools==5.3.1 to requirements

    @wanliAlex
    wanliAlex committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    5787197 View commit details
    Browse the repository at this point in the history

  2. Add cachetools==5.3.1 to requirements

    @wanliAlex
    wanliAlex committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    ecd5d68 View commit details
    Browse the repository at this point in the history

  3. Catch mainline

    @wanliAlex
    wanliAlex committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    0910c66 View commit details
    Browse the repository at this point in the history

  4. Catch mainline

    @wanliAlex
    wanliAlex committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    8a9a431 View commit details
    Browse the repository at this point in the history