Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Inference]Add BatchInferState, Sequence and InferConfig #5149

Merged
merged 10 commits into from
Dec 7, 2023
Merged

[Inference]Add BatchInferState, Sequence and InferConfig #5149

merged 10 commits into from
Dec 7, 2023

Commits on Dec 1, 2023

  1. add infer_struct and infer_config

    @isky-cd
    isky-cd committed Dec 1, 2023
    Configuration menu
    Copy the full SHA
    2a52867 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. update codes

    @isky-cd
    isky-cd committed Dec 4, 2023
    Configuration menu
    Copy the full SHA
    fbe49fc View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. change InferConfig

    @isky-cd
    isky-cd committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    2ee231d View commit details
    Browse the repository at this point in the history

  2. Add hf_model_config to the engine

    @isky-cd
    isky-cd committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    c500891 View commit details
    Browse the repository at this point in the history

  3. rm _get_hf_model_config

    @isky-cd
    isky-cd committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    9aeb8e8 View commit details
    Browse the repository at this point in the history

  4. update codes

    @isky-cd
    isky-cd committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    c53bfe2 View commit details
    Browse the repository at this point in the history

  5. made adjustments according to the feedback from the reviewer.

    @isky-cd
    isky-cd committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    c09279e View commit details
    Browse the repository at this point in the history

  6. update codes

    @isky-cd
    isky-cd committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    736dcbb View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Merge branch 'feature/colossal-infer' into infer_struct_and_config

    @isky-cd
    isky-cd committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    138a2be View commit details
    Browse the repository at this point in the history

  2. add ci test for config and struct

    @isky-cd
    isky-cd committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    d5058a3 View commit details
    Browse the repository at this point in the history