Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MODEL] Make constant vocab size for models instead dynamic #2290

Closed
wants to merge 1 commit into from
Closed

[MODEL] Make constant vocab size for models instead dynamic #2290

wants to merge 1 commit into from

Commits on May 7, 2024

  1. [MODEL] Make constant vocab size for models instead dynamic 

    Used model config vocab size in model compilation instead dynamic
variable, which degrades the performance of chat application.
    @krishnaraj36
    krishnaraj36 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    41dd4de View commit details
    Browse the repository at this point in the history