New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

huggingface model support added #391

Merged

zainhoda merged 3 commits into vanna-ai:main from jis478:main

Apr 30, 2024

jis478 commented Apr 29, 2024

Hugginface model support added. In detail, it supports models loaded with AutoTokenizer' and 'AutoModelForCausalLM from 'transformer' library.
apply_chat_template is being used, which assumes that the models being used are chat-based models rather than completion models.


          huggingface model support added

fb2baf2

jis478 mentioned this pull request

Supporting AutoModelForCausalLM #385

Closed

zainhoda added 2 commits

April 30, 2024 17:21


          Merge branch 'main' into main

5ef0ea4


          add import tests

6bb70ac

zainhoda approved these changes

View reviewed changes

zainhoda merged commit 5c9af52 into vanna-ai:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment