New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Add more env information to benchmark script #157

Merged

yaoyaoding merged 1 commit into hidet-org:main from yaoyaoding:cli-bench

Apr 5, 2023

Member

yaoyaoding commented Apr 5, 2023

No description provided.

a84cf84

yaoyaoding merged commit dfa638e into hidet-org:main

1 of 2 checks passed

yaoyaoding deleted the cli-bench branch

April 7, 2023 18:41

KTong821 pushed a commit to KTong821/hidet that referenced this pull request


          [App] Minor bugfixes for LLM app (hidet-org#157)

e9fad7a

- The attention scalar should be by the head dimension.
- The option name `tokens.for_huggingface` is incorrect, see the
following:
https://github.com/CentML/hidet/blob/eefc9d81afe687e9173c65c68fc3c7eb4e3019a7/python/hidet/option.py#L299-L304

With these changes the LLM app runs correctly before tracing into
FlowGraph. Those changes will come later, I'm isolating these minor
changes into their own PR here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment