Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Testing][Models] Add gpt2 module in testing models #252

Merged
merged 5 commits into from May 29, 2023

Conversation

yaoyaoding
Copy link
Member

Added gpt2 to hidet.testing.models.gpt2, and implemented the version that supports both initial generation and key-value cache.

Enhancement:

  • Added hook support for compiled model, used to investigate the execution of the compiled mode (mainly for debug).
  • Fixed a bug in memory planner.

@yaoyaoding yaoyaoding force-pushed the gpt2 branch 2 times, most recently from 536592b to 96bac3a Compare May 28, 2023 19:58
@yaoyaoding yaoyaoding merged commit 6d4bd3d into hidet-org:main May 29, 2023
2 checks passed
@yaoyaoding yaoyaoding deleted the gpt2 branch May 29, 2023 16:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant