Skip to content

Conversation

SagsMug
Copy link
Contributor

@SagsMug SagsMug commented May 4, 2023

Updates chat example
Updates plain llama example
Adds some usage examples

TODO:

  • Test lora

Should fix #141

@SagsMug SagsMug marked this pull request as draft May 4, 2023 16:35
@SagsMug SagsMug marked this pull request as ready for review May 6, 2023 10:41
@SagsMug
Copy link
Contributor Author

SagsMug commented May 8, 2023

@abetlen I think you can review this now.
I dont really know any lora's, so its left untested
Mirostat was only added to chat, i can add it to the plain example aswell.

@abetlen
Copy link
Owner

abetlen commented May 8, 2023

@SagsMug looks good to me, great work.

@abetlen abetlen merged commit ed0f48b into abetlen:main May 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update low-level examples to use new sampling API
2 participants