Skip to content

[Unity] Update LM Sample builtins#14793

Merged
junrushao merged 1 commit intoapache:unityfrom
tqchen:llm
May 6, 2023
Merged

[Unity] Update LM Sample builtins#14793
junrushao merged 1 commit intoapache:unityfrom
tqchen:llm

Conversation

@tqchen
Copy link
Member

@tqchen tqchen commented May 6, 2023

This PR updates the LM sample routine builtins.
Make the sample from logits aware of temperature.
Add sample from prob that samples from probablity
distribution after softmax scaling.

This PR updates the LM sample routine builtins.
Make the sample from logits aware of temperature.
Add sample from prob that samples from probablity
distribution after softmax scaling.
@tvm-bot
Copy link
Collaborator

tvm-bot commented May 6, 2023

Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment.

Generated by tvm-bot

@junrushao junrushao merged commit 40fab65 into apache:unity May 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants