-
Notifications
You must be signed in to change notification settings - Fork 667
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature]: Add Top K as a backend parameter #1105
Comments
VaibhavMalik4187
added a commit
to VaibhavMalik4187/k8sgpt
that referenced
this issue
May 11, 2024
This commit adds Top-K sampling, a feature that allows users to control the randomness of the generated text by specifying the number of most probable next words considered by the model. This enhances user control and potentially improves the quality of the generated outputs. Fixes: k8sgpt-ai#1105 Signed-off-by: VaibhavMalik4187 <vaibhavmalik2018@gmail.com>
4 tasks
VaibhavMalik4187
added a commit
to VaibhavMalik4187/k8sgpt
that referenced
this issue
May 11, 2024
This commit adds Top-K sampling, a feature that allows users to control the randomness of the generated text by specifying the number of most probable next words considered by the model. This enhances user control and potentially improves the quality of the generated outputs. Fixes: k8sgpt-ai#1105 Signed-off-by: VaibhavMalik4187 <vaibhavmalik2018@gmail.com>
AlexsJones
added a commit
that referenced
this issue
May 16, 2024
This commit adds Top-K sampling, a feature that allows users to control the randomness of the generated text by specifying the number of most probable next words considered by the model. This enhances user control and potentially improves the quality of the generated outputs. Fixes: #1105 Signed-off-by: VaibhavMalik4187 <vaibhavmalik2018@gmail.com> Co-authored-by: Alex Jones <alexsimonjones@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Checklist
Is this feature request related to a problem?
No
Problem Description
Top K is a common parameter for models. This parameter should be added to k8sgpt, and configurable for any backends which have models that support Top K.
Solution Description
Benefits
Users gain additional configuration over the backend model by utilizing the Top K parameter.
Potential Drawbacks
No response
Additional Information
No response
The text was updated successfully, but these errors were encountered: