feat: LLM - Made tuning asynchronous when tuning becomes GA#2372
Closed
copybara-service[bot] wants to merge 0 commit into
Closed
feat: LLM - Made tuning asynchronous when tuning becomes GA#2372copybara-service[bot] wants to merge 0 commit into
copybara-service[bot] wants to merge 0 commit into
Conversation
a383277 to
0422e49
Compare
ce442ca to
ef264b4
Compare
ef264b4 to
226ab8b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
feat: LLM - Made tuning asynchronous when tuning becomes GA
Previously,
tune_modelwaited for the tuning is complete, then modified the model in-place.This behavior will change in the future GA (non-preview) classes:
In the future,
tune_modelwill become asynchronous: It will start tuning job and return a job object immediately without waiting. This will allow the user to do other work while the model is being tuned. This will also allow the user to perform multiple tuning jobs in parallel.Future breaking change: The model will no longer be updated in-place, so the user will need to get the tuned model from the job object.
To make the transition easier and avoid breaking changes, the
.tune_model(...)method will start returning the job object even in preview classes (although it will still wait for the job completion and update the model in-place too). This makes it possible to start writing future-proof code immediately.Usage: