Skip to content

feat: LLM - Made tuning asynchronous when tuning becomes GA#2372

Closed
copybara-service[bot] wants to merge 0 commit into
mainfrom
copybara_549754111
Closed

feat: LLM - Made tuning asynchronous when tuning becomes GA#2372
copybara-service[bot] wants to merge 0 commit into
mainfrom
copybara_549754111

Conversation

@copybara-service
Copy link
Copy Markdown
Contributor

@copybara-service copybara-service Bot commented Jul 20, 2023

feat: LLM - Made tuning asynchronous when tuning becomes GA

Previously, tune_model waited for the tuning is complete, then modified the model in-place.
This behavior will change in the future GA (non-preview) classes:

In the future, tune_model will become asynchronous: It will start tuning job and return a job object immediately without waiting. This will allow the user to do other work while the model is being tuned. This will also allow the user to perform multiple tuning jobs in parallel.

Future breaking change: The model will no longer be updated in-place, so the user will need to get the tuned model from the job object.

To make the transition easier and avoid breaking changes, the .tune_model(...) method will start returning the job object even in preview classes (although it will still wait for the job completion and update the model in-place too). This makes it possible to start writing future-proof code immediately.

Usage:

tuning_job = model.tune_model(...)  # Returns tuning job. In preview: Waits for the tuning job to finish
tuned_model = tuning_job.get_tuned_model()  # Returns tuned model after waiting for the tuning job to finish.

@product-auto-label product-auto-label Bot added size: xs Pull request size is extra small. api: vertex-ai Issues related to the googleapis/python-aiplatform API. labels Jul 20, 2023
@copybara-service copybara-service Bot changed the title feat: LLM - Made tuning asynchronous feat: LLM - Made tuning asynchronous when tuning becomes GA Aug 18, 2023
@product-auto-label product-auto-label Bot added size: m Pull request size is medium. and removed size: xs Pull request size is extra small. labels Aug 18, 2023
@copybara-service copybara-service Bot force-pushed the copybara_549754111 branch 2 times, most recently from ce442ca to ef264b4 Compare August 20, 2023 10:04
@copybara-service copybara-service Bot closed this Aug 20, 2023
@product-auto-label product-auto-label Bot added size: u Pull request is empty. and removed size: m Pull request size is medium. labels Aug 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: vertex-ai Issues related to the googleapis/python-aiplatform API. google-contributor size: u Pull request is empty.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants