Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deferrable mode for custom training job operators #27

Closed

Conversation

e-galan
Copy link
Collaborator

@e-galan e-galan commented Mar 14, 2024

The PR adds the deferrable mode feature for the following Vertex AI operators:

  • CreateCustomContainerTrainingJobOperator
  • CreateCustomPythonPackageTrainingJobOperator
  • CreateCustomTrainingJobOperator

Other changes include:

  • Fix for VertexAIModelLink. The old link url did not work anymore, I replaced it with a working one.
  • New unit tests
  • Update example dags

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

@e-galan e-galan force-pushed the add-defer-mode-to-custom-training-job-operators branch from 51e773f to 4130d02 Compare March 15, 2024 09:21
@MaksYermak
Copy link
Collaborator

Why did you not add a system test for CreateCustomTrainingJobOperator operartor?

@e-galan e-galan force-pushed the add-defer-mode-to-custom-training-job-operators branch from 4130d02 to be8d256 Compare March 15, 2024 14:18
@e-galan
Copy link
Collaborator Author

e-galan commented Mar 18, 2024

Why did you not add a system test for CreateCustomTrainingJobOperator operartor?

The system test is there now, thanks for pointing it out.

@e-galan e-galan force-pushed the add-defer-mode-to-custom-training-job-operators branch 2 times, most recently from 3ff9b47 to 16a1f74 Compare March 26, 2024 15:14
@e-galan e-galan force-pushed the add-defer-mode-to-custom-training-job-operators branch from 16a1f74 to cdba3ae Compare March 27, 2024 13:13
@e-galan e-galan requested a review from moiseenkov March 27, 2024 13:47
@e-galan e-galan closed this Mar 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants