Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pipeline root can not be bucket root after change in storage API #2936

Closed
mcompen opened this issue Nov 9, 2023 · 0 comments · Fixed by #3224 or #3175
Closed

Pipeline root can not be bucket root after change in storage API #2936

mcompen opened this issue Nov 9, 2023 · 0 comments · Fixed by #3224 or #3175
Assignees
@Ark-kun
Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

Comments

@mcompen
Copy link

mcompen commented Nov 9, 2023 •
edited

Environment details

  • All OS and Python versions:
  • google-cloud-storage==2.13.0

Code example

job = aip.PipelineJob(
               ...
                pipeline_root="gs://bucket_root",  # note no trailing slash and no blob provided
               ...
            )

Stack trace

"/Users/manu.compen/Library/Caches/pypoetry/virtualenvs/bla-py3.9/lib/python3.9/site-packages/google/cloud/aiplatform/pipeline_jobs.py", line 404, in submit
    gcs_utils.create_gcs_bucket_for_pipeline_artifacts_if_it_does_not_exist(
  File "/Users/manu.compen/Library/Caches/pypoetry/virtualenvs/bla-py3.9/lib/python3.9/site-packages/google/cloud/aiplatform/utils/gcs_utils.py", line 237, in create_gcs_bucket_for_pipeline_artifacts_if_it_does_not_exist
    pipelines_bucket = storage.Blob.from_string(
  File "/Users/manu.compen/Library/Caches/pypoetry/virtualenvs/bla-py3.9/lib/python3.9/site-packages/google/cloud/storage/blob.py", line 410, in from_string
    raise ValueError("URI scheme must be gs")
ValueError: URI scheme must be gs

See change in python-storage Blob api: googleapis/python-storage@0a243fa
@product-auto-label product-auto-label bot added the api: vertex-ai Issues related to the googleapis/python-aiplatform API. label Nov 9, 2023
mcompen added a commit to mcompen/python-aiplatform that referenced this issue Nov 10, 2023
@mcompen
Minor: fix bucket from_string if not exist (googleapis#2936)
3f64049
@mcompen mcompen mentioned this issue Nov 10, 2023
Closed
6 tasks
@cojenco cojenco mentioned this issue Nov 11, 2023
Closed
@sasha-gitg sasha-gitg added type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. priority: p2 Moderately-important priority. Fix may not be included in next release. labels Jan 11, 2024
Ark-kun pushed a commit to mcompen/python-aiplatform that referenced this issue Jan 12, 2024
@mcompen @Ark-kun
Minor: fix bucket from_string if not exist (googleapis#2936)
c1b5808
@Ark-kun Ark-kun self-assigned this Jan 16, 2024
Ark-kun pushed a commit to mcompen/python-aiplatform that referenced this issue Jan 18, 2024
@mcompen @Ark-kun
Minor: fix bucket from_string if not exist (googleapis#2936)
53c5694
copybara-service bot pushed a commit that referenced this issue Jan 23, 2024
@Ark-kun
fix: Fixed the PipelineJob bucket creation after a breaking change in…
a3db56e 
… Google Cloud Storage client library

Fixes #2936

PiperOrigin-RevId: 600653928
@copybara-service copybara-service bot mentioned this issue Jan 23, 2024
Merged
copybara-service bot pushed a commit that referenced this issue Jan 23, 2024
@Ark-kun
fix: Fixed the PipelineJob bucket creation after a breaking change in…
c930276 
… Google Cloud Storage client library

Fixes #2936

PiperOrigin-RevId: 600653928
@release-please release-please bot mentioned this issue Jan 23, 2024
Merged
@brandtoliver brandtoliver mentioned this issue Feb 2, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Ark-kun Ark-kun

Labels
api: vertex-ai Issues related to the googleapis/python-aiplatform API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns.
Projects
None yet
Milestone
No milestone
3 participants
@Ark-kun @mcompen @sasha-gitg