Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(launch): remove fallback resource when not specified for a queue #4637

Merged
merged 15 commits into from
Dec 21, 2022

Conversation

gtarpenning
Copy link
Contributor

@gtarpenning gtarpenning commented Dec 14, 2022

Now, when a user doesn't specify a --resource and also uses the --queue param, we expect the queue to be configured with a default resource configuration. If not, we now fail, with an error message from the backend:

Error while calling W&B API: No resource configuration and no manually defined resource (<Response [404]>)

Also deprecates the "local" and "bare" runners, ticket

@codecov
Copy link

codecov bot commented Dec 14, 2022

Codecov Report

Merging #4637 (3fa537d) into main (cf7df1d) will increase coverage by 0.02%.
The diff coverage is 100.00%.

❗ Current head 3fa537d differs from pull request most recent head c8e58f8. Consider uploading reports for the commit c8e58f8 to get more accurate results

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main    #4637      +/-   ##
==========================================
+ Coverage   83.26%   83.28%   +0.02%     
==========================================
  Files         279      279              
  Lines       34911    34913       +2     
==========================================
+ Hits        29067    29076       +9     
+ Misses       5844     5837       -7     
Flag Coverage Δ
functest 55.94% <0.00%> (+0.03%) ⬆️
unittest 73.88% <100.00%> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
wandb/sdk/launch/launch_add.py 100.00% <ø> (ø)
wandb/sdk/launch/runner/loader.py 100.00% <ø> (ø)
wandb/cli/cli.py 69.33% <100.00%> (ø)
wandb/sdk/launch/launch.py 84.09% <100.00%> (+0.36%) ⬆️
wandb/util.py 87.55% <0.00%> (-0.41%) ⬇️
wandb/sdk/wandb_run.py 90.66% <0.00%> (-0.18%) ⬇️
wandb/sdk/lib/git.py 77.71% <0.00%> (ø)
wandb/sdk/lib/printer.py 89.24% <0.00%> (+0.63%) ⬆️
wandb/sdk/internal/file_stream.py 89.86% <0.00%> (+1.01%) ⬆️
wandb/filesync/step_prepare.py 94.93% <0.00%> (+1.26%) ⬆️
... and 2 more

@gtarpenning gtarpenning marked this pull request as ready for review December 15, 2022 00:22
Copy link
Contributor

@KyleGoyette KyleGoyette left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One nit, then I will stamp

wandb/sdk/launch/launch.py Outdated Show resolved Hide resolved
wandb/cli/cli.py Outdated Show resolved Hide resolved
@gtarpenning gtarpenning enabled auto-merge (squash) December 21, 2022 20:36
@gtarpenning gtarpenning merged commit 84be24c into main Dec 21, 2022
@gtarpenning gtarpenning deleted the griffin/launch/remove-cli-default branch December 21, 2022 21:20
bcsherma added a commit that referenced this pull request Dec 29, 2022
commit d244d07
Author: Katia Patkin <87335417+kptkin@users.noreply.github.com>
Date:   Tue Dec 27 13:31:20 2022 -0800

    style(public-api): format public file with proper formating (#4697)

    fix format

commit 3dc8584
Author: Janosh Riebesell <janosh.riebesell@gmail.com>
Date:   Tue Dec 27 10:21:41 2022 -0800

    feat(sdk): add `exist_ok=False` to `file.download()` (#4564)

    * add exist_ok=False to file.download() to avoid raising ValueError if file exists but you don't want to redownload

    also add type annotations

    * handle case file exists and exist_ok==True in File.download()

    * point out exist_ok=True option in file already exists error

    * tweak if/else paths

    Co-authored-by: Katia Patkin <87335417+kptkin@users.noreply.github.com>

commit 4a4651e
Author: Vish Rajiv <8609620+vwrj@users.noreply.github.com>
Date:   Fri Dec 23 14:27:16 2022 -0800

    fix(artifacts): artifact.version should be the version index from the associated collection (#4486)

    fix(artifacts): artifact.version should be the version index from the associated collection

    Co-authored-by: Hugh Wimberly <hugh.wimberly@wandb.com>
    Co-authored-by: Dmitry Duev <dmitryduev@users.noreply.github.com>

commit a7de372
Author: Noah Luna <15202580+ngrayluna@users.noreply.github.com>
Date:   Fri Dec 23 14:19:14 2022 -0800

    docs(sdk): Removed less than, greater than characters from dosctrings… (#4687)

    docs(sdk): Removed less than, greater than characters from dosctrings. Re: It breaks the new doc engine Docusuarus.

commit a45629d
Author: Noah Luna <15202580+ngrayluna@users.noreply.github.com>
Date:   Fri Dec 23 14:18:00 2022 -0800

    docs(sdk): Fixed typo in docstring for data_types.Objects3D (#4543)

    Fixed typo in docstring for data_types.Objects3D

commit 6df4b88
Author: Dmitry Duev <dmitryduev@users.noreply.github.com>
Date:   Fri Dec 23 13:16:16 2022 -0800

    test(integrations): fix import tests (#4690)

    test(integrations): fix import tests

commit 8da62bb
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Fri Dec 23 11:46:00 2022 -0800

    refactor(artifacts): consolidate hash utilities into lib.hashutil (#4525)

    * Move all MD5 and base64 encode utilities to lib.hashutil

    * Remove duplicate function definitions

    * Refactor common code out into small functions

    * Use hypothesis to for testing

    * Remove unused code

    * Update type annotations for hash types

commit eb70114
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Thu Dec 22 09:44:23 2022 -0800

    test(artifacts): improve storage handler test coverage (#4674)

    * Add test case for adding a file to a finalized artifact

    * Add test case for caching local file references

    * Add GCS and WBArtifact storage handler tests

commit 7106d17
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Wed Dec 21 19:36:31 2022 -0800

    fix(artifacts): get digest directly instead of from the manifests' manifest (#4681)

    Reference digest directly instead of though the manifests' manifest

commit 0a21fd1
Author: KyleGoyette <kdgoyette@gmail.com>
Date:   Wed Dec 21 14:37:03 2022 -0800

    feat(launch): Default to using model-registry project for agent and launch_add (#4613)

commit 84be24c
Author: Griffin Tarpenning <griffin.tarpenning@wandb.com>
Date:   Wed Dec 21 13:20:02 2022 -0800

    chore(launch): remove fallback resource when not specified for a queue (#4637)

commit cf7df1d
Author: speezepearson <speezepearson@users.noreply.github.com>
Date:   Tue Dec 20 17:10:13 2022 -0800

    test(sdk): add tests for Api.upload_file_retry (#4639)

commit c1ad0c0
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Tue Dec 20 16:08:37 2022 -0800

    refactor(artifacts): use ArtifactEntry directly instead of subclassing (#4649)

    * Subsume ArtifactEntry into ArtifactManifestEntry

commit 491fc59
Author: speezepearson <speezepearson@users.noreply.github.com>
Date:   Tue Dec 20 15:26:54 2022 -0800

    test(sdk): add unit tests for filesync.StepUpload (#4652)

    * add unit tests for filesync.StepUpload

commit 4e667d0
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Tue Dec 20 15:02:09 2022 -0800

    fix(artifacts): correctly handle url-encoded local file references. (#4665)

    * Add test case for path names needing correct urldecoding

    * Use local_fil_uri_to_path instead of urlparse

    * Fix existing tests that used relative path uris instead of absolute paths
bcsherma added a commit that referenced this pull request Dec 29, 2022
commit d244d07
Author: Katia Patkin <87335417+kptkin@users.noreply.github.com>
Date:   Tue Dec 27 13:31:20 2022 -0800

    style(public-api): format public file with proper formating (#4697)

    fix format

commit 3dc8584
Author: Janosh Riebesell <janosh.riebesell@gmail.com>
Date:   Tue Dec 27 10:21:41 2022 -0800

    feat(sdk): add `exist_ok=False` to `file.download()` (#4564)

    * add exist_ok=False to file.download() to avoid raising ValueError if file exists but you don't want to redownload

    also add type annotations

    * handle case file exists and exist_ok==True in File.download()

    * point out exist_ok=True option in file already exists error

    * tweak if/else paths

    Co-authored-by: Katia Patkin <87335417+kptkin@users.noreply.github.com>

commit 4a4651e
Author: Vish Rajiv <8609620+vwrj@users.noreply.github.com>
Date:   Fri Dec 23 14:27:16 2022 -0800

    fix(artifacts): artifact.version should be the version index from the associated collection (#4486)

    fix(artifacts): artifact.version should be the version index from the associated collection

    Co-authored-by: Hugh Wimberly <hugh.wimberly@wandb.com>
    Co-authored-by: Dmitry Duev <dmitryduev@users.noreply.github.com>

commit a7de372
Author: Noah Luna <15202580+ngrayluna@users.noreply.github.com>
Date:   Fri Dec 23 14:19:14 2022 -0800

    docs(sdk): Removed less than, greater than characters from dosctrings… (#4687)

    docs(sdk): Removed less than, greater than characters from dosctrings. Re: It breaks the new doc engine Docusuarus.

commit a45629d
Author: Noah Luna <15202580+ngrayluna@users.noreply.github.com>
Date:   Fri Dec 23 14:18:00 2022 -0800

    docs(sdk): Fixed typo in docstring for data_types.Objects3D (#4543)

    Fixed typo in docstring for data_types.Objects3D

commit 6df4b88
Author: Dmitry Duev <dmitryduev@users.noreply.github.com>
Date:   Fri Dec 23 13:16:16 2022 -0800

    test(integrations): fix import tests (#4690)

    test(integrations): fix import tests

commit 8da62bb
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Fri Dec 23 11:46:00 2022 -0800

    refactor(artifacts): consolidate hash utilities into lib.hashutil (#4525)

    * Move all MD5 and base64 encode utilities to lib.hashutil

    * Remove duplicate function definitions

    * Refactor common code out into small functions

    * Use hypothesis to for testing

    * Remove unused code

    * Update type annotations for hash types

commit eb70114
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Thu Dec 22 09:44:23 2022 -0800

    test(artifacts): improve storage handler test coverage (#4674)

    * Add test case for adding a file to a finalized artifact

    * Add test case for caching local file references

    * Add GCS and WBArtifact storage handler tests

commit 7106d17
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Wed Dec 21 19:36:31 2022 -0800

    fix(artifacts): get digest directly instead of from the manifests' manifest (#4681)

    Reference digest directly instead of though the manifests' manifest

commit 0a21fd1
Author: KyleGoyette <kdgoyette@gmail.com>
Date:   Wed Dec 21 14:37:03 2022 -0800

    feat(launch): Default to using model-registry project for agent and launch_add (#4613)

commit 84be24c
Author: Griffin Tarpenning <griffin.tarpenning@wandb.com>
Date:   Wed Dec 21 13:20:02 2022 -0800

    chore(launch): remove fallback resource when not specified for a queue (#4637)

commit cf7df1d
Author: speezepearson <speezepearson@users.noreply.github.com>
Date:   Tue Dec 20 17:10:13 2022 -0800

    test(sdk): add tests for Api.upload_file_retry (#4639)

commit c1ad0c0
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Tue Dec 20 16:08:37 2022 -0800

    refactor(artifacts): use ArtifactEntry directly instead of subclassing (#4649)

    * Subsume ArtifactEntry into ArtifactManifestEntry

commit 491fc59
Author: speezepearson <speezepearson@users.noreply.github.com>
Date:   Tue Dec 20 15:26:54 2022 -0800

    test(sdk): add unit tests for filesync.StepUpload (#4652)

    * add unit tests for filesync.StepUpload

commit 4e667d0
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Tue Dec 20 15:02:09 2022 -0800

    fix(artifacts): correctly handle url-encoded local file references. (#4665)

    * Add test case for path names needing correct urldecoding

    * Use local_fil_uri_to_path instead of urlparse

    * Fix existing tests that used relative path uris instead of absolute paths
@kptkin kptkin added this to the sdk-2023-01.1 milestone Jan 5, 2023
bcsherma added a commit that referenced this pull request Jan 21, 2023
commit d244d07
Author: Katia Patkin <87335417+kptkin@users.noreply.github.com>
Date:   Tue Dec 27 13:31:20 2022 -0800

    style(public-api): format public file with proper formating (#4697)

    fix format

commit 3dc8584
Author: Janosh Riebesell <janosh.riebesell@gmail.com>
Date:   Tue Dec 27 10:21:41 2022 -0800

    feat(sdk): add `exist_ok=False` to `file.download()` (#4564)

    * add exist_ok=False to file.download() to avoid raising ValueError if file exists but you don't want to redownload

    also add type annotations

    * handle case file exists and exist_ok==True in File.download()

    * point out exist_ok=True option in file already exists error

    * tweak if/else paths

    Co-authored-by: Katia Patkin <87335417+kptkin@users.noreply.github.com>

commit 4a4651e
Author: Vish Rajiv <8609620+vwrj@users.noreply.github.com>
Date:   Fri Dec 23 14:27:16 2022 -0800

    fix(artifacts): artifact.version should be the version index from the associated collection (#4486)

    fix(artifacts): artifact.version should be the version index from the associated collection

    Co-authored-by: Hugh Wimberly <hugh.wimberly@wandb.com>
    Co-authored-by: Dmitry Duev <dmitryduev@users.noreply.github.com>

commit a7de372
Author: Noah Luna <15202580+ngrayluna@users.noreply.github.com>
Date:   Fri Dec 23 14:19:14 2022 -0800

    docs(sdk): Removed less than, greater than characters from dosctrings… (#4687)

    docs(sdk): Removed less than, greater than characters from dosctrings. Re: It breaks the new doc engine Docusuarus.

commit a45629d
Author: Noah Luna <15202580+ngrayluna@users.noreply.github.com>
Date:   Fri Dec 23 14:18:00 2022 -0800

    docs(sdk): Fixed typo in docstring for data_types.Objects3D (#4543)

    Fixed typo in docstring for data_types.Objects3D

commit 6df4b88
Author: Dmitry Duev <dmitryduev@users.noreply.github.com>
Date:   Fri Dec 23 13:16:16 2022 -0800

    test(integrations): fix import tests (#4690)

    test(integrations): fix import tests

commit 8da62bb
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Fri Dec 23 11:46:00 2022 -0800

    refactor(artifacts): consolidate hash utilities into lib.hashutil (#4525)

    * Move all MD5 and base64 encode utilities to lib.hashutil

    * Remove duplicate function definitions

    * Refactor common code out into small functions

    * Use hypothesis to for testing

    * Remove unused code

    * Update type annotations for hash types

commit eb70114
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Thu Dec 22 09:44:23 2022 -0800

    test(artifacts): improve storage handler test coverage (#4674)

    * Add test case for adding a file to a finalized artifact

    * Add test case for caching local file references

    * Add GCS and WBArtifact storage handler tests

commit 7106d17
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Wed Dec 21 19:36:31 2022 -0800

    fix(artifacts): get digest directly instead of from the manifests' manifest (#4681)

    Reference digest directly instead of though the manifests' manifest

commit 0a21fd1
Author: KyleGoyette <kdgoyette@gmail.com>
Date:   Wed Dec 21 14:37:03 2022 -0800

    feat(launch): Default to using model-registry project for agent and launch_add (#4613)

commit 84be24c
Author: Griffin Tarpenning <griffin.tarpenning@wandb.com>
Date:   Wed Dec 21 13:20:02 2022 -0800

    chore(launch): remove fallback resource when not specified for a queue (#4637)

commit cf7df1d
Author: speezepearson <speezepearson@users.noreply.github.com>
Date:   Tue Dec 20 17:10:13 2022 -0800

    test(sdk): add tests for Api.upload_file_retry (#4639)

commit c1ad0c0
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Tue Dec 20 16:08:37 2022 -0800

    refactor(artifacts): use ArtifactEntry directly instead of subclassing (#4649)

    * Subsume ArtifactEntry into ArtifactManifestEntry

commit 491fc59
Author: speezepearson <speezepearson@users.noreply.github.com>
Date:   Tue Dec 20 15:26:54 2022 -0800

    test(sdk): add unit tests for filesync.StepUpload (#4652)

    * add unit tests for filesync.StepUpload

commit 4e667d0
Author: Hugh Wimberly <hugh.wimberly@wandb.com>
Date:   Tue Dec 20 15:02:09 2022 -0800

    fix(artifacts): correctly handle url-encoded local file references. (#4665)

    * Add test case for path names needing correct urldecoding

    * Use local_fil_uri_to_path instead of urlparse

    * Fix existing tests that used relative path uris instead of absolute paths
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants