migrate code from googleapis/python-batch #8453

m-strzelczyk · 2022-11-03T13:24:26Z

feat: generate v1
feat: generate v1alpha (Re-organizing some test stuff. #25)
chore: Bump gapic-generator-python version to 1.3.0 (Adds Regression Test By Mocking Input #32)
docs(samples): Adding first sample code + tests (Added README for bigquery #22)
feat: Add support for REST transport (Make the integration text runnable with your own project easily #37)
chore(deps): update all dependencies (Fixed broken travis build. #36)
chore: regenerate samples (Move sample using appengine images to this repository, add tests. #39)
chore(deps): update dependency google-cloud-batch to v0.3.0 (Export data to CSV sample #38)
chore: regenerate samples (Move sample using appengine images to this repository, add tests. #40)
chore: regenerate samples (Export data to CSV sample #42)
docs(samples): Adding sample for bucket mounting (Add 3LO Auth examples for python clients #43)
chore: regenerate samples (Added export format option #45)
docs(samples): Adding samples for template usage (Add doc strings to functions #41)
chore: regenerate samples (Add RPC verification to bigquery tests #48)
docs(samples): Adding samples for list and get tasks (Move monitoring sample in, modified for ADC. #50)
chore(deps): update dependency google-cloud-resource-manager to v1.6.2 (Move samples #49)
chore(deps): update all dependencies (Fix Images Test #51)
chore(deps): update dependency black to v22.10.0 (Move monitoring sample in, modified for ADC. #52)
docs: Refine GPU drivers installation proto description (Reword credential creation in README.md #57)
chore(deps): update all dependencies (Add storagetransfer samples #55)
chore(deps): update dependency google-cloud-batch to v0.4.0 (Change "Datstore" to "Datastore" #61)
chore(deps): update dependency pytest to v7.2.0 (Confirm that coverage is working post-gae split #62)
docs(samples): Adding code samples for log reading (modify the url link address in README.md #56)
chore(deps): update dependency google-cloud-batch to v0.4.1 (Misplaced datastore_example_test comment #64)

Description

Fixes #

Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.

Checklist

I have followed Sample Guidelines from AUTHORING_GUIDE.MD
README is updated to include all relevant information
Tests pass: nox -s py-3.9 (see Test Environment Setup)
Lint pass: nox -s lint (see Test Environment Setup)
These samples need a new API enabled in testing projects to pass (let us know which ones)
These samples need a new/updated env vars in testing projects set to pass (let us know which ones)
Please merge this PR for me once it is approved.
This sample adds a new sample directory, and I updated the CODEOWNERS file with the codeowners for this sample

- [ ] Regenerate this pull request now. PiperOrigin-RevId: 472561635 Source-Link: googleapis/googleapis@332ecf5 Source-Link: https://github.com/googleapis/googleapis-gen/commit/4313d682880fd9d7247291164d4e9d3d5bd9f177 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNDMxM2Q2ODI4ODBmZDlkNzI0NzI5MTE2NGQ0ZTlkM2Q1YmQ5ZjE3NyJ9

* docs(samples): Adding basic code samples + tests * Checking something * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * Fixing noxfile * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * Fixing noxfile with new test detection * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * Trying to understand what's wrong * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * use latest post processor image * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * Fixing the requirements * Making tests more resilent * Improving tests * Tests no longer use logging * Another fix... * Fixing lint problems * Fixing tests Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

- [ ] Regenerate this pull request now. PiperOrigin-RevId: 474571730 Source-Link: googleapis/googleapis@5a9ee4d Source-Link: https://github.com/googleapis/googleapis-gen/commit/ceafe521f137680fdee2f9ca9e1947cdd825070d Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiY2VhZmU1MjFmMTM3NjgwZmRlZTJmOWNhOWUxOTQ3Y2RkODI1MDcwZCJ9 fix(deps): require google-api-core>=1.33.1,>=2.8.0 fix(deps): require protobuf >= 3.20.1

Co-authored-by: Anthonios Partheniou <partheniou@google.com>

* chore: update gapic-generator-python to 1.4.3 with test fixes PiperOrigin-RevId: 475399737 Source-Link: googleapis/googleapis@4c4a9a2 Source-Link: https://github.com/googleapis/googleapis-gen/commit/72fdb5ae55a4d6583893a3e57b7ef264850d06cd Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNzJmZGI1YWU1NWE0ZDY1ODM4OTNhM2U1N2I3ZWYyNjQ4NTBkMDZjZCJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

Co-authored-by: Anthonios Partheniou <partheniou@google.com>

PiperOrigin-RevId: 475580307 Source-Link: googleapis/googleapis@dbc83bd Source-Link: https://github.com/googleapis/googleapis-gen/commit/26c120594d6049d40061023cae345da80181077c Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiMjZjMTIwNTk0ZDYwNDlkNDAwNjEwMjNjYWUzNDVkYTgwMTgxMDc3YyJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * feat: Add support for V1 and V2 classification models for the V1Beta2 API PiperOrigin-RevId: 475604619 Source-Link: googleapis/googleapis@044a15c Source-Link: https://github.com/googleapis/googleapis-gen/commit/410020af934c7248f7804770d6f8ec4571bfa551 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNDEwMDIwYWY5MzRjNzI0OGY3ODA0NzcwZDZmOGVjNDU3MWJmYTU1MSJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * chore: update gapic-generator-python-1.4.4 with unit tests generation fixes PiperOrigin-RevId: 475683078 Source-Link: googleapis/googleapis@df791ce Source-Link: https://github.com/googleapis/googleapis-gen/commit/ee0ce41cb9bf7bb51005e991022b00ce1bc669d8 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiZWUwY2U0MWNiOWJmN2JiNTEwMDVlOTkxMDIyYjAwY2UxYmM2NjlkOCJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

* feat: release SensitiveAction Cloud Logging payload to v1 PiperOrigin-RevId: 476083958 Source-Link: googleapis/googleapis@fafd03f Source-Link: https://github.com/googleapis/googleapis-gen/commit/79c1b9ce243374735651e72cdebcbed99f5e4e65 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNzljMWI5Y2UyNDMzNzQ3MzU2NTFlNzJjZGViY2JlZDk5ZjVlNGU2NSJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

* docs(samples): Adding sample for bucket mounting * Fixing lint stuff.

* feat: Add an enum value for raw locations from Apple platforms PiperOrigin-RevId: 476961484 Source-Link: googleapis/googleapis@695134b Source-Link: https://github.com/googleapis/googleapis-gen/commit/49457f9e7aae89cfe0491af4dbd9961a90125d32 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNDk0NTdmOWU3YWFlODljZmUwNDkxYWY0ZGJkOTk2MWE5MDEyNWQzMiJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

Preparing another code sample. This time for the [`Create a job from a Compute Engine instance template`](https://cloud.google.com/batch/docs/create-run-job#create-job-instance-template) section.

* chore(bazel): update protobuf to v3.21.7 PiperOrigin-RevId: 477955264 Source-Link: googleapis/googleapis@a724450 Source-Link: https://github.com/googleapis/googleapis-gen/commit/4abcbcaec855e74a0b22a4988cf9e0eb61a83094 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNGFiY2JjYWVjODU1ZTc0YTBiMjJhNDk4OGNmOWUwZWI2MWE4MzA5NCJ9 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

* Fixing tests * docs(samples): Adding samples for list tasks and get task Co-authored-by: Anthonios Partheniou <partheniou@google.com>

#49) Co-authored-by: Anthonios Partheniou <partheniou@google.com>

- [ ] Regenerate this pull request now. docs: Refine comments for deprecated proto fields docs: Update the API comments about the device_name PiperOrigin-RevId: 481282173 Source-Link: https://togithub.com/googleapis/googleapis/commit/e981f84f8a337561a114f8cf7d8f49b2c548228f Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/f550f5e45d7b9d5cf92be96db2de5cc2a8088c39 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiZjU1MGY1ZTQ1ZDdiOWQ1Y2Y5MmJlOTZkYjJkZTVjYzJhODA4OGMzOSJ9 feat: Enable install_gpu_drivers flag in v1 proto docs: Refine GPU drivers installation proto description docs: Refine comments for deprecated proto fields docs: Update the API comments about the device_name PiperOrigin-RevId: 481212993 Source-Link: https://togithub.com/googleapis/googleapis/commit/b037bb3b4ed91bdbdcc6e9ad9d3d641d914b93d2 Source-Link: https://togithub.com/googleapis/googleapis-gen/commit/60e247bd1082e706c42c115453214b9fb0354864 Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiNjBlMjQ3YmQxMDgyZTcwNmM0MmMxMTU0NTMyMTRiOWZiMDM1NDg2NCJ9

Co-authored-by: Anthonios Partheniou <partheniou@google.com>

* docs(samples): Adding code samples for log reading Co-authored-by: Anthonios Partheniou <partheniou@google.com>

…tion

Catching up to match synthtool noxfile template.

dandhlee

LGTM, verified compute has existing CODEOWNERS and blunderbuss. All other settings look good, one comment.

noxfile-template.py

engelke

LGTM

dandhlee · 2022-11-10T00:28:52Z

Will verify that additional tests don't run first.

noxfile-template.py

dandhlee

I just realized - any reason why this is under compute/batch? We're labeling under products and not by ownership.

dandhlee

Don't forget CODEOWNERS and blunderbuss entry for api: batch!

dandhlee

LGTM. Thank you!

parthea and others added 25 commits July 4, 2022 17:50

feat: generate v1

d13f342

feat: generate v1alpha (#25)

0bb14ce

chore(deps): update all dependencies (#36)

44c0664

Co-authored-by: Anthonios Partheniou <partheniou@google.com>

chore(deps): update dependency google-cloud-batch to v0.3.0 (#38)

cee794e

Co-authored-by: Anthonios Partheniou <partheniou@google.com>

docs(samples): Adding sample for bucket mounting (#43)

c4f3b69

* docs(samples): Adding sample for bucket mounting * Fixing lint stuff.

docs(samples): Adding samples for template usage (#41)

278d7e1

Preparing another code sample. This time for the [`Create a job from a Compute Engine instance template`](https://cloud.google.com/batch/docs/create-run-job#create-job-instance-template) section.

docs(samples): Adding samples for list and get tasks (#50)

1de1655

* Fixing tests * docs(samples): Adding samples for list tasks and get task Co-authored-by: Anthonios Partheniou <partheniou@google.com>

chore(deps): update dependency google-cloud-resource-manager to v1.6.2 (

fdfd474

#49) Co-authored-by: Anthonios Partheniou <partheniou@google.com>

chore(deps): update all dependencies (#51)

11d8441

chore(deps): update dependency black to v22.10.0 (#52)

d540ed8

chore(deps): update all dependencies (#55)

a746f82

Co-authored-by: Anthonios Partheniou <partheniou@google.com>

chore(deps): update dependency google-cloud-batch to v0.4.0 (#61)

0332217

chore(deps): update dependency pytest to v7.2.0 (#62)

88a0f4f

docs(samples): Adding code samples for log reading (#56)

f0fc663

* docs(samples): Adding code samples for log reading Co-authored-by: Anthonios Partheniou <partheniou@google.com>

chore(deps): update dependency google-cloud-batch to v0.4.1 (#64)

a099d6c

Merge remote-tracking branch 'migration/main' into python-batch-migra…

dc449cf

…tion

product-auto-label bot added the samples Issues that are directly related to samples. label Nov 3, 2022

m-strzelczyk added 3 commits November 3, 2022 14:27

Removing auto-generated files

f18db24

Removing noxfile

02d34cf

feat: Tests in subdericteries get properly detected

0fb0b71

Catching up to match synthtool noxfile template.

nicain marked this pull request as ready for review November 3, 2022 16:03

dandhlee and others added 2 commits November 5, 2022 01:57

Merge branch 'main' into python-batch-migration

7e59c94

Fixing the test

c9a9268

dandhlee reviewed Nov 7, 2022

View reviewed changes

noxfile-template.py Outdated Show resolved Hide resolved

dandhlee and others added 2 commits November 7, 2022 18:52

Merge branch 'main' into python-batch-migration

6e141a2

Merge branch 'main' into python-batch-migration

5c3311c

engelke approved these changes Nov 9, 2022

View reviewed changes

Merge branch 'main' into python-batch-migration

ec17b47

dandhlee added the do not merge Indicates a pull request not ready for merge, due to either quality or timing. label Nov 10, 2022

dandhlee requested changes Nov 14, 2022

View reviewed changes

noxfile-template.py Outdated Show resolved Hide resolved

m-strzelczyk and others added 3 commits November 14, 2022 13:50

Reverting noxfile changes and adjusting folder structure.

65fda72

Merge remote-tracking branch 'origin/main' into python-batch-migration

6302660

Merge branch 'main' into python-batch-migration

162887a

dandhlee added kokoro:run Add this label to force Kokoro to re-run the tests. snippet-bot:force-run Force snippet-bot runs its logic owlbot:run Add this label to trigger the Owlbot post processor. labels Nov 14, 2022

snippet-bot bot removed the snippet-bot:force-run Force snippet-bot runs its logic label Nov 14, 2022

gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Nov 14, 2022

kokoro-team removed the kokoro:run Add this label to force Kokoro to re-run the tests. label Nov 14, 2022

dandhlee requested changes Nov 14, 2022

View reviewed changes

m-strzelczyk requested a review from dandhlee November 15, 2022 08:05

m-strzelczyk added 2 commits November 15, 2022 09:06

Merge branch 'main' into python-batch-migration

01342c6

Moving batch to separate top level dir

a7633f2

dandhlee reviewed Nov 15, 2022

View reviewed changes

m-strzelczyk and others added 2 commits November 15, 2022 15:39

Adding batch info

abbb071

Merge branch 'main' into python-batch-migration

7be0eb5

dandhlee removed the do not merge Indicates a pull request not ready for merge, due to either quality or timing. label Nov 15, 2022

dandhlee approved these changes Nov 15, 2022

View reviewed changes

dandhlee merged commit d73bcf6 into main Nov 15, 2022

dandhlee deleted the python-batch-migration branch November 15, 2022 16:15

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

migrate code from googleapis/python-batch #8453

migrate code from googleapis/python-batch #8453

m-strzelczyk commented Nov 3, 2022

dandhlee left a comment

engelke left a comment

dandhlee commented Nov 10, 2022

dandhlee left a comment

dandhlee left a comment

dandhlee left a comment

migrate code from googleapis/python-batch #8453

migrate code from googleapis/python-batch #8453

Conversation

m-strzelczyk commented Nov 3, 2022

Description

Checklist

dandhlee left a comment

Choose a reason for hiding this comment

engelke left a comment

Choose a reason for hiding this comment

dandhlee commented Nov 10, 2022

dandhlee left a comment

Choose a reason for hiding this comment

dandhlee left a comment

Choose a reason for hiding this comment

dandhlee left a comment

Choose a reason for hiding this comment