Dataproc: adding new service features in v1, including autoscaling (via autosynth)

[yoshi-automation]

This PR was generated using Autosynth. 🌈

Here's the log from Synthtool:

synthtool > Executing /tmpfs/src/git/autosynth/working_repo/dataproc/synth.py.
synthtool > Ensuring dependencies.
synthtool > Pulling artman image.
latest: Pulling from googleapis/artman
Digest: sha256:28d4271586772b275cd3bc95cb46bd227a24d3c9048de45dccdb7f3afb0bfba9
Status: Image is up to date for googleapis/artman:latest
synthtool > Cloning googleapis.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1beta2.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/autoscaling_policies.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/autoscaling_policies.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1beta2/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1beta2/google/cloud/dataproc_v1beta2/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py.
synthtool > Running generator for google/cloud/dataproc/artman_dataproc_v1.yaml.
synthtool > Generated code into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1.
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/clusters.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/clusters.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/jobs.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/jobs.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/operations.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/operations.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/workflow_templates.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/workflow_templates.proto
synthtool > Copy: /home/kbuilder/.cache/synthtool/googleapis/google/cloud/dataproc/v1/shared.proto to /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto/shared.proto
synthtool > Placed proto files into /home/kbuilder/.cache/synthtool/googleapis/artman-genfiles/python/dataproc-v1/google/cloud/dataproc_v1/proto.
synthtool > Replaced 'metadata_type=operations_pb2.ClusterOperationMetadata,' in google/cloud/dataproc_v1/gapic/cluster_controller_client.py.
synthtool > No replacements made in google/cloud/dataproc_v1/gapic/cluster_controller_client.py for pattern \s+<strong>Note:</strong>.*
(.*
)+?.*types.FieldMask., maybe replacement is not longer needed?
synthtool > Replaced ', and must\n\\s+conform to the following PCRE regular expression:(.*\n)+?.*No more than 32' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced ', and must conform to\n\\s+the following regular expression:(.*\n)+?.* No more than' in google/cloud/dataproc_v1/proto/workflow_templates_pb2.py.
synthtool > Replaced '# Generated by the protocol buffer compiler.  DO NOT EDIT!' in google/cloud/dataproc_v1beta2/proto/clusters_pb2.py.
.coveragerc
.flake8
MANIFEST.in
noxfile.py.j2
setup.cfg
Running session blacken
Creating virtualenv using python3.6 in /tmpfs/src/git/autosynth/working_repo/dataproc/.nox/blacken
pip install black
black docs google tests noxfile.py setup.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/__init__.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/__init__.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/__init__.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/cluster_controller_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/docs/conf.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/enums.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/job_controller_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/transports/cluster_controller_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/transports/job_controller_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/transports/workflow_template_service_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/workflow_template_service_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/cluster_controller_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/job_controller_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/clusters_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/jobs_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/gapic/workflow_template_service_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/operations_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/shared_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/shared_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/operations_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/workflow_templates_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/types.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/__init__.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/autoscaling_policy_service_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/autoscaling_policy_service_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/cluster_controller_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/cluster_controller_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/enums.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/job_controller_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/job_controller_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/transports/autoscaling_policy_service_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/transports/cluster_controller_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/transports/job_controller_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/transports/workflow_template_service_grpc_transport.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/workflow_template_service_client.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/gapic/workflow_template_service_client_config.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/clusters_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/autoscaling_policies_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/workflow_templates_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/clusters_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/autoscaling_policies_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/jobs_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1/proto/jobs_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/operations_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/shared_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/shared_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/operations_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2_grpc.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/types.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/noxfile.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/system/gapic/v1/test_system_cluster_controller_v1.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/system/gapic/v1beta2/test_system_cluster_controller_v1beta2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1/test_cluster_controller_client_v1.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1/test_job_controller_client_v1.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1/test_workflow_template_service_client_v1.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1beta2/test_autoscaling_policy_service_client_v1beta2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1beta2/test_cluster_controller_client_v1beta2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1beta2/test_job_controller_client_v1beta2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/clusters_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/tests/unit/gapic/v1beta2/test_workflow_template_service_client_v1beta2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/workflow_templates_pb2.py
reformatted /tmpfs/src/git/autosynth/working_repo/dataproc/google/cloud/dataproc_v1beta2/proto/jobs_pb2.py
All done! ✨ 🍰 ✨
63 files reformatted, 7 files left unchanged.
Session blacken was successful.
synthtool > Cleaned up 2 temporary directories.
synthtool > Wrote metadata to synth.metadata.

[tseaver]

@sduskis The Github UI strikes again: your change to the PR title didn't get propagated to the commit message when you merged the PR.

[sduskis]

@tseaver, I'll be more careful in the future. Is there anything we can do at this point?

[tseaver]

@sduskis I don't think so: doing repo surgery to fix the commit message seems too risky. When we make a release of Dataproc (maybe today would be a good time?) we can fix the entry in the changelog.

[sduskis]

I'll do the release, and do the changelog entry fix.