Synthesis failed for python-bigquery-storage #105

yoshi-automation · 2020-12-12T13:53:15Z

Hello! Autosynth couldn't regenerate python-bigquery-storage. 💔

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-12 05:53:07,705 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-12 05:53:07,724 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-12 05:53:07,726 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-12 05:53:07,727 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-12 05:53:07,729 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-12 05:53:07,730 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-12 05:53:07,732 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-12 05:53:07,733 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-12 05:53:07,735 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-12 05:53:07,735 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-12 05:53:07,737 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-12 05:53:07,738 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-12 05:53:07,739 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-12 05:53:07,740 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-12 05:53:07,741 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-12 05:53:07,741 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-12 05:53:07,742 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-12 05:53:13,447 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-12 05:53:13,499 autosynth [ERROR] > Synthesis failed
2020-12-12 05:53:13,499 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-12 05:53:13,510 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-12 05:53:13,518 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

The text was updated successfully, but these errors were encountered:

yoshi-automation · 2020-12-13T13:28:37Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-13 05:28:31,776 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-13 05:28:31,792 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-13 05:28:31,794 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-13 05:28:31,795 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-13 05:28:31,796 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-13 05:28:31,797 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-13 05:28:31,798 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-13 05:28:31,799 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-13 05:28:31,800 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-13 05:28:31,801 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-13 05:28:31,802 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-13 05:28:31,803 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-13 05:28:31,803 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-13 05:28:31,804 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-13 05:28:31,805 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-13 05:28:31,805 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-13 05:28:31,806 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-13 05:28:36,676 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-13 05:28:36,733 autosynth [ERROR] > Synthesis failed
2020-12-13 05:28:36,733 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-13 05:28:36,744 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-13 05:28:36,750 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-14T13:30:04Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-14 05:29:58,253 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-14 05:29:58,270 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-14 05:29:58,273 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-14 05:29:58,273 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-14 05:29:58,275 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-14 05:29:58,276 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-14 05:29:58,277 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-14 05:29:58,278 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-14 05:29:58,279 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-14 05:29:58,281 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-14 05:29:58,282 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-14 05:29:58,283 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-14 05:29:58,284 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-14 05:29:58,284 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-14 05:29:58,285 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-14 05:29:58,286 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-14 05:29:58,286 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-14 05:30:03,728 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-14 05:30:03,794 autosynth [ERROR] > Synthesis failed
2020-12-14 05:30:03,794 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-14 05:30:03,807 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-14 05:30:03,815 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-15T17:17:35Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-15 09:17:27,435 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-15 09:17:27,452 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-15 09:17:27,453 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-15 09:17:27,454 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-15 09:17:27,456 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-15 09:17:27,457 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-15 09:17:27,458 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-15 09:17:27,459 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-15 09:17:27,460 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-15 09:17:27,461 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-15 09:17:27,461 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-15 09:17:27,462 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-15 09:17:27,463 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-15 09:17:27,464 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-15 09:17:27,465 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-15 09:17:27,465 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-15 09:17:27,466 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-15 09:17:32,821 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-15 09:17:32,879 autosynth [ERROR] > Synthesis failed
2020-12-15 09:17:32,879 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-15 09:17:32,890 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-15 09:17:32,896 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-16T17:25:15Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-16 09:25:06,773 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-16 09:25:06,792 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-16 09:25:06,793 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-16 09:25:06,794 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-16 09:25:06,796 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-16 09:25:06,798 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-16 09:25:06,798 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-16 09:25:06,799 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-16 09:25:06,801 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-16 09:25:06,802 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-16 09:25:06,802 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-16 09:25:06,803 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-16 09:25:06,804 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-16 09:25:06,805 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-16 09:25:06,806 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-16 09:25:06,807 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-16 09:25:06,807 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-16 09:25:12,629 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-16 09:25:12,722 autosynth [ERROR] > Synthesis failed
2020-12-16 09:25:12,723 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-16 09:25:12,735 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-16 09:25:12,743 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-17T13:31:11Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-17 05:31:04,607 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-17 05:31:04,627 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-17 05:31:04,629 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-17 05:31:04,631 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-17 05:31:04,632 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-17 05:31:04,634 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-17 05:31:04,636 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-17 05:31:04,637 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-17 05:31:04,639 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-17 05:31:04,640 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-17 05:31:04,640 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-17 05:31:04,642 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-17 05:31:04,643 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-17 05:31:04,644 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-17 05:31:04,645 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-17 05:31:04,646 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-17 05:31:04,646 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-17 05:31:10,547 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-17 05:31:10,618 autosynth [ERROR] > Synthesis failed
2020-12-17 05:31:10,618 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-17 05:31:10,630 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-17 05:31:10,638 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-18T13:30:24Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-18 05:30:18,007 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-18 05:30:18,025 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-18 05:30:18,027 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-18 05:30:18,028 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-18 05:30:18,029 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-18 05:30:18,030 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-18 05:30:18,032 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-18 05:30:18,033 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-18 05:30:18,034 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-18 05:30:18,035 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-18 05:30:18,036 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-18 05:30:18,037 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-18 05:30:18,037 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-18 05:30:18,038 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-18 05:30:18,039 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-18 05:30:18,040 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-18 05:30:18,040 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-18 05:30:23,445 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-18 05:30:23,506 autosynth [ERROR] > Synthesis failed
2020-12-18 05:30:23,506 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-18 05:30:23,517 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-18 05:30:23,524 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-19T13:29:06Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-19 05:28:59,766 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-19 05:28:59,783 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-19 05:28:59,785 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-19 05:28:59,786 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-19 05:28:59,788 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-19 05:28:59,789 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-19 05:28:59,791 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-19 05:28:59,791 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-19 05:28:59,792 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-19 05:28:59,793 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-19 05:28:59,794 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-19 05:28:59,795 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-19 05:28:59,796 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-19 05:28:59,797 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-19 05:28:59,797 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-19 05:28:59,798 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-19 05:28:59,799 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-19 05:29:05,194 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-19 05:29:05,254 autosynth [ERROR] > Synthesis failed
2020-12-19 05:29:05,255 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-19 05:29:05,266 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-19 05:29:05,272 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-20T13:28:56Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-20 05:28:50,181 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-20 05:28:50,198 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-20 05:28:50,200 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-20 05:28:50,201 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-20 05:28:50,203 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-20 05:28:50,204 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-20 05:28:50,205 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-20 05:28:50,206 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-20 05:28:50,207 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-20 05:28:50,208 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-20 05:28:50,209 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-20 05:28:50,210 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-20 05:28:50,211 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-20 05:28:50,212 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-20 05:28:50,212 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-20 05:28:50,213 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-20 05:28:50,213 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-20 05:28:55,516 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-20 05:28:55,574 autosynth [ERROR] > Synthesis failed
2020-12-20 05:28:55,574 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-20 05:28:55,585 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-20 05:28:55,591 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-21T13:34:00Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-21 05:33:53,471 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-21 05:33:53,493 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-21 05:33:53,496 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-21 05:33:53,498 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-21 05:33:53,500 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-21 05:33:53,502 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-21 05:33:53,503 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-21 05:33:53,504 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-21 05:33:53,506 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-21 05:33:53,507 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-21 05:33:53,508 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-21 05:33:53,509 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-21 05:33:53,510 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-21 05:33:53,512 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-21 05:33:53,513 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-21 05:33:53,513 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-21 05:33:53,514 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-21 05:33:59,865 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-21 05:33:59,970 autosynth [ERROR] > Synthesis failed
2020-12-21 05:33:59,970 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-21 05:33:59,982 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-21 05:33:59,989 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-22T13:32:12Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

 project 'samples/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-22 05:32:05,265 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-22 05:32:05,286 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-22 05:32:05,289 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-22 05:32:05,291 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-22 05:32:05,293 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-22 05:32:05,295 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-22 05:32:05,296 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-22 05:32:05,297 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-22 05:32:05,298 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-22 05:32:05,300 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-22 05:32:05,301 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-22 05:32:05,302 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-22 05:32:05,303 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-22 05:32:05,305 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-22 05:32:05,305 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-22 05:32:05,306 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-22 05:32:05,307 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-22 05:32:11,244 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-22 05:32:11,318 autosynth [ERROR] > Synthesis failed
2020-12-22 05:32:11,319 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at cef5d4a chore: require samples checks (#101)
2020-12-22 05:32:11,332 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-22 05:32:11,339 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-23T13:32:04Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-23 05:31:57,257 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-23 05:31:57,275 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-23 05:31:57,278 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-23 05:31:57,279 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-23 05:31:57,281 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-23 05:31:57,282 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-23 05:31:57,283 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-23 05:31:57,284 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-23 05:31:57,285 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-23 05:31:57,286 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-23 05:31:57,287 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-23 05:31:57,288 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-23 05:31:57,289 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-23 05:31:57,291 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-23 05:31:57,291 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-23 05:31:57,292 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-23 05:31:57,292 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-23 05:32:03,024 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-23 05:32:03,093 autosynth [ERROR] > Synthesis failed
2020-12-23 05:32:03,093 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-23 05:32:03,105 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-23 05:32:03,112 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-24T13:32:39Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-24 05:32:32,402 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-24 05:32:32,421 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-24 05:32:32,424 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-24 05:32:32,425 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-24 05:32:32,426 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-24 05:32:32,428 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-24 05:32:32,429 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-24 05:32:32,430 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-24 05:32:32,431 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-24 05:32:32,432 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-24 05:32:32,433 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-24 05:32:32,434 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-24 05:32:32,435 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-24 05:32:32,436 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-24 05:32:32,436 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-24 05:32:32,437 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-24 05:32:32,437 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-24 05:32:38,328 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-24 05:32:38,421 autosynth [ERROR] > Synthesis failed
2020-12-24 05:32:38,421 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-24 05:32:38,433 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-24 05:32:38,441 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-25T13:31:01Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-25 05:30:54,599 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-25 05:30:54,617 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-25 05:30:54,619 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-25 05:30:54,620 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-25 05:30:54,622 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-25 05:30:54,623 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-25 05:30:54,624 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-25 05:30:54,625 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-25 05:30:54,626 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-25 05:30:54,627 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-25 05:30:54,627 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-25 05:30:54,628 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-25 05:30:54,629 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-25 05:30:54,631 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-25 05:30:54,631 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-25 05:30:54,632 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-25 05:30:54,633 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-25 05:31:00,147 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-25 05:31:00,195 autosynth [ERROR] > Synthesis failed
2020-12-25 05:31:00,195 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-25 05:31:00,206 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-25 05:31:00,212 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-26T13:30:34Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-26 05:30:28,448 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-26 05:30:28,465 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-26 05:30:28,467 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-26 05:30:28,468 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-26 05:30:28,469 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-26 05:30:28,471 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-26 05:30:28,472 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-26 05:30:28,473 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-26 05:30:28,474 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-26 05:30:28,475 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-26 05:30:28,476 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-26 05:30:28,477 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-26 05:30:28,477 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-26 05:30:28,478 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-26 05:30:28,479 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-26 05:30:28,479 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-26 05:30:28,480 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-26 05:30:33,837 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-26 05:30:33,901 autosynth [ERROR] > Synthesis failed
2020-12-26 05:30:33,901 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-26 05:30:33,912 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-26 05:30:33,919 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-27T13:30:34Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-27 05:30:27,766 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-27 05:30:27,783 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-27 05:30:27,785 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-27 05:30:27,786 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-27 05:30:27,788 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-27 05:30:27,789 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-27 05:30:27,790 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-27 05:30:27,791 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-27 05:30:27,792 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-27 05:30:27,793 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-27 05:30:27,794 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-27 05:30:27,795 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-27 05:30:27,796 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-27 05:30:27,797 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-27 05:30:27,797 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-27 05:30:27,798 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-27 05:30:27,799 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-27 05:30:33,316 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-27 05:30:33,379 autosynth [ERROR] > Synthesis failed
2020-12-27 05:30:33,379 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-27 05:30:33,390 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-27 05:30:33,396 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-28T13:31:38Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-28 05:31:31,491 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-28 05:31:31,511 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-28 05:31:31,513 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-28 05:31:31,514 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-28 05:31:31,516 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-28 05:31:31,517 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-28 05:31:31,519 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-28 05:31:31,520 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-28 05:31:31,522 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-28 05:31:31,523 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-28 05:31:31,524 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-28 05:31:31,525 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-28 05:31:31,526 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-28 05:31:31,527 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-28 05:31:31,528 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-28 05:31:31,529 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-28 05:31:31,529 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-28 05:31:37,266 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-28 05:31:37,336 autosynth [ERROR] > Synthesis failed
2020-12-28 05:31:37,336 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-28 05:31:37,347 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-28 05:31:37,355 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-29T14:13:38Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-29 06:13:32,631 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-29 06:13:32,646 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-29 06:13:32,647 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-29 06:13:32,648 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-29 06:13:32,650 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-29 06:13:32,651 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-29 06:13:32,652 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-29 06:13:32,652 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-29 06:13:32,654 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-29 06:13:32,654 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-29 06:13:32,655 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-29 06:13:32,656 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-29 06:13:32,657 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-29 06:13:32,658 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-29 06:13:32,658 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-29 06:13:32,658 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-29 06:13:32,659 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-29 06:13:37,316 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-29 06:13:37,376 autosynth [ERROR] > Synthesis failed
2020-12-29 06:13:37,377 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-29 06:13:37,386 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-29 06:13:37,392 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-30T13:43:49Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-30 05:43:44,123 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-30 05:43:44,140 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-30 05:43:44,142 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-30 05:43:44,142 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-30 05:43:44,144 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-30 05:43:44,145 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-30 05:43:44,146 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-30 05:43:44,147 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-30 05:43:44,148 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-30 05:43:44,149 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-30 05:43:44,149 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-30 05:43:44,150 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-30 05:43:44,151 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-30 05:43:44,152 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-30 05:43:44,153 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-30 05:43:44,153 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-30 05:43:44,153 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-30 05:43:48,983 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-30 05:43:49,027 autosynth [ERROR] > Synthesis failed
2020-12-30 05:43:49,027 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-30 05:43:49,037 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-30 05:43:49,044 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2020-12-31T13:28:51Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

s/quickstart'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-31 05:28:45,668 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2020-12-31 05:28:45,683 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2020-12-31 05:28:45,685 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2020-12-31 05:28:45,686 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2020-12-31 05:28:45,687 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2020-12-31 05:28:45,688 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2020-12-31 05:28:45,689 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-31 05:28:45,690 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2020-12-31 05:28:45,691 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2020-12-31 05:28:45,692 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2020-12-31 05:28:45,693 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2020-12-31 05:28:45,694 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-31 05:28:45,694 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2020-12-31 05:28:45,695 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2020-12-31 05:28:45,696 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2020-12-31 05:28:45,696 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2020-12-31 05:28:45,697 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2020-12-31 05:28:50,411 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2020-12-31 05:28:50,467 autosynth [ERROR] > Synthesis failed
2020-12-31 05:28:50,467 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2020-12-31 05:28:50,478 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2020-12-31 05:28:50,483 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-01T13:28:57Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

rt'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-01 05:28:50,962 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-01 05:28:50,983 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-01 05:28:50,986 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-01 05:28:50,987 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-01 05:28:50,989 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-01 05:28:50,991 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-01 05:28:50,993 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-01 05:28:50,994 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-01 05:28:50,995 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-01 05:28:50,997 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-01 05:28:50,999 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-01 05:28:51,002 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-01 05:28:51,003 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-01 05:28:51,005 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-01 05:28:51,006 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-01 05:28:51,006 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-01 05:28:51,007 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-01 05:28:56,604 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-01 05:28:56,664 autosynth [ERROR] > Synthesis failed
2021-01-01 05:28:56,664 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2021-01-01 05:28:56,675 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-01 05:28:56,682 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-02T13:27:30Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

rt'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-02 05:27:24,136 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-02 05:27:24,155 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-02 05:27:24,157 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-02 05:27:24,158 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-02 05:27:24,160 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-02 05:27:24,161 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-02 05:27:24,162 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-02 05:27:24,163 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-02 05:27:24,164 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-02 05:27:24,165 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-02 05:27:24,165 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-02 05:27:24,166 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-02 05:27:24,168 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-02 05:27:24,171 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-02 05:27:24,172 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-02 05:27:24,172 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-02 05:27:24,173 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-02 05:27:29,857 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-02 05:27:29,931 autosynth [ERROR] > Synthesis failed
2021-01-02 05:27:29,931 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2021-01-02 05:27:29,943 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-02 05:27:29,950 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-03T13:29:21Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

rt'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-03 05:29:14,975 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-03 05:29:14,993 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-03 05:29:14,995 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-03 05:29:14,996 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-03 05:29:14,998 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-03 05:29:14,999 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-03 05:29:15,000 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-03 05:29:15,001 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-03 05:29:15,002 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-03 05:29:15,003 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-03 05:29:15,004 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-03 05:29:15,005 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-03 05:29:15,006 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-03 05:29:15,008 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-03 05:29:15,008 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-03 05:29:15,009 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-03 05:29:15,009 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-03 05:29:20,568 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-03 05:29:20,621 autosynth [ERROR] > Synthesis failed
2021-01-03 05:29:20,621 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2021-01-03 05:29:20,632 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-03 05:29:20,639 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-04T13:32:07Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

rt'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-04 05:32:00,077 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-04 05:32:00,099 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-04 05:32:00,102 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-04 05:32:00,103 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-04 05:32:00,105 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-04 05:32:00,107 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-04 05:32:00,109 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-04 05:32:00,110 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-04 05:32:00,112 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-04 05:32:00,113 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-04 05:32:00,114 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-04 05:32:00,115 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-04 05:32:00,116 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-04 05:32:00,118 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-04 05:32:00,119 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-04 05:32:00,119 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-04 05:32:00,120 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-04 05:32:06,058 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-04 05:32:06,137 autosynth [ERROR] > Synthesis failed
2021-01-04 05:32:06,137 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2021-01-04 05:32:06,149 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-04 05:32:06,156 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-05T13:29:59Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

rt'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-05 05:29:53,026 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-05 05:29:53,046 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-05 05:29:53,049 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-05 05:29:53,050 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-05 05:29:53,051 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-05 05:29:53,053 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-05 05:29:53,054 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-05 05:29:53,055 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-05 05:29:53,056 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-05 05:29:53,058 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-05 05:29:53,058 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-05 05:29:53,059 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-05 05:29:53,060 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-05 05:29:53,061 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-05 05:29:53,062 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-05 05:29:53,063 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-05 05:29:53,063 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 338)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-05 05:29:58,799 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-05 05:29:58,873 autosynth [ERROR] > Synthesis failed
2021-01-05 05:29:58,873 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 3218893 test: add system test SQL to run tests locally (#74)
2021-01-05 05:29:58,885 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-05 05:29:58,892 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-06T13:52:59Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

pl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-06 05:52:52,964 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-06 05:52:52,986 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-06 05:52:52,988 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-06 05:52:52,989 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-06 05:52:52,990 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-06 05:52:52,992 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-06 05:52:52,993 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-06 05:52:52,994 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-06 05:52:52,995 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-06 05:52:52,996 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-06 05:52:52,997 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-06 05:52:52,998 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-06 05:52:52,998 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-06 05:52:53,000 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-06 05:52:53,000 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-06 05:52:53,001 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-06 05:52:53,001 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-06 05:52:58,661 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-06 05:52:58,736 autosynth [ERROR] > Synthesis failed
2021-01-06 05:52:58,736 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 89ba292 fix: skip some system tests for mtls testing (#106)
2021-01-06 05:52:58,747 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-06 05:52:58,755 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-07T13:36:36Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

pl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-07 05:36:30,320 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-07 05:36:30,340 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-07 05:36:30,342 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-07 05:36:30,343 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-07 05:36:30,344 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-07 05:36:30,346 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-07 05:36:30,347 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-07 05:36:30,348 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-07 05:36:30,349 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-07 05:36:30,350 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-07 05:36:30,351 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-07 05:36:30,352 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-07 05:36:30,353 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-07 05:36:30,354 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-07 05:36:30,355 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-07 05:36:30,355 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-07 05:36:30,356 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-07 05:36:35,886 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-07 05:36:35,953 autosynth [ERROR] > Synthesis failed
2021-01-07 05:36:35,953 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at d20d041 chore: add constraints file (#107)
2021-01-07 05:36:35,964 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-07 05:36:35,971 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing bigquery-storage-v1-py.tar.gz
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-08T13:59:03Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

pl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-08 05:58:57,319 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-08 05:58:57,337 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-08 05:58:57,339 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-08 05:58:57,340 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-08 05:58:57,342 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-08 05:58:57,343 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-08 05:58:57,344 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-08 05:58:57,345 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-08 05:58:57,346 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-08 05:58:57,347 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-08 05:58:57,348 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-08 05:58:57,349 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-08 05:58:57,350 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-08 05:58:57,351 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-08 05:58:57,351 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-08 05:58:57,352 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-08 05:58:57,352 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-08 05:59:02,617 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-08 05:59:02,677 autosynth [ERROR] > Synthesis failed
2021-01-08 05:59:02,677 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at d20d041 chore: add constraints file (#107)
2021-01-08 05:59:02,688 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-08 05:59:02,694 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing bigquery-storage-v1-py.tar.gz
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-09T13:34:51Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

y.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-09 05:34:45,407 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-09 05:34:45,424 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-09 05:34:45,426 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-09 05:34:45,427 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-09 05:34:45,429 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-09 05:34:45,430 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-09 05:34:45,431 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-09 05:34:45,432 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-09 05:34:45,433 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-09 05:34:45,434 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-09 05:34:45,435 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-09 05:34:45,436 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-09 05:34:45,437 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-09 05:34:45,438 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-09 05:34:45,438 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-09 05:34:45,438 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-09 05:34:45,439 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-09 05:34:50,944 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-09 05:34:51,003 autosynth [ERROR] > Synthesis failed
2021-01-09 05:34:51,003 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 4842e99 chore(deps): update dependency google-cloud-bigquery to v2.6.1 (#109)
2021-01-09 05:34:51,015 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-09 05:34:51,022 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-10T13:30:26Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

y.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-10 05:30:20,131 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-10 05:30:20,150 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-10 05:30:20,153 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-10 05:30:20,153 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-10 05:30:20,155 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-10 05:30:20,156 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-10 05:30:20,157 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-10 05:30:20,158 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-10 05:30:20,159 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-10 05:30:20,160 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-10 05:30:20,161 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-10 05:30:20,162 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-10 05:30:20,163 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-10 05:30:20,164 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-10 05:30:20,164 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-10 05:30:20,165 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-10 05:30:20,165 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-10 05:30:25,793 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-10 05:30:25,868 autosynth [ERROR] > Synthesis failed
2021-01-10 05:30:25,869 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 4842e99 chore(deps): update dependency google-cloud-bigquery to v2.6.1 (#109)
2021-01-10 05:30:25,881 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-10 05:30:25,888 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-11T13:29:00Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

y.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-11 05:28:54,252 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-11 05:28:54,270 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-11 05:28:54,272 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-11 05:28:54,273 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-11 05:28:54,274 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-11 05:28:54,276 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-11 05:28:54,277 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-11 05:28:54,278 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-11 05:28:54,279 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-11 05:28:54,280 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-11 05:28:54,281 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-11 05:28:54,281 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-11 05:28:54,282 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-11 05:28:54,283 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-11 05:28:54,284 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-11 05:28:54,284 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-11 05:28:54,285 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 21 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-11 05:28:59,732 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-11 05:28:59,795 autosynth [ERROR] > Synthesis failed
2021-01-11 05:28:59,795 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 4842e99 chore(deps): update dependency google-cloud-bigquery to v2.6.1 (#109)
2021-01-11 05:28:59,806 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-11 05:28:59,812 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation · 2021-01-12T13:35:49Z

Autosynth is still having trouble generating python-bigquery-storage. 😭

Here's the output from running synth.py:

g: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-12 05:35:42,924 synthtool [INFO] > Generating templates for samples project 'samples/to_dataframe'
Skipping: README.md
Skipping: README.rst
auth.tmpl.rst
auth_api_key.tmpl.rst
install_deps.tmpl.rst
install_portaudio.tmpl.rst
noxfile.py.j2
2021-01-12 05:35:42,942 synthtool [INFO] > Replaced 'session\\.install\\("--pre", "grpcio"\\)' in noxfile.py.
2021-01-12 05:35:42,944 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py.
2021-01-12 05:35:42,945 synthtool [INFO] > Replaced 'type\\(self\\).create_channel\\(\\s*host,\\s*credentials=credentials,\\s*credentials_file=credentials_file,\\s*ssl_credentials=ssl_[a-z_]*credentials,\\s*scopes=scopes or self.AUTH_SCOPES,\\s*quota_project_id=quota_project_id' in google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py.
2021-01-12 05:35:42,946 synthtool [INFO] > Replaced 'grpc_create_channel\\.assert_called_once_with\\([^()]+scopes=\\([^()]+\\),\\s*ssl_credentials=[a-z_]+,\\s*quota_project_id=None' in tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py.
2021-01-12 05:35:42,948 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.client import' in google/cloud/bigquery_storage/__init__.py.
2021-01-12 05:35:42,949 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.services.big_query_read.async_client import BigQueryReadAsyncClient\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-12 05:35:42,950 synthtool [INFO] > Replaced '["\']BigQueryReadAsyncClient["\'],\\n' in google/cloud/bigquery_storage/__init__.py.
2021-01-12 05:35:42,951 synthtool [INFO] > Replaced 'from google\\.cloud\\.bigquery_storage_v1\\.types\\.arrow import ArrowRecordBatch' in google/cloud/bigquery_storage/__init__.py.
2021-01-12 05:35:42,952 synthtool [INFO] > Replaced '["\']ArrowRecordBatch["\']' in google/cloud/bigquery_storage/__init__.py.
2021-01-12 05:35:42,953 synthtool [INFO] > Replaced 'import types' in google/cloud/bigquery_storage/__init__.py.
2021-01-12 05:35:42,954 synthtool [INFO] > Replaced 'from \\.stream import \\(' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-12 05:35:42,954 synthtool [INFO] > Replaced '["\']ReadSession["\']' in google/cloud/bigquery_storage_v1/types/__init__.py.
2021-01-12 05:35:42,955 synthtool [INFO] > Replaced '\\)\\s*session\\.install\\("-e", "\\."\\)\\n' in noxfile.py.
2021-01-12 05:35:42,956 synthtool [WARNING] > No replacements made in noxfile.py for pattern "--cov=google\.cloud\.bigquerystorage", maybe replacement is no longer needed?
2021-01-12 05:35:42,956 synthtool [WARNING] > No replacements made in noxfile.py for pattern --cov=tests\.unit, maybe replacement is no longer needed?
2021-01-12 05:35:42,957 synthtool [INFO] > Replaced '[\'"]sphinx[\'"]' in noxfile.py.
nox > Running session blacken
nox > Creating virtual environment (virtualenv) using python3.6 in .nox/blacken
nox > python -m pip install black==19.10b0
nox > black docs google tests noxfile.py setup.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/docs/conf.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/base.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 48)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/async_client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/__init__.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/arrow.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/avro.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/transports/grpc_asyncio.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 51)
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/stream.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/types/storage.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/google/cloud/bigquery_storage_v1/services/big_query_read/client.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/quickstart/noxfile.py
reformatted /home/kbuilder/.cache/synthtool/python-bigquery-storage/samples/to_dataframe/noxfile.py
error: cannot format /home/kbuilder/.cache/synthtool/python-bigquery-storage/tests/unit/gapic/bigquery_storage_v1/test_big_query_read.py: cannot use --safe with this file; failed to parse source file.  AST error message: invalid syntax (<unknown>, line 357)
Oh no! 💥 💔 💥
15 files reformatted, 24 files left unchanged, 3 files failed to reformat.
nox > Command black docs google tests noxfile.py setup.py failed with exit code 123
nox > Session blacken failed.
2021-01-12 05:35:48,579 synthtool [ERROR] > Failed executing nox -s blacken:

None
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "<frozen importlib._bootstrap_external>", line 678, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/kbuilder/.cache/synthtool/python-bigquery-storage/synth.py", line 225, in <module>
    s.shell.run(["nox", "-s", "blacken"], hide_output=False)
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 39, in run
    raise exc
  File "/tmpfs/src/github/synthtool/synthtool/shell.py", line 33, in run
    encoding="utf-8",
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['nox', '-s', 'blacken']' returned non-zero exit status 1.
2021-01-12 05:35:48,644 autosynth [ERROR] > Synthesis failed
2021-01-12 05:35:48,644 autosynth [DEBUG] > Running: git reset --hard HEAD
HEAD is now at 936e0a5 test: test on Python 3.9 (#99)
2021-01-12 05:35:48,655 autosynth [DEBUG] > Running: git checkout autosynth
Switched to branch 'autosynth'
2021-01-12 05:35:48,661 autosynth [DEBUG] > Running: git clean -fdx
Removing .nox/
Removing .pre-commit-config.yaml
Removing __pycache__/
Removing docs/bigquery_storage_v1/big_query_read.rst
Removing google/__pycache__/
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 354, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 189, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 334, in _inner_main
    commit_count = synthesize_loop(x, multiple_prs, change_pusher, synthesizer)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 65, in synthesize_loop
    has_changes = toolbox.synthesize_version_in_new_branch(synthesizer, youngest)
  File "/tmpfs/src/github/synthtool/autosynth/synth_toolbox.py", line 259, in synthesize_version_in_new_branch
    synthesizer.synthesize(synth_log_path, self.environ)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 120, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'synth.metadata', 'synth.py', '--']' returned non-zero exit status 1.

Google internal developers can see the full log here.

yoshi-automation added autosynth failure priority: p1 Important issue which blocks shipping the next release. Will be fixed prior to next release. type: bug Error or flaw in code with unintended results or allowing sub-optimal usage patterns. labels Dec 12, 2020

product-auto-label bot added the api: bigquerystorage Issues related to the googleapis/python-bigquery-storage API. label Dec 12, 2020

yoshi-automation added the 🚨 This issue needs some love. label Dec 19, 2020

tswast self-assigned this Jan 11, 2021

tswast mentioned this issue Jan 11, 2021

chore: remove manual workaround for response size validation #112

Merged

4 tasks

tswast closed this as completed in #112 Jan 12, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Synthesis failed for python-bigquery-storage #105

Synthesis failed for python-bigquery-storage #105

yoshi-automation commented Dec 12, 2020

yoshi-automation commented Dec 13, 2020

yoshi-automation commented Dec 14, 2020

yoshi-automation commented Dec 15, 2020

yoshi-automation commented Dec 16, 2020

yoshi-automation commented Dec 17, 2020

yoshi-automation commented Dec 18, 2020

yoshi-automation commented Dec 19, 2020

yoshi-automation commented Dec 20, 2020

yoshi-automation commented Dec 21, 2020

yoshi-automation commented Dec 22, 2020

yoshi-automation commented Dec 23, 2020

yoshi-automation commented Dec 24, 2020

yoshi-automation commented Dec 25, 2020

yoshi-automation commented Dec 26, 2020

yoshi-automation commented Dec 27, 2020

yoshi-automation commented Dec 28, 2020

yoshi-automation commented Dec 29, 2020

yoshi-automation commented Dec 30, 2020

yoshi-automation commented Dec 31, 2020

yoshi-automation commented Jan 1, 2021

yoshi-automation commented Jan 2, 2021

yoshi-automation commented Jan 3, 2021

yoshi-automation commented Jan 4, 2021

yoshi-automation commented Jan 5, 2021

yoshi-automation commented Jan 6, 2021

yoshi-automation commented Jan 7, 2021

yoshi-automation commented Jan 8, 2021

yoshi-automation commented Jan 9, 2021

yoshi-automation commented Jan 10, 2021

yoshi-automation commented Jan 11, 2021

yoshi-automation commented Jan 12, 2021

Synthesis failed for python-bigquery-storage #105

Synthesis failed for python-bigquery-storage #105

Comments

yoshi-automation commented Dec 12, 2020

yoshi-automation commented Dec 13, 2020

yoshi-automation commented Dec 14, 2020

yoshi-automation commented Dec 15, 2020

yoshi-automation commented Dec 16, 2020

yoshi-automation commented Dec 17, 2020

yoshi-automation commented Dec 18, 2020

yoshi-automation commented Dec 19, 2020

yoshi-automation commented Dec 20, 2020

yoshi-automation commented Dec 21, 2020

yoshi-automation commented Dec 22, 2020

yoshi-automation commented Dec 23, 2020

yoshi-automation commented Dec 24, 2020

yoshi-automation commented Dec 25, 2020

yoshi-automation commented Dec 26, 2020

yoshi-automation commented Dec 27, 2020

yoshi-automation commented Dec 28, 2020

yoshi-automation commented Dec 29, 2020

yoshi-automation commented Dec 30, 2020

yoshi-automation commented Dec 31, 2020

yoshi-automation commented Jan 1, 2021

yoshi-automation commented Jan 2, 2021

yoshi-automation commented Jan 3, 2021

yoshi-automation commented Jan 4, 2021

yoshi-automation commented Jan 5, 2021

yoshi-automation commented Jan 6, 2021

yoshi-automation commented Jan 7, 2021

yoshi-automation commented Jan 8, 2021

yoshi-automation commented Jan 9, 2021

yoshi-automation commented Jan 10, 2021

yoshi-automation commented Jan 11, 2021

yoshi-automation commented Jan 12, 2021