Skip to content

gen_protos doesn't retry after failure #20387

@damccorm

Description

@damccorm

[~chadrik]

While running using an outdated version of the protobuf package, I got this error:


$ python setup.py sdist
...
Traceback (most recent call last):
  File "setup.py", line 339, in <module>

   'mypy': generate_protos_first(mypy),
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/envs/beam-py3.6.9/lib/python3.6/site-packages/setuptools/__init__.py",
line 145, in setup
    return distutils.core.setup(**attrs)
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/lib/python3.6/distutils/core.py",
line 148, in setup
    dist.run_commands()
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/lib/python3.6/distutils/dist.py",
line 955, in run_commands
    self.run_command(cmd)
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/lib/python3.6/distutils/dist.py",
line 974, in run_command
    cmd_obj.run()
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/envs/beam-py3.6.9/lib/python3.6/site-packages/setuptools/command/sdist.py",
line 44, in run
    self.run_command('egg_info')
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/lib/python3.6/distutils/cmd.py",
line 313, in run_command
    self.distribution.run_command(command)
  File "/usr/local/google/home/ehudm/.pyenv/versions/3.6.9/lib/python3.6/distutils/dist.py",
line 974, in run_command
    cmd_obj.run()
  File "setup.py", line 253, in run
    gen_protos.generate_proto_files()

 File "/usr/local/google/home/ehudm/src/beam/sdks/python/gen_protos.py", line 345, in generate_proto_files

   generate_urn_files(log, out_dir)
  File "/usr/local/google/home/ehudm/src/beam/sdks/python/gen_protos.py",
line 188, in generate_urn_files
    beam_runner_api_pb2 = _import('beam_runner_api_pb2')
  File "/usr/local/google/home/ehudm/src/beam/sdks/python/gen_protos.py",
line 185, in _import
    return __import__('api.%s' % m, fromlist=[None])
  File "/usr/local/google/home/ehudm/src/beam/sdks/python/apache_beam/portability/api/beam_runner_api_pb2.py",
line 15, in <module>
    from . import endpoints_pb2 as endpoints__pb2
  File "/usr/local/google/home/ehudm/src/beam/sdks/python/apache_beam/portability/api/endpoints_pb2.py",
line 21, in <module>
    create_key=_descriptor._internal_create_key,
AttributeError: module 'google.protobuf.descriptor'
has no attribute '_internal_create_key'

Rerunning sdist was successful, but the generated files were missing things like TRUNCATE_SIZED_RESTRICTION.

Issue for protobuf version: https://issues.apache.org/jira/browse/BEAM-10552

Imported from Jira BEAM-10553. Original Jira may contain additional context.
Reported by: udim.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions