Hi Team,
We are in the situation where we have written the pipeline in python and trying to run it on Dataflow where VMs don't have internet access. So the issue is dataflow is trying to install apache beam again even though it is specified in the docker image. This is the same problem as described in https://stackoverflow.com/questions/56193070/does-apache-beam-need-internet-to-run-gcp-dataflow-jobs and one of the solution is to copy tar to docker file and specify in pipeline.
I need to build the tar on local but there is an error of RuntimeError: Could not find protoc-gen-mypy
Can you please help me by providing the tar.gz file of the latest release. I have tried everything in my capacity to build it on local.
Would be really thankful.
Hi Team,
We are in the situation where we have written the pipeline in python and trying to run it on Dataflow where VMs don't have internet access. So the issue is dataflow is trying to install apache beam again even though it is specified in the docker image. This is the same problem as described in https://stackoverflow.com/questions/56193070/does-apache-beam-need-internet-to-run-gcp-dataflow-jobs and one of the solution is to copy tar to docker file and specify in pipeline.
I need to build the tar on local but there is an error of RuntimeError: Could not find protoc-gen-mypy
Can you please help me by providing the tar.gz file of the latest release. I have tried everything in my capacity to build it on local.
Would be really thankful.