Skip to content

Load test for dataflow caused other tests to fail due to lack of quota #19325

@kennknowles

Description

@kennknowles

On Dec 10, tests of dataflow pipelines were failing. Console logs showed lack of quota:
Workflow failed. Causes: Project apache-beam-testing has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/6987 instances, 1/0 CPUs, 250/69951 disk GB, 0/4046 SSD disk GB, 1/293 instance groups, 1/293 managed instance groups, 1/268 instance templates, 1/241 in-use IP addresses.

At the same time, the loadtestoptions-jenkins-1210161627-d0e49a84 job was running, and requested 1000 workers, and got 498 max. It ran for 1hr 21min.

Could this job be reduced in scope or limited in the number of dataflow workers?

https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-12-10_08_16_32-12840883456333022524?project=apache-beam-testing

Imported from Jira BEAM-6203. Original Jira may contain additional context.
Reported by: alanmyrvold.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions