Error: Connection pool is full

[bluecanarybe]

My progress is stuck halfway (6847/12966), receiving following debug output:

WARNING:urllib3.connectionpool:Connection pool is full, discarding connection: ec2.us-east-1.amazonaws.com

[bitsandsalsa]

This is a warning about efficiency and shouldn't be stalling progress. See boto/botocore#766. However, it is likely an indication of a bug elsewhere around resource contention.

[aleon1220]

all of the threads in botocore point to
botocore.client.Config(max_pool_connections=X)

check
boto/botocore#1026 (comment)

[aleon1220]

a PR is open to address this.
refer to https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html

• add to max_pool_connections config.py
• set the config in the invoker.py
  max_pool_connections=config.CLIENT_MAX_POOL_CONNECTIONS

[bitsandsalsa]

Fixed by #30