Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

IPv4 pool is full #184

Closed
nelebadnjak opened this issue Apr 20, 2017 · 5 comments
Closed

IPv4 pool is full #184

nelebadnjak opened this issue Apr 20, 2017 · 5 comments
Labels
🏷bug

Comments

@nelebadnjak
Copy link

I'm using docksal for local developent and for CI and right now we have 29 docksal project running on one host. When I run fin up I get this error:

docksal@server:~/projects/featureb$ fin up
WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
Starting services...
Creating network "featureb273_default" with the default driver
ERROR: could not find an available, non-overlapping IPv4 address pool among the defaults to assign to the network

If I remove few projects and run fin cleanup IP pool get some space and this project starts.
Question is how I can increase IP pool for docksal?
Right now we do not need more than 15 IP adresses per project.
Output of fin config:

fin config output 

WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
---------------------
COMPOSE_PROJECT_NAME_SAFE: featurebtn273btn8
COMPOSE_FILE:
/home/docksal/.docksal/stacks/volumes-bind.yml
/home/docksal/projects/featureb/.docksal/docksal.yml
ENV_FILE:
/home/docksal/projects/featureb/.docksal/docksal.env
/home/docksal/projects/featureb/.docksal/docksal-local.env

PROJECT_ROOT: /home/docksal/projects/feature-btn-273.btn8
DOCROOT: docroot
VIRTUAL_HOST: featureb.bld.ci.somedomain.com
VIRTUAL_HOST_ALIASES: *.featureb.bld.ci.somedomain.com
IP: 192.168.64.100
MYSQL:

Docker Compose configuration
---------------------
networks: {}
services:
  cli:
    environment:
      XDEBUG_ENABLED: '0'
    hostname: cli
    image: docksal/cli:1.1-php7
    volumes:
    - host_home:/.home:ro
    - docksal_ssh_agent:/.ssh-agent:ro
    - project_root:/var/www:rw
  db:
    environment:
      MYSQL_DATABASE: default
      MYSQL_PASSWORD: user
      MYSQL_ROOT_PASSWORD: root
      MYSQL_USER: user
    hostname: db
    image: docksal/db:1.0-mysql-5.5
    ports:
    - 0:3306/tcp
    volumes:
    - project_root:/var/www:ro
  web:
    depends_on:
      cli:
        condition: service_started
    environment:
      APACHE_DOCUMENTROOT: /var/www/docroot
      VIRTUAL_HOST: featureb.bld.ci.somedomain.com
    hostname: web
    image: docksal/web:1.0-apache2.2
    labels:
      io.docksal.project-root: /home/docksal/projects/featureb
      io.docksal.virtual-host: featureb.bld.ci.somedomain.com,*.featureb.bld.ci.somedomain.com
    volumes:
    - project_root:/var/www:ro
version: '2.1'
volumes:
  docksal_ssh_agent:
    external: true
  host_home:
    driver: local
    driver_opts:
      device: /home/docksal
      o: bind
      type: none
  project_root:
    driver: local
    driver_opts:
      device: /home/docksal/projects/featureb
      o: bind
      type: none

Output of fin sysinfo:

fin sysinfo output 
███  OS & BASICS
Linux horde1.somefqdn.com 3.16.0-4-amd64 #1 SMP Debian 3.16.39-1+deb8u2 (2017-03-07) x86_64 GNU/Linux
Debian 8.7
fin version: 1.6.0
Mode:  Native / Docker for Mac/Windows
███  DOCKER
DOCKER_HOST:  

Docker: Client:
Version:      17.04.0-ce
API version:  1.28
Go version:   go1.7.5
Git commit:   4845c56
Built:        Mon Apr  3 17:45:49 2017
OS/Arch:      linux/amd64

Server:
Version:      17.04.0-ce
API version:  1.28 (minimum version 1.12)
Go version:   go1.7.5
Git commit:   4845c56
Built:        Mon Apr  3 17:45:49 2017
OS/Arch:      linux/amd64
Experimental: false
███  DOCKER COMPOSE
Docker Compose: docker-compose version 1.12.0, build b31ff33
docker-py version: 2.2.1
CPython version: 2.7.13
OpenSSL version: OpenSSL 1.0.1t  3 May 2016
WARNING: No memory limit support
WARNING: No swap limit support
WARNING: No kernel memory limit support
WARNING: No oom kill disable support
WARNING: No cpu cfs quota support
WARNING: No cpu cfs period support
███  DOCKER: IMAGES
REPOSITORY            TAG                 IMAGE ID            CREATED             SIZE
docksal/cli           1.2-php7            aef362412c9f        12 days ago         787MB
nginx                 latest              5e69fe4b3c31        3 weeks ago         183MB
busybox               latest              00f017a8c2a6        5 weeks ago         1.11MB
docksal/vhost-proxy   1.0                 2c8a8b1e62c4        6 weeks ago         164MB
docksal/cli           1.1-php7            bdac44fe25f1        6 weeks ago         777MB
docksal/dns           1.0                 20c7a535479d        2 months ago        61.6MB
docksal/ssh-agent     1.0                 148220cc033d        2 months ago        12.2MB
docksal/web           1.0-apache2.2       a9c03f8a5f0f        3 months ago        188MB
docksal/db            1.0-mysql-5.5       9fb8c0aed5fc        3 months ago        255MB
docksal/cli           1.0-php7            5bc490ae4d93        3 months ago        747MB
docksal/cli           1.0-php5            bde35eb43ad7        3 months ago        801MB
docksal/solr          1.0-solr4           fa6b236caf06        3 months ago        546MB
███  DOCKER: CONTAINERS
CONTAINER ID        IMAGE                       COMMAND                  CREATED             STATUS              PORTS                                      NAMES
65877d5c6714        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   2 hours ago         Up 2 hours          80/tcp, 443/tcp                            featurebtn201btn8_web_1
aee244a3fb25        docksal/cli:1.1-php7        "/opt/startup.sh g..."   2 hours ago         Up 2 hours          22/tcp, 9000/tcp                           featurebtn201btn8_cli_1
b21558841e40        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   2 hours ago         Up 2 hours          0.0.0.0:32802->3306/tcp                    featurebtn201btn8_db_1
fe24e7912df6        docksal/solr:1.0-solr4      "/opt/solr/bin/sol..."   2 hours ago         Up 2 hours          8983/tcp                                   featurebtn201btn8_solr_1
cd246164c0b6        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   15 hours ago        Up 15 hours         80/tcp, 443/tcp                            mastercirtav2_web_1
29ecbcae43d8        docksal/cli:1.0-php7        "/opt/startup.sh g..."   15 hours ago        Up 15 hours         22/tcp, 9000/tcp                           mastercirtav2_cli_1
3ba2529801b4        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   15 hours ago        Up 15 hours         0.0.0.0:32801->3306/tcp                    mastercirtav2_db_1
a7ca8fc63468        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            feature11847bnsv2_web_1
193780b5db7f        docksal/cli:1.2-php7        "/opt/startup.sh s..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           feature11847bnsv2_cli_1
5fd0ed3bc8ec        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32800->3306/tcp                    feature11847bnsv2_db_1
c7fe432ff3c4        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            featurebtn282btn8_web_1
694f22f76cdf        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32799->3306/tcp                    featurebtn282btn8_db_1
9e8647bfcd01        docksal/cli:1.1-php7        "/opt/startup.sh g..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           featurebtn282btn8_cli_1
2865ae59eb6e        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            feature11832cirtav2_web_1
d28687bd0945        docksal/cli:1.0-php7        "/opt/startup.sh g..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           feature11832cirtav2_cli_1
62f1577afc4c        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32798->3306/tcp                    feature11832cirtav2_db_1
bedf3258eefe        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            masterbnsv2_web_1
285696ba847b        docksal/cli:1.2-php7        "/opt/startup.sh s..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           masterbnsv2_cli_1
4fd44ecf5b1d        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32797->3306/tcp                    masterbnsv2_db_1
fb37db633bce        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            feature11860bnsv2_web_1
cd61b099afe1        docksal/cli:1.2-php7        "/opt/startup.sh s..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           feature11860bnsv2_cli_1
ebe62def5fd1        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32796->3306/tcp                    feature11860bnsv2_db_1
2924798403de        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            feature11854bnsv2_web_1
97cfe1e07abb        docksal/cli:1.2-php7        "/opt/startup.sh s..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           feature11854bnsv2_cli_1
d68b953229e0        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32795->3306/tcp                    feature11854bnsv2_db_1
056a3aadf569        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            feature11865bnsv2_web_1
009c704e6028        docksal/cli:1.2-php7        "/opt/startup.sh s..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           feature11865bnsv2_cli_1
56cdabd55c22        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32794->3306/tcp                    feature11865bnsv2_db_1
51a0a1013564        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   21 hours ago        Up 21 hours         80/tcp, 443/tcp                            developbtn8_web_1
12a47ed40606        docksal/cli:1.1-php7        "/opt/startup.sh g..."   21 hours ago        Up 21 hours         22/tcp, 9000/tcp                           developbtn8_cli_1
224d02d3a478        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   21 hours ago        Up 21 hours         0.0.0.0:32793->3306/tcp                    developbtn8_db_1
9fd295cd6f4e        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   22 hours ago        Up 22 hours         80/tcp, 443/tcp                            featurebtn251btn8_web_1
fdda47da2e8a        docksal/cli:1.1-php7        "/opt/startup.sh g..."   22 hours ago        Up 22 hours         22/tcp, 9000/tcp                           featurebtn251btn8_cli_1
f5274bd5f254        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   22 hours ago        Up 22 hours         0.0.0.0:32792->3306/tcp                    featurebtn251btn8_db_1
9f30e5b87a09        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   22 hours ago        Up 22 hours         80/tcp, 443/tcp                            featurebtn253btn8_web_1
9dd2304b09d1        docksal/cli:1.1-php7        "/opt/startup.sh g..."   22 hours ago        Up 22 hours         22/tcp, 9000/tcp                           featurebtn253btn8_cli_1
1142ae71ca53        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   22 hours ago        Up 22 hours         0.0.0.0:32790->3306/tcp                    featurebtn253btn8_db_1
e9380ce1eaf2        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   24 hours ago        Up 24 hours         80/tcp, 443/tcp                            featurebtn284btn8_web_1
fddd3d90ca68        docksal/cli:1.1-php7        "/opt/startup.sh g..."   24 hours ago        Up 24 hours         22/tcp, 9000/tcp                           featurebtn284btn8_cli_1
f2b530ba09d1        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   24 hours ago        Up 24 hours         0.0.0.0:32787->3306/tcp                    featurebtn284btn8_db_1
150567b3ad9b        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   46 hours ago        Up 46 hours         80/tcp, 443/tcp                            featurebtn252btn8_web_1
116754a891e6        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   46 hours ago        Up 46 hours         0.0.0.0:32775->3306/tcp                    featurebtn252btn8_db_1
9014c9499ba7        docksal/cli:1.1-php7        "/opt/startup.sh g..."   46 hours ago        Up 46 hours         22/tcp, 9000/tcp                           featurebtn252btn8_cli_1
384a4932f325        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   47 hours ago        Up 47 hours         80/tcp, 443/tcp                            featurebtn202btn8_web_1
1cb555756151        docksal/cli:1.1-php7        "/opt/startup.sh g..."   47 hours ago        Up 47 hours         22/tcp, 9000/tcp                           featurebtn202btn8_cli_1
de84dba68c0c        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   47 hours ago        Up 47 hours         0.0.0.0:32774->3306/tcp                    featurebtn202btn8_db_1
54f3b25c2b7b        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   47 hours ago        Up 47 hours         80/tcp, 443/tcp                            featurebtn228btn8_web_1
3af2a9cb1aba        docksal/cli:1.1-php7        "/opt/startup.sh g..."   47 hours ago        Up 47 hours         22/tcp, 9000/tcp                           featurebtn228btn8_cli_1
ea2b010f244c        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   47 hours ago        Up 47 hours         0.0.0.0:32772->3306/tcp                    featurebtn228btn8_db_1
b344c0ebed9b        docksal/db:1.0-mysql-5.5    "/entrypoint.sh my..."   2 days ago          Up 2 days           0.0.0.0:32769->3306/tcp                    featurebtn182btn8_db_1
00a632cd7ecb        docksal/ssh-agent:1.0       "/run.sh ssh-agent"      2 days ago          Up 2 days                                                      docksal-ssh-agent
46fc4a88c95c        docksal/dns:1.0             "/opt/entrypoint.s..."   2 days ago          Up 2 days           192.168.64.100:53->53/udp                  docksal-dns
97f86ece83bb        docksal/vhost-proxy:1.0     "/usr/local/bin/st..."   2 days ago          Up 2 days           0.0.0.0:80->80/tcp, 0.0.0.0:443->443/tcp   docksal-vhost-proxy
e7feacb686f5        docksal/web:1.0-apache2.2   "/opt/startup.sh a..."   2 days ago          Up 2 days           80/tcp, 443/tcp                            featurebtn182btn8_web_1
88cc463edf5d        docksal/cli:1.1-php7        "/opt/startup.sh g..."   2 days ago          Up 2 days           22/tcp, 9000/tcp                           featurebtn182btn8_cli_1
docksal@horde1:~/projects/feature-btn-273.btn8$
@achekulaev
Copy link
Member

achekulaev commented Apr 20, 2017 •
edited

Do you happen to have a line nameserver fe80:..... or something like that in your /etc/resolv.conf?

If you do have it, try commenting that line out. Looks like it may impact IPv4 somehow: moby/moby#30295 (comment)

@nelebadnjak
Copy link
Author

Well, server has IPv6 DNS servers and I removed them but no effect.

@lmakarov
Copy link
Member

lmakarov commented Aug 5, 2017 •
edited

By default there can be only about 30 docker networks created on a host: moby/moby#23971 (comment)

https://github.com/docksal/service-vhost-proxy provides several very useful features when used in a CI environment. See the README in that repo.

PROJECT_INACTIVITY_TIMEOUT is what you'd want to use to suspend inactive projects. vhost-proxy will also kill the network when suspending the project containers. When a request comes in for the project URL, vhost-proxy recreates a network and restarts the project containers.

This resolves the network limit issue as long as you have less than 30 environments on a single host being active at the same time.

Here's how our Docksal sandbox servers are configured:

$ cat ~/.docksal/docksal.env 
DOCKSAL_UUID="..."
DOCKSAL_VHOST_PROXY_IP="0.0.0.0"
PROJECT_INACTIVITY_TIMEOUT="0.5h"
PROJECT_DANGLING_TIMEOUT="120h"
CI="true"

fin reset vhost-proxy to have the settings applied.

@lmakarov lmakarov closed this as completed Aug 5, 2017
@lmakarov lmakarov mentioned this issue Jan 4, 2018
Open
@lmakarov lmakarov mentioned this issue Jun 6, 2018
Closed
@lmakarov lmakarov mentioned this issue Jun 18, 2018
Open
@claytron5000
Copy link

I had this same issue, and resolved it by ssh-ing into the boot2docker instance. Then running docker network prune. I'm not sure if there's fin commands to do the same thing.

@sean-e-dietrich
Copy link
Member

@claytron5000 you can run fin docker network prune in fact you can run all commands using fin docker ...

@lmakarov lmakarov mentioned this issue Jun 9, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
🏷bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@achekulaev @lmakarov @sean-e-dietrich @claytron5000 @nelebadnjak