==> Audit <== |---------|-----------------------------------------------------------------------------------------|--------------------------|--------|---------|---------------------|---------------------| | Command | Args | Profile | User | Version | Start Time | End Time | |---------|-----------------------------------------------------------------------------------------|--------------------------|--------|---------|---------------------|---------------------| | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:38 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:38 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:38 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:38 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | ssh | subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | ssh --node | | | | | | | | subprovisioner-test-2n-a-m02 | | | | | | | | -- bash -ic '! find | | | | | | | | /dev/mapper -type b -name | | | | | | | | subprovisioner-pvc--*--thin | | | | | | | | -exec false {} +' bash | | | | | | | delete | delete | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | start | --iso-url=https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:40 CDT | | | --profile=subprovisioner-test-2n-a --driver=kvm2 --cpus=2 --memory=2g --disk-size=5g | | | | | | | | --keep-context --nodes=2 | | | | | | | stop | stop --keep-context-active | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | --cancel-scheduled | | | | | | | ip | ip | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | ip | ip | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | --node=subprovisioner-test-2n-b-m02 | | | | | | | image | image load - | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | image | image load - | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | cp | cp | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | /home/eblake/subprovisioner/tests/lib/node-bash-profile.sh | | | | | | | | subprovisioner-test-2n-b:/home/docker/.bashrc | | | | | | | cp | cp | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | /home/eblake/subprovisioner/tests/lib/node-bash-profile.sh | | | | | | | | subprovisioner-test-2n-b-m02:/home/docker/.bashrc | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:39 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo truncate -s 2G | | | | | | | | /mnt/vda1/backing.raw | | | | | | | | __run_in_test_container_async | | | | | | | | --net host -v | | | | | | | | /mnt/vda1/backing.raw:/disk | | | | | | | | -- nbd-server | | | | | | | | --nodaemon --config-file | | | | | | | | /dev/null 10809 /disk | | | | | | | | __run_in_test_container --net | | | | | | | | host -- bash -c ' | | | | | | | | for (( i = 0; i < 50; ++i )); | | | | | | | | do if nc -z | | | | | | | | localhost 10809; then exit 0; | | | | | | | | fi sleep 0.1 | | | | | | | | done exit | | | | | | | | 1 ' | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:39 CDT | 25 Apr 24 08:40 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo modprobe nbd | | | | | | | | nbds_max=16 # for Subprovisioner | | | | | | | | to use as well | | | | | | | | __run_in_test_container --net | | | | | | | | host -- nbd-client | | | | | | | | 192.168.39.123 /dev/nbd0 | | | | | | | | sudo ln -s /dev/nbd0 | | | | | | | | /dev/subprovisioner-backing-volume | | | | | | | | sudo cp -r /dev/nbd0 | | | | | | | | /dev/my-san-lun # good for demos | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:40 CDT | 25 Apr 24 08:40 CDT | | | --node=subprovisioner-test-2n-b-m02 | | | | | | | | -- set -o errexit -o | | | | | | | | pipefail -o nounset source | | | | | | | | .bashrc sudo | | | | | | | | modprobe nbd nbds_max=16 # for | | | | | | | | Subprovisioner to use as well | | | | | | | | __run_in_test_container | | | | | | | | --net host -- | | | | | | | | nbd-client 192.168.39.123 /dev/nbd0 | | | | | | | | sudo ln -s /dev/nbd0 | | | | | | | | /dev/subprovisioner-backing-volume | | | | | | | | sudo cp -r /dev/nbd0 | | | | | | | | /dev/my-san-lun # good for demos | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:40 CDT | 25 Apr 24 08:40 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo sed -i 's|# | | | | | | | | use_lvmlockd = 0|use_lvmlockd | | | | | | | | = 1|' /etc/lvm/lvm.conf | | | | | | | | sudo sed -i 's|# | | | | | | | | host_id = 0|host_id = 1|' | | | | | | | | /etc/lvm/lvmlocal.conf | | | | | | | | # TODO set up watchdog | | | | | | | | sudo sed -i 's|# | | | | | | | | use_watchdog = 1|use_watchdog | | | | | | | | = 0|' /etc/sanlock/sanlock.conf | | | | | | | | sudo systemctl | | | | | | | | restart sanlock lvmlockd | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:40 CDT | 25 Apr 24 08:40 CDT | | | --node=subprovisioner-test-2n-b-m02 | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo sed -i 's|# | | | | | | | | use_lvmlockd = 0|use_lvmlockd = 1|' | | | | | | | | /etc/lvm/lvm.conf sudo | | | | | | | | sed -i 's|# host_id = 0|host_id | | | | | | | | = 2|' /etc/lvm/lvmlocal.conf | | | | | | | | # TODO set up watchdog | | | | | | | | sudo sed -i 's|# | | | | | | | | use_watchdog = 1|use_watchdog = 0|' | | | | | | | | /etc/sanlock/sanlock.conf | | | | | | | | sudo systemctl restart sanlock | | | | | | | | lvmlockd | | | | | | | delete | delete | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:41 CDT | 25 Apr 24 08:41 CDT | | start | --iso-url=https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:41 CDT | 25 Apr 24 08:42 CDT | | | --profile=subprovisioner-test-2n-b --driver=kvm2 --cpus=2 --memory=2g --disk-size=5g | | | | | | | | --keep-context --nodes=2 | | | | | | | stop | stop --keep-context-active | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:41 CDT | 25 Apr 24 08:41 CDT | | | --cancel-scheduled | | | | | | | ip | ip | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:41 CDT | 25 Apr 24 08:41 CDT | | | --node=subprovisioner-test-2n-a | | | | | | | ip | ip | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:41 CDT | 25 Apr 24 08:41 CDT | | | --node=subprovisioner-test-2n-a-m02 | | | | | | | image | image load - | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:41 CDT | 25 Apr 24 08:42 CDT | | image | image load - | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | cp | cp | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | /home/eblake/subprovisioner/tests/lib/node-bash-profile.sh | | | | | | | | subprovisioner-test-2n-a:/home/docker/.bashrc | | | | | | | cp | cp | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | /home/eblake/subprovisioner/tests/lib/node-bash-profile.sh | | | | | | | | subprovisioner-test-2n-a-m02:/home/docker/.bashrc | | | | | | | ssh | ssh | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | --node=subprovisioner-test-2n-a | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo truncate -s 2G | | | | | | | | /mnt/vda1/backing.raw | | | | | | | | __run_in_test_container_async | | | | | | | | --net host -v | | | | | | | | /mnt/vda1/backing.raw:/disk | | | | | | | | -- nbd-server | | | | | | | | --nodaemon --config-file | | | | | | | | /dev/null 10809 /disk | | | | | | | | __run_in_test_container --net | | | | | | | | host -- bash -c ' | | | | | | | | for (( i = 0; i < 50; ++i )); | | | | | | | | do if nc -z | | | | | | | | localhost 10809; then exit 0; | | | | | | | | fi sleep 0.1 | | | | | | | | done exit | | | | | | | | 1 ' | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | --node=subprovisioner-test-2n-a | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo modprobe nbd | | | | | | | | nbds_max=16 # for Subprovisioner | | | | | | | | to use as well | | | | | | | | __run_in_test_container --net | | | | | | | | host -- nbd-client | | | | | | | | 192.168.50.137 /dev/nbd0 | | | | | | | | sudo ln -s /dev/nbd0 | | | | | | | | /dev/subprovisioner-backing-volume | | | | | | | | sudo cp -r /dev/nbd0 | | | | | | | | /dev/my-san-lun # good for demos | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | --node=subprovisioner-test-2n-a-m02 | | | | | | | | -- set -o errexit -o | | | | | | | | pipefail -o nounset source | | | | | | | | .bashrc sudo | | | | | | | | modprobe nbd nbds_max=16 # for | | | | | | | | Subprovisioner to use as well | | | | | | | | __run_in_test_container | | | | | | | | --net host -- | | | | | | | | nbd-client 192.168.50.137 /dev/nbd0 | | | | | | | | sudo ln -s /dev/nbd0 | | | | | | | | /dev/subprovisioner-backing-volume | | | | | | | | sudo cp -r /dev/nbd0 | | | | | | | | /dev/my-san-lun # good for demos | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | --node=subprovisioner-test-2n-a | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo sed -i 's|# | | | | | | | | use_lvmlockd = 0|use_lvmlockd | | | | | | | | = 1|' /etc/lvm/lvm.conf | | | | | | | | sudo sed -i 's|# | | | | | | | | host_id = 0|host_id = 1|' | | | | | | | | /etc/lvm/lvmlocal.conf | | | | | | | | # TODO set up watchdog | | | | | | | | sudo sed -i 's|# | | | | | | | | use_watchdog = 1|use_watchdog | | | | | | | | = 0|' /etc/sanlock/sanlock.conf | | | | | | | | sudo systemctl | | | | | | | | restart sanlock lvmlockd | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:42 CDT | 25 Apr 24 08:42 CDT | | | --node=subprovisioner-test-2n-a-m02 | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo sed -i 's|# | | | | | | | | use_lvmlockd = 0|use_lvmlockd = 1|' | | | | | | | | /etc/lvm/lvm.conf sudo | | | | | | | | sed -i 's|# host_id = 0|host_id | | | | | | | | = 2|' /etc/lvm/lvmlocal.conf | | | | | | | | # TODO set up watchdog | | | | | | | | sudo sed -i 's|# | | | | | | | | use_watchdog = 1|use_watchdog = 0|' | | | | | | | | /etc/sanlock/sanlock.conf | | | | | | | | sudo systemctl restart sanlock | | | | | | | | lvmlockd | | | | | | | delete | delete | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | start | --iso-url=https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:45 CDT | | | --profile=subprovisioner-test-2n-a --driver=kvm2 --cpus=2 --memory=2g --disk-size=5g | | | | | | | | --keep-context --nodes=2 | | | | | | | stop | stop --keep-context-active | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | | --cancel-scheduled | | | | | | | ip | ip | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | ip | ip | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | | --node=subprovisioner-test-2n-b-m02 | | | | | | | image | image load - | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | image | image load - | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | cp | cp | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | | /home/eblake/subprovisioner/tests/lib/node-bash-profile.sh | | | | | | | | subprovisioner-test-2n-b:/home/docker/.bashrc | | | | | | | cp | cp | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | | /home/eblake/subprovisioner/tests/lib/node-bash-profile.sh | | | | | | | | subprovisioner-test-2n-b-m02:/home/docker/.bashrc | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:44 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo truncate -s 2G | | | | | | | | /mnt/vda1/backing.raw | | | | | | | | __run_in_test_container_async | | | | | | | | --net host -v | | | | | | | | /mnt/vda1/backing.raw:/disk | | | | | | | | -- nbd-server | | | | | | | | --nodaemon --config-file | | | | | | | | /dev/null 10809 /disk | | | | | | | | __run_in_test_container --net | | | | | | | | host -- bash -c ' | | | | | | | | for (( i = 0; i < 50; ++i )); | | | | | | | | do if nc -z | | | | | | | | localhost 10809; then exit 0; | | | | | | | | fi sleep 0.1 | | | | | | | | done exit | | | | | | | | 1 ' | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:44 CDT | 25 Apr 24 08:45 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo modprobe nbd | | | | | | | | nbds_max=16 # for Subprovisioner | | | | | | | | to use as well | | | | | | | | __run_in_test_container --net | | | | | | | | host -- nbd-client | | | | | | | | 192.168.39.100 /dev/nbd0 | | | | | | | | sudo ln -s /dev/nbd0 | | | | | | | | /dev/subprovisioner-backing-volume | | | | | | | | sudo cp -r /dev/nbd0 | | | | | | | | /dev/my-san-lun # good for demos | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:45 CDT | 25 Apr 24 08:45 CDT | | | --node=subprovisioner-test-2n-b-m02 | | | | | | | | -- set -o errexit -o | | | | | | | | pipefail -o nounset source | | | | | | | | .bashrc sudo | | | | | | | | modprobe nbd nbds_max=16 # for | | | | | | | | Subprovisioner to use as well | | | | | | | | __run_in_test_container | | | | | | | | --net host -- | | | | | | | | nbd-client 192.168.39.100 /dev/nbd0 | | | | | | | | sudo ln -s /dev/nbd0 | | | | | | | | /dev/subprovisioner-backing-volume | | | | | | | | sudo cp -r /dev/nbd0 | | | | | | | | /dev/my-san-lun # good for demos | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:45 CDT | 25 Apr 24 08:45 CDT | | | --node=subprovisioner-test-2n-b | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo sed -i 's|# | | | | | | | | use_lvmlockd = 0|use_lvmlockd | | | | | | | | = 1|' /etc/lvm/lvm.conf | | | | | | | | sudo sed -i 's|# | | | | | | | | host_id = 0|host_id = 1|' | | | | | | | | /etc/lvm/lvmlocal.conf | | | | | | | | # TODO set up watchdog | | | | | | | | sudo sed -i 's|# | | | | | | | | use_watchdog = 1|use_watchdog | | | | | | | | = 0|' /etc/sanlock/sanlock.conf | | | | | | | | sudo systemctl | | | | | | | | restart sanlock lvmlockd | | | | | | | | | | | | | | | ssh | ssh | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:45 CDT | 25 Apr 24 08:45 CDT | | | --node=subprovisioner-test-2n-b-m02 | | | | | | | | -- set -o errexit | | | | | | | | -o pipefail -o nounset | | | | | | | | source .bashrc | | | | | | | | sudo sed -i 's|# | | | | | | | | use_lvmlockd = 0|use_lvmlockd = 1|' | | | | | | | | /etc/lvm/lvm.conf sudo | | | | | | | | sed -i 's|# host_id = 0|host_id | | | | | | | | = 2|' /etc/lvm/lvmlocal.conf | | | | | | | | # TODO set up watchdog | | | | | | | | sudo sed -i 's|# | | | | | | | | use_watchdog = 1|use_watchdog = 0|' | | | | | | | | /etc/sanlock/sanlock.conf | | | | | | | | sudo systemctl restart sanlock | | | | | | | | lvmlockd | | | | | | | delete | delete | subprovisioner-test-2n-b | eblake | v1.33.0 | 25 Apr 24 08:46 CDT | 25 Apr 24 08:46 CDT | | stop | --profile=subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:46 CDT | | | | --keep-context-active | | | | | | | | --schedule=30m | | | | | | | stop | --profile=subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:46 CDT | | | | --keep-context-active | | | | | | | | --schedule=30m | | | | | | | stop | --profile=subprovisioner-test-2n-a | subprovisioner-test-2n-a | eblake | v1.33.0 | 25 Apr 24 08:46 CDT | 25 Apr 24 09:16 CDT | | | --keep-context-active | | | | | | | | --schedule=30m | | | | | | |---------|-----------------------------------------------------------------------------------------|--------------------------|--------|---------|---------------------|---------------------| ==> Last Start <== Log file created at: 2024/04/25 08:44:37 Running on machine: green Binary: Built with gc go1.22.1 for linux/amd64 Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg I0425 08:44:37.825246 450500 out.go:291] Setting OutFile to fd 1 ... I0425 08:44:37.825415 450500 out.go:343] isatty.IsTerminal(1) = false I0425 08:44:37.825421 450500 out.go:304] Setting ErrFile to fd 2... I0425 08:44:37.825427 450500 out.go:343] isatty.IsTerminal(2) = false I0425 08:44:37.825664 450500 root.go:338] Updating PATH: /home/eblake/.minikube/bin I0425 08:44:37.826251 450500 out.go:298] Setting JSON to false I0425 08:44:37.830134 450500 start.go:129] hostinfo: {"hostname":"green","uptime":129302,"bootTime":1713923376,"procs":610,"os":"linux","platform":"fedora","platformFamily":"fedora","platformVersion":"40","kernelVersion":"6.8.7-300.fc40.x86_64","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"host","hostId":"910aea41-a61b-44d9-b9ab-5d6f6dd16d77"} I0425 08:44:37.830206 450500 start.go:139] virtualization: kvm host I0425 08:44:37.835142 450500 out.go:177] * [subprovisioner-test-2n-a] minikube v1.33.0 on Fedora 40 I0425 08:44:37.838491 450500 notify.go:220] Checking for updates... I0425 08:44:37.839081 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-b": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:44:37.839188 450500 driver.go:392] Setting default libvirt URI to qemu:///system I0425 08:44:38.055871 450500 out.go:177] * Using the kvm2 driver based on user configuration I0425 08:44:38.058960 450500 start.go:297] selected driver: kvm2 I0425 08:44:38.058986 450500 start.go:901] validating driver "kvm2" against I0425 08:44:38.059053 450500 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error: Reason: Fix: Doc: Version:} I0425 08:44:38.060859 450500 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0425 08:44:38.060941 450500 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/eblake/.minikube/bin:/home/eblake/.local/bin:/home/eblake/bin:/home/eblake/.local/bin:/home/eblake/bin:/usr/lib64/ccache:/usr/local/bin:/usr/local/sbin:/usr/bin:/usr/sbin:/home/eblake/.dotnet/tools I0425 08:44:38.078567 450500 install.go:137] /home/eblake/.minikube/bin/docker-machine-driver-kvm2 version is 1.33.0 I0425 08:44:38.078622 450500 start_flags.go:310] no existing cluster config was found, will generate one from the flags I0425 08:44:38.079079 450500 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true] I0425 08:44:38.079134 450500 cni.go:84] Creating CNI manager for "" I0425 08:44:38.079144 450500 cni.go:136] multinode detected (0 nodes found), recommending kindnet I0425 08:44:38.079151 450500 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni I0425 08:44:38.079211 450500 start.go:340] cluster config: {Name:subprovisioner-test-2n-a KeepContext:true EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2048 CPUs:2 DiskSize:5120 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/eblake:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} I0425 08:44:38.079311 450500 iso.go:125] acquiring lock: {Name:mk44b654eccda7cc6686162a0f5cf8f28073c8ea Clock:{} Delay:500ms Timeout:10m0s Cancel:} I0425 08:44:38.081283 450500 out.go:177] * Starting "subprovisioner-test-2n-a" primary control-plane node in "subprovisioner-test-2n-a" cluster I0425 08:44:38.086373 450500 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker I0425 08:44:38.086403 450500 preload.go:147] Found local preload: /home/eblake/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-amd64.tar.lz4 I0425 08:44:38.086408 450500 cache.go:56] Caching tarball of preloaded images I0425 08:44:38.086507 450500 preload.go:173] Found /home/eblake/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0425 08:44:38.086515 450500 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on docker I0425 08:44:38.086595 450500 profile.go:143] Saving config to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/config.json ... I0425 08:44:38.086610 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/config.json: {Name:mk5644a277d67a8f675e894ce589a3f8e0f6593d Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:44:38.086707 450500 start.go:360] acquireMachinesLock for subprovisioner-test-2n-a: {Name:mkf7ef19c09ee03b82e3f02f4c680452e72cfa0d Clock:{} Delay:500ms Timeout:13m0s Cancel:} I0425 08:44:38.086729 450500 start.go:364] duration metric: took 15.457µs to acquireMachinesLock for "subprovisioner-test-2n-a" I0425 08:44:38.086738 450500 start.go:93] Provisioning new machine with config: &{Name:subprovisioner-test-2n-a KeepContext:true EmbedCerts:false MinikubeISO:https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2048 CPUs:2 DiskSize:5120 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/eblake:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true} I0425 08:44:38.086783 450500 start.go:125] createHost starting for "" (driver="kvm2") I0425 08:44:38.088578 450500 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2048MB, Disk=5120MB) ... I0425 08:44:38.088673 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:44:38.088702 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:44:38.112294 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35477 I0425 08:44:38.112807 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:44:38.113273 450500 main.go:141] libmachine: Using API Version 1 I0425 08:44:38.113288 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:44:38.113656 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:44:38.113824 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetMachineName I0425 08:44:38.113957 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:38.114095 450500 start.go:159] libmachine.API.Create for "subprovisioner-test-2n-a" (driver="kvm2") I0425 08:44:38.114116 450500 client.go:168] LocalClient.Create starting I0425 08:44:38.114145 450500 main.go:141] libmachine: Reading certificate data from /home/eblake/.minikube/certs/ca.pem I0425 08:44:38.114178 450500 main.go:141] libmachine: Decoding PEM data... I0425 08:44:38.114194 450500 main.go:141] libmachine: Parsing certificate... I0425 08:44:38.114259 450500 main.go:141] libmachine: Reading certificate data from /home/eblake/.minikube/certs/cert.pem I0425 08:44:38.114282 450500 main.go:141] libmachine: Decoding PEM data... I0425 08:44:38.114294 450500 main.go:141] libmachine: Parsing certificate... I0425 08:44:38.114317 450500 main.go:141] libmachine: Running pre-create checks... I0425 08:44:38.114326 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .PreCreateCheck I0425 08:44:38.114611 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetConfigRaw I0425 08:44:38.114897 450500 main.go:141] libmachine: Creating machine... I0425 08:44:38.114906 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .Create I0425 08:44:38.115002 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Creating KVM machine... I0425 08:44:38.123305 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found existing default KVM network I0425 08:44:38.124589 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.124399 450640 network.go:211] skipping subnet 192.168.39.0/24 that is taken: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName:virbr1 IfaceIPv4:192.168.39.1 IfaceMTU:1500 IfaceMAC:52:54:00:80:f6:ad} reservation:} I0425 08:44:38.125591 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125460 450640 network.go:206] using free private subnet 192.168.50.0/24: &{IP:192.168.50.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.50.0/24 Gateway:192.168.50.1 ClientMin:192.168.50.2 ClientMax:192.168.50.254 Broadcast:192.168.50.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0002fa5d0} I0425 08:44:38.125620 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | created network xml: I0425 08:44:38.125630 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125636 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | mk-subprovisioner-test-2n-a I0425 08:44:38.125644 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125655 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125664 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125669 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125700 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125757 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125767 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125773 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125779 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.125782 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.134191 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | trying to create private KVM network mk-subprovisioner-test-2n-a 192.168.50.0/24... I0425 08:44:38.218335 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | private KVM network mk-subprovisioner-test-2n-a 192.168.50.0/24 created I0425 08:44:38.218377 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Setting up store path in /home/eblake/.minikube/machines/subprovisioner-test-2n-a ... I0425 08:44:38.218391 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.218286 450640 common.go:145] Making disk image using store path: /home/eblake/.minikube I0425 08:44:38.218413 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Building disk image from file:///home/eblake/.minikube/cache/iso/amd64/download I0425 08:44:38.218541 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Downloading /home/eblake/.minikube/cache/boot2docker.iso from file:///home/eblake/.minikube/cache/iso/amd64/download... I0425 08:44:38.220294 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.220245 450640 common.go:152] Creating ssh key: /home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa... I0425 08:44:38.486993 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.486916 450640 common.go:158] Creating raw disk image: /home/eblake/.minikube/machines/subprovisioner-test-2n-a/subprovisioner-test-2n-a.rawdisk... I0425 08:44:38.487031 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Writing magic tar header I0425 08:44:38.487046 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Writing SSH key tar header I0425 08:44:38.487069 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:38.487040 450640 common.go:172] Fixing permissions on /home/eblake/.minikube/machines/subprovisioner-test-2n-a ... I0425 08:44:38.487126 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Checking permissions on dir: /home/eblake/.minikube/machines/subprovisioner-test-2n-a I0425 08:44:38.487138 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Setting executable bit set on /home/eblake/.minikube/machines/subprovisioner-test-2n-a (perms=drwx------) I0425 08:44:38.487145 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Checking permissions on dir: /home/eblake/.minikube/machines I0425 08:44:38.487153 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Setting executable bit set on /home/eblake/.minikube/machines (perms=drwxr-xr-x) I0425 08:44:38.487165 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Setting executable bit set on /home/eblake/.minikube (perms=drwxr-xr-x) I0425 08:44:38.487176 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Checking permissions on dir: /home/eblake/.minikube I0425 08:44:38.487183 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Setting executable bit set on /home/eblake (perms=drwxr-xr-x) I0425 08:44:38.487190 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Checking permissions on dir: /home/eblake I0425 08:44:38.487198 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Checking permissions on dir: /home I0425 08:44:38.487202 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Skipping /home - not owner I0425 08:44:38.487209 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Creating domain... I0425 08:44:38.496925 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) define libvirt domain using xml: I0425 08:44:38.496939 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496947 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) subprovisioner-test-2n-a I0425 08:44:38.496952 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) 2048 I0425 08:44:38.496956 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) 2 I0425 08:44:38.496960 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496964 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496968 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496972 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496975 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496980 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.496984 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497000 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497026 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497034 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497042 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) hvm I0425 08:44:38.497049 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497071 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497078 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497083 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497087 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497092 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497099 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497104 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497108 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497112 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497116 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497125 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497131 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497136 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497139 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497144 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497148 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497155 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497160 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497165 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497168 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497178 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497182 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497186 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497190 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497194 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497197 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497202 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497205 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497210 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497214 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) /dev/random I0425 08:44:38.497217 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497221 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497264 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497276 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497281 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.497285 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) I0425 08:44:38.504740 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:64:26:36 in network default I0425 08:44:38.505153 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Ensuring networks are active... I0425 08:44:38.505170 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:38.512282 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Ensuring network default is active I0425 08:44:38.514428 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Ensuring network mk-subprovisioner-test-2n-a is active I0425 08:44:38.515338 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Getting domain xml... I0425 08:44:38.522069 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Creating domain... I0425 08:44:39.030332 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Waiting to get IP... I0425 08:44:39.031100 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:39.031507 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:39.031534 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:39.031491 450640 retry.go:31] will retry after 225.743533ms: waiting for machine to come up I0425 08:44:39.260691 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:39.261341 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:39.261383 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:39.261303 450640 retry.go:31] will retry after 297.908347ms: waiting for machine to come up I0425 08:44:39.562265 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:39.562979 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:39.563056 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:39.562943 450640 retry.go:31] will retry after 473.732761ms: waiting for machine to come up I0425 08:44:40.038249 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:40.038542 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:40.038553 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:40.038527 450640 retry.go:31] will retry after 542.20281ms: waiting for machine to come up I0425 08:44:40.581872 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:40.582206 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:40.582233 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:40.582198 450640 retry.go:31] will retry after 545.281706ms: waiting for machine to come up I0425 08:44:41.128619 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:41.129075 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:41.129110 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:41.129012 450640 retry.go:31] will retry after 753.131988ms: waiting for machine to come up I0425 08:44:41.883611 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:41.884168 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:41.884192 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:41.884131 450640 retry.go:31] will retry after 1.061191004s: waiting for machine to come up I0425 08:44:42.946884 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:42.947207 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:42.947235 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:42.947179 450640 retry.go:31] will retry after 1.136696256s: waiting for machine to come up I0425 08:44:44.084915 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:44.085331 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:44.085355 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:44.085294 450640 retry.go:31] will retry after 1.572692815s: waiting for machine to come up I0425 08:44:45.659403 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:45.660038 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:45.660056 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:45.659923 450640 retry.go:31] will retry after 1.677101586s: waiting for machine to come up I0425 08:44:47.337833 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:47.338139 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:47.338158 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:47.338112 450640 retry.go:31] will retry after 2.828886318s: waiting for machine to come up I0425 08:44:50.168800 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:50.169135 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:50.169157 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:50.169125 450640 retry.go:31] will retry after 2.279581755s: waiting for machine to come up I0425 08:44:52.450770 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:52.451023 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find current IP address of domain subprovisioner-test-2n-a in network mk-subprovisioner-test-2n-a I0425 08:44:52.451034 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | I0425 08:44:52.450992 450640 retry.go:31] will retry after 3.746025687s: waiting for machine to come up I0425 08:44:56.199806 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.200181 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has current primary IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.200188 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Found IP for machine: 192.168.50.222 I0425 08:44:56.200196 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Reserving static IP address... I0425 08:44:56.201547 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | unable to find host DHCP lease matching {name: "subprovisioner-test-2n-a", mac: "52:54:00:45:16:af", ip: "192.168.50.222"} in network mk-subprovisioner-test-2n-a I0425 08:44:56.434992 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Reserved static IP address: 192.168.50.222 I0425 08:44:56.435034 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Getting to WaitForSSH function... I0425 08:44:56.435040 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Waiting for SSH to be available... I0425 08:44:56.457229 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.459073 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:minikube Clientid:01:52:54:00:45:16:af} I0425 08:44:56.459104 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.459311 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Using SSH client type: external I0425 08:44:56.459328 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Using SSH private key: /home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa (-rw-------) I0425 08:44:56.459362 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.222 -o IdentitiesOnly=yes -i /home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa -p 22] /usr/bin/ssh } I0425 08:44:56.459368 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | About to run SSH command: I0425 08:44:56.459375 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | exit 0 I0425 08:44:56.712214 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | SSH cmd err, output: : I0425 08:44:56.712436 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) KVM machine creation complete! I0425 08:44:56.713076 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetConfigRaw I0425 08:44:56.713597 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:56.713718 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:56.713820 450500 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes... I0425 08:44:56.713827 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetState I0425 08:44:56.720904 450500 main.go:141] libmachine: Detecting operating system of created instance... I0425 08:44:56.720916 450500 main.go:141] libmachine: Waiting for SSH to be available... I0425 08:44:56.720923 450500 main.go:141] libmachine: Getting to WaitForSSH function... I0425 08:44:56.720931 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:56.730026 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.731340 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:56.731354 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.731445 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:56.731570 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:56.731670 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:56.731741 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:56.731845 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:56.731994 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:56.731998 450500 main.go:141] libmachine: About to run SSH command: exit 0 I0425 08:44:56.836439 450500 main.go:141] libmachine: SSH cmd err, output: : I0425 08:44:56.836449 450500 main.go:141] libmachine: Detecting the provisioner... I0425 08:44:56.836455 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:56.849742 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.850889 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:56.850911 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.851048 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:56.851215 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:56.851312 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:56.851398 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:56.851511 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:56.851646 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:56.851651 450500 main.go:141] libmachine: About to run SSH command: cat /etc/os-release I0425 08:44:56.958909 450500 main.go:141] libmachine: SSH cmd err, output: : NAME=Buildroot VERSION=2023.02.9-2-gb5fa2c8c-dirty ID=buildroot VERSION_ID=2023.02.9 PRETTY_NAME="Buildroot 2023.02.9" I0425 08:44:56.958945 450500 main.go:141] libmachine: found compatible host: buildroot I0425 08:44:56.958949 450500 main.go:141] libmachine: Provisioning with buildroot... I0425 08:44:56.958957 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetMachineName I0425 08:44:56.959191 450500 buildroot.go:166] provisioning hostname "subprovisioner-test-2n-a" I0425 08:44:56.959203 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetMachineName I0425 08:44:56.959300 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:56.967233 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.968474 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:56.968498 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:56.968668 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:56.968849 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:56.968954 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:56.969055 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:56.969186 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:56.969329 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:56.969335 450500 main.go:141] libmachine: About to run SSH command: sudo hostname subprovisioner-test-2n-a && echo "subprovisioner-test-2n-a" | sudo tee /etc/hostname I0425 08:44:57.096865 450500 main.go:141] libmachine: SSH cmd err, output: : subprovisioner-test-2n-a I0425 08:44:57.096877 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:57.114529 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.115731 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.115743 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.115891 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:57.116011 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.116120 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.116210 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:57.116330 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:57.116491 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:57.116502 450500 main.go:141] libmachine: About to run SSH command: if ! grep -xq '.*\ssubprovisioner-test-2n-a' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 subprovisioner-test-2n-a/g' /etc/hosts; else echo '127.0.1.1 subprovisioner-test-2n-a' | sudo tee -a /etc/hosts; fi fi I0425 08:44:57.229140 450500 main.go:141] libmachine: SSH cmd err, output: : I0425 08:44:57.229153 450500 buildroot.go:172] set auth options {CertDir:/home/eblake/.minikube CaCertPath:/home/eblake/.minikube/certs/ca.pem CaPrivateKeyPath:/home/eblake/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/eblake/.minikube/machines/server.pem ServerKeyPath:/home/eblake/.minikube/machines/server-key.pem ClientKeyPath:/home/eblake/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/eblake/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/eblake/.minikube} I0425 08:44:57.229170 450500 buildroot.go:174] setting up certificates I0425 08:44:57.229176 450500 provision.go:84] configureAuth start I0425 08:44:57.229183 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetMachineName I0425 08:44:57.229348 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetIP I0425 08:44:57.238406 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.239685 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.239702 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.239863 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:57.248611 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.249603 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.249621 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.249733 450500 provision.go:143] copyHostCerts I0425 08:44:57.249785 450500 exec_runner.go:144] found /home/eblake/.minikube/ca.pem, removing ... I0425 08:44:57.249798 450500 exec_runner.go:203] rm: /home/eblake/.minikube/ca.pem I0425 08:44:57.249856 450500 exec_runner.go:151] cp: /home/eblake/.minikube/certs/ca.pem --> /home/eblake/.minikube/ca.pem (1078 bytes) I0425 08:44:57.249936 450500 exec_runner.go:144] found /home/eblake/.minikube/cert.pem, removing ... I0425 08:44:57.249939 450500 exec_runner.go:203] rm: /home/eblake/.minikube/cert.pem I0425 08:44:57.249967 450500 exec_runner.go:151] cp: /home/eblake/.minikube/certs/cert.pem --> /home/eblake/.minikube/cert.pem (1119 bytes) I0425 08:44:57.250038 450500 exec_runner.go:144] found /home/eblake/.minikube/key.pem, removing ... I0425 08:44:57.250041 450500 exec_runner.go:203] rm: /home/eblake/.minikube/key.pem I0425 08:44:57.250066 450500 exec_runner.go:151] cp: /home/eblake/.minikube/certs/key.pem --> /home/eblake/.minikube/key.pem (1675 bytes) I0425 08:44:57.250113 450500 provision.go:117] generating server cert: /home/eblake/.minikube/machines/server.pem ca-key=/home/eblake/.minikube/certs/ca.pem private-key=/home/eblake/.minikube/certs/ca-key.pem org=eblake.subprovisioner-test-2n-a san=[127.0.0.1 192.168.50.222 localhost minikube subprovisioner-test-2n-a] I0425 08:44:57.342352 450500 provision.go:177] copyRemoteCerts I0425 08:44:57.342464 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0425 08:44:57.342479 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:57.351355 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.352346 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.352357 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.352504 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:57.352621 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.352706 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:57.352773 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} I0425 08:44:57.433571 450500 ssh_runner.go:362] scp /home/eblake/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes) I0425 08:44:57.450947 450500 ssh_runner.go:362] scp /home/eblake/.minikube/machines/server.pem --> /etc/docker/server.pem (1237 bytes) I0425 08:44:57.468330 450500 ssh_runner.go:362] scp /home/eblake/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes) I0425 08:44:57.485736 450500 provision.go:87] duration metric: took 256.550735ms to configureAuth I0425 08:44:57.485751 450500 buildroot.go:189] setting minikube options for container-runtime I0425 08:44:57.485887 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-a": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:44:57.485903 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:57.486094 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:57.495446 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.496651 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.496664 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.496820 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:57.496950 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.497042 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.497149 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:57.497256 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:57.497425 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:57.497432 450500 main.go:141] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0425 08:44:57.606460 450500 main.go:141] libmachine: SSH cmd err, output: : tmpfs I0425 08:44:57.606473 450500 buildroot.go:70] root file system type: tmpfs I0425 08:44:57.606582 450500 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ... I0425 08:44:57.606604 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:57.615217 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.616348 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.616360 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.616549 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:57.616653 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.616761 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.616842 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:57.616972 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:57.617153 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:57.617243 450500 main.go:141] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0425 08:44:57.734493 450500 main.go:141] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0425 08:44:57.734526 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:57.746127 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.747190 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:57.747207 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:57.747327 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:57.747448 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.747547 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:57.747622 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:57.747717 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:57.747846 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:57.747857 450500 main.go:141] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0425 08:44:59.655729 450500 main.go:141] libmachine: SSH cmd err, output: : diff: can't stat '/lib/systemd/system/docker.service': No such file or directory Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service. I0425 08:44:59.655739 450500 main.go:141] libmachine: Checking connection to Docker... I0425 08:44:59.655746 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetURL I0425 08:44:59.660018 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Using libvirt version 10001000 I0425 08:44:59.668071 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.669183 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.669200 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.669333 450500 main.go:141] libmachine: Docker is up and running! I0425 08:44:59.669343 450500 main.go:141] libmachine: Reticulating splines... I0425 08:44:59.669350 450500 client.go:171] duration metric: took 21.555227845s to LocalClient.Create I0425 08:44:59.669367 450500 start.go:167] duration metric: took 21.555272973s to libmachine.API.Create "subprovisioner-test-2n-a" I0425 08:44:59.669374 450500 start.go:293] postStartSetup for "subprovisioner-test-2n-a" (driver="kvm2") I0425 08:44:59.669381 450500 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0425 08:44:59.669392 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:59.669558 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0425 08:44:59.669573 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:59.677479 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.678551 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.678570 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.678716 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:59.678847 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:59.678963 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:59.679064 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} I0425 08:44:59.755914 450500 ssh_runner.go:195] Run: cat /etc/os-release I0425 08:44:59.758837 450500 info.go:137] Remote host: Buildroot 2023.02.9 I0425 08:44:59.758849 450500 filesync.go:126] Scanning /home/eblake/.minikube/addons for local assets ... I0425 08:44:59.758895 450500 filesync.go:126] Scanning /home/eblake/.minikube/files for local assets ... I0425 08:44:59.758910 450500 start.go:296] duration metric: took 89.532666ms for postStartSetup I0425 08:44:59.758931 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetConfigRaw I0425 08:44:59.759322 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetIP I0425 08:44:59.770307 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.771814 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.771834 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.772074 450500 profile.go:143] Saving config to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/config.json ... I0425 08:44:59.772303 450500 start.go:128] duration metric: took 21.685512503s to createHost I0425 08:44:59.772316 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:59.782620 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.783737 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.783749 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.783891 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:59.784000 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:59.784129 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:59.784207 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:59.784327 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:44:59.784452 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.222 22 } I0425 08:44:59.784457 450500 main.go:141] libmachine: About to run SSH command: date +%!s(MISSING).%!N(MISSING) I0425 08:44:59.895140 450500 main.go:141] libmachine: SSH cmd err, output: : 1714052699.878284956 I0425 08:44:59.895152 450500 fix.go:216] guest clock: 1714052699.878284956 I0425 08:44:59.895160 450500 fix.go:229] Guest: 2024-04-25 08:44:59.878284956 -0500 CDT Remote: 2024-04-25 08:44:59.772307326 -0500 CDT m=+21.997487308 (delta=105.97763ms) I0425 08:44:59.895178 450500 fix.go:200] guest clock delta is within tolerance: 105.97763ms I0425 08:44:59.895182 450500 start.go:83] releasing machines lock for "subprovisioner-test-2n-a", held for 21.808448689s I0425 08:44:59.895199 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:59.895378 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetIP I0425 08:44:59.904695 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.905898 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.905917 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.906058 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:59.906428 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:59.906537 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:44:59.906625 450500 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/ I0425 08:44:59.906653 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:59.906656 450500 ssh_runner.go:195] Run: cat /version.json I0425 08:44:59.906665 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:44:59.917270 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.918515 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.918527 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.918711 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:59.918860 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:59.918977 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:59.919091 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} I0425 08:44:59.919563 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.920871 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:44:59.920888 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:44:59.921031 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:44:59.921146 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:44:59.921259 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:44:59.921340 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} W0425 08:44:59.996580 450500 out.go:239] ! Image was not built for the current minikube version. To resolve this you can delete and recreate your minikube cluster using the latest images. Expected minikube version: v1.33.0-beta.0 -> Actual minikube version: v1.33.0 I0425 08:44:59.996776 450500 ssh_runner.go:195] Run: systemctl --version I0425 08:45:00.474571 450500 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*" W0425 08:45:00.478583 450500 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found I0425 08:45:00.478636 450500 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ; I0425 08:45:00.490779 450500 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s) I0425 08:45:00.490797 450500 start.go:494] detecting cgroup driver to use... I0425 08:45:00.490883 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock " | sudo tee /etc/crictl.yaml" I0425 08:45:00.506210 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml" I0425 08:45:00.514471 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml" I0425 08:45:00.522990 450500 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver... I0425 08:45:00.523080 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml" I0425 08:45:00.531925 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0425 08:45:00.541386 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml" I0425 08:45:00.551062 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0425 08:45:00.563316 450500 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk" I0425 08:45:00.573683 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml" I0425 08:45:00.584750 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml" I0425 08:45:00.592485 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml" I0425 08:45:00.599917 450500 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables I0425 08:45:00.606364 450500 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward" I0425 08:45:00.613182 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:00.720433 450500 ssh_runner.go:195] Run: sudo systemctl restart containerd I0425 08:45:00.739354 450500 start.go:494] detecting cgroup driver to use... I0425 08:45:00.739421 450500 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0425 08:45:00.755801 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd I0425 08:45:00.775332 450500 ssh_runner.go:195] Run: sudo systemctl stop -f containerd I0425 08:45:00.793960 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd I0425 08:45:00.805513 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0425 08:45:00.815386 450500 ssh_runner.go:195] Run: sudo systemctl stop -f crio I0425 08:45:00.850698 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0425 08:45:00.863387 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock " | sudo tee /etc/crictl.yaml" I0425 08:45:00.877923 450500 ssh_runner.go:195] Run: which cri-dockerd I0425 08:45:00.880572 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d I0425 08:45:00.887639 450500 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes) I0425 08:45:00.902197 450500 ssh_runner.go:195] Run: sudo systemctl unmask docker.service I0425 08:45:00.997508 450500 ssh_runner.go:195] Run: sudo systemctl enable docker.socket I0425 08:45:01.122078 450500 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver... I0425 08:45:01.122182 450500 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes) I0425 08:45:01.133183 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:01.228720 450500 ssh_runner.go:195] Run: sudo systemctl restart docker I0425 08:45:03.562188 450500 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.333451736s) I0425 08:45:03.562255 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket I0425 08:45:03.573943 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service I0425 08:45:03.584236 450500 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket I0425 08:45:03.700222 450500 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket I0425 08:45:03.810791 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:03.917989 450500 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket I0425 08:45:03.930323 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service I0425 08:45:03.940856 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:04.031963 450500 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service I0425 08:45:04.077505 450500 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock I0425 08:45:04.077550 450500 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock I0425 08:45:04.081550 450500 start.go:562] Will wait 60s for crictl version I0425 08:45:04.081595 450500 ssh_runner.go:195] Run: which crictl I0425 08:45:04.084042 450500 ssh_runner.go:195] Run: sudo /usr/bin/crictl version I0425 08:45:04.118355 450500 start.go:578] Version: 0.1.0 RuntimeName: docker RuntimeVersion: 25.0.4 RuntimeApiVersion: v1 I0425 08:45:04.118487 450500 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0425 08:45:04.133908 450500 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0425 08:45:04.169674 450500 out.go:204] * Preparing Kubernetes v1.30.0 on Docker 25.0.4 ... I0425 08:45:04.169719 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetIP I0425 08:45:04.177933 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:04.178866 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:45:04.178880 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:04.179070 450500 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts I0425 08:45:04.181651 450500 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0425 08:45:04.190186 450500 kubeadm.go:877] updating cluster {Name:subprovisioner-test-2n-a KeepContext:true EmbedCerts:false MinikubeISO:https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2048 CPUs:2 DiskSize:5120 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.222 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/eblake:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ... I0425 08:45:04.190302 450500 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker I0425 08:45:04.190355 450500 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0425 08:45:04.202625 450500 docker.go:685] Got preloaded images: I0425 08:45:04.202634 450500 docker.go:691] registry.k8s.io/kube-apiserver:v1.30.0 wasn't preloaded I0425 08:45:04.202676 450500 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json I0425 08:45:04.209764 450500 ssh_runner.go:195] Run: which lz4 I0425 08:45:04.212082 450500 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4 I0425 08:45:04.214705 450500 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1 stdout: stderr: stat: cannot statx '/preloaded.tar.lz4': No such file or directory I0425 08:45:04.214721 450500 ssh_runner.go:362] scp /home/eblake/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-amd64.tar.lz4 --> /preloaded.tar.lz4 (359556852 bytes) I0425 08:45:05.271598 450500 docker.go:649] duration metric: took 1.059543555s to copy over tarball I0425 08:45:05.271650 450500 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4 I0425 08:45:07.056933 450500 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (1.785263717s) I0425 08:45:07.056949 450500 ssh_runner.go:146] rm: /preloaded.tar.lz4 I0425 08:45:07.085893 450500 ssh_runner.go:195] Run: sudo cat /var/lib/docker/image/overlay2/repositories.json I0425 08:45:07.092827 450500 ssh_runner.go:362] scp memory --> /var/lib/docker/image/overlay2/repositories.json (2630 bytes) I0425 08:45:07.104239 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:07.197022 450500 ssh_runner.go:195] Run: sudo systemctl restart docker I0425 08:45:09.623759 450500 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.426716951s) I0425 08:45:09.623853 450500 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}} I0425 08:45:09.636314 450500 docker.go:685] Got preloaded images: -- stdout -- registry.k8s.io/kube-apiserver:v1.30.0 registry.k8s.io/kube-scheduler:v1.30.0 registry.k8s.io/kube-controller-manager:v1.30.0 registry.k8s.io/kube-proxy:v1.30.0 registry.k8s.io/etcd:3.5.12-0 registry.k8s.io/coredns/coredns:v1.11.1 registry.k8s.io/pause:3.9 gcr.io/k8s-minikube/storage-provisioner:v5 -- /stdout -- I0425 08:45:09.636324 450500 cache_images.go:84] Images are preloaded, skipping loading I0425 08:45:09.636333 450500 kubeadm.go:928] updating node { 192.168.50.222 8443 v1.30.0 docker true true} ... I0425 08:45:09.636425 450500 kubeadm.go:940] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=subprovisioner-test-2n-a --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.222 [Install] config: {KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} I0425 08:45:09.636469 450500 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}} I0425 08:45:09.654624 450500 cni.go:84] Creating CNI manager for "" I0425 08:45:09.654633 450500 cni.go:136] multinode detected (1 nodes found), recommending kindnet I0425 08:45:09.654639 450500 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16 I0425 08:45:09.654654 450500 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.50.222 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:subprovisioner-test-2n-a NodeName:subprovisioner-test-2n-a DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.50.222"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.50.222 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true} I0425 08:45:09.654749 450500 kubeadm.go:187] kubeadm config: apiVersion: kubeadm.k8s.io/v1beta3 kind: InitConfiguration localAPIEndpoint: advertiseAddress: 192.168.50.222 bindPort: 8443 bootstrapTokens: - groups: - system:bootstrappers:kubeadm:default-node-token ttl: 24h0m0s usages: - signing - authentication nodeRegistration: criSocket: unix:///var/run/cri-dockerd.sock name: "subprovisioner-test-2n-a" kubeletExtraArgs: node-ip: 192.168.50.222 taints: [] --- apiVersion: kubeadm.k8s.io/v1beta3 kind: ClusterConfiguration apiServer: certSANs: ["127.0.0.1", "localhost", "192.168.50.222"] extraArgs: enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota" controllerManager: extraArgs: allocate-node-cidrs: "true" leader-elect: "false" scheduler: extraArgs: leader-elect: "false" certificatesDir: /var/lib/minikube/certs clusterName: mk controlPlaneEndpoint: control-plane.minikube.internal:8443 etcd: local: dataDir: /var/lib/minikube/etcd extraArgs: proxy-refresh-interval: "70000" kubernetesVersion: v1.30.0 networking: dnsDomain: cluster.local podSubnet: "10.244.0.0/16" serviceSubnet: 10.96.0.0/12 --- apiVersion: kubelet.config.k8s.io/v1beta1 kind: KubeletConfiguration authentication: x509: clientCAFile: /var/lib/minikube/certs/ca.crt cgroupDriver: cgroupfs containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock hairpinMode: hairpin-veth runtimeRequestTimeout: 15m clusterDomain: "cluster.local" # disable disk resource management by default imageGCHighThresholdPercent: 100 evictionHard: nodefs.available: "0%!"(MISSING) nodefs.inodesFree: "0%!"(MISSING) imagefs.available: "0%!"(MISSING) failSwapOn: false staticPodPath: /etc/kubernetes/manifests --- apiVersion: kubeproxy.config.k8s.io/v1alpha1 kind: KubeProxyConfiguration clusterCIDR: "10.244.0.0/16" metricsBindAddress: 0.0.0.0:10249 conntrack: maxPerCore: 0 # Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established" tcpEstablishedTimeout: 0s # Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close" tcpCloseWaitTimeout: 0s I0425 08:45:09.654796 450500 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0 I0425 08:45:09.662549 450500 binaries.go:44] Found k8s binaries, skipping transfer I0425 08:45:09.662649 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube I0425 08:45:09.669181 450500 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (325 bytes) I0425 08:45:09.682428 450500 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0425 08:45:09.697337 450500 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2172 bytes) I0425 08:45:09.710823 450500 ssh_runner.go:195] Run: grep 192.168.50.222 control-plane.minikube.internal$ /etc/hosts I0425 08:45:09.713486 450500 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.222 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0425 08:45:09.721784 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:09.828309 450500 ssh_runner.go:195] Run: sudo systemctl start kubelet I0425 08:45:09.840568 450500 certs.go:68] Setting up /home/eblake/.minikube/profiles/subprovisioner-test-2n-a for IP: 192.168.50.222 I0425 08:45:09.840575 450500 certs.go:194] generating shared ca certs ... I0425 08:45:09.840584 450500 certs.go:226] acquiring lock for ca certs: {Name:mk73484ff16617e22c86e8ccdad36aa85d03d96e Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:09.840681 450500 certs.go:235] skipping valid "minikubeCA" ca cert: /home/eblake/.minikube/ca.key I0425 08:45:09.840711 450500 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/eblake/.minikube/proxy-client-ca.key I0425 08:45:09.840715 450500 certs.go:256] generating profile certs ... I0425 08:45:09.840753 450500 certs.go:363] generating signed profile cert for "minikube-user": /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/client.key I0425 08:45:09.840759 450500 crypto.go:68] Generating cert /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/client.crt with IP's: [] I0425 08:45:10.047408 450500 crypto.go:156] Writing cert to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/client.crt ... I0425 08:45:10.047418 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/client.crt: {Name:mk01c5f10e65b268d336ec3e17c4f33eec191e0b Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:10.047534 450500 crypto.go:164] Writing key to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/client.key ... I0425 08:45:10.047538 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/client.key: {Name:mk701023861eda8d37877e6a435711fb223c3368 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:10.047600 450500 certs.go:363] generating signed profile cert for "minikube": /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.key.33978711 I0425 08:45:10.047609 450500 crypto.go:68] Generating cert /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.crt.33978711 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.50.222] I0425 08:45:10.215175 450500 crypto.go:156] Writing cert to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.crt.33978711 ... I0425 08:45:10.215185 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.crt.33978711: {Name:mk78ac2a9fe61fcefba4de1d6b0d9e9a1c3e3c2e Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:10.215299 450500 crypto.go:164] Writing key to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.key.33978711 ... I0425 08:45:10.215304 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.key.33978711: {Name:mk0a400ae8fb6bc913f0332559b6dae05d5b9391 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:10.215361 450500 certs.go:381] copying /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.crt.33978711 -> /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.crt I0425 08:45:10.215536 450500 certs.go:385] copying /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.key.33978711 -> /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.key I0425 08:45:10.215718 450500 certs.go:363] generating signed profile cert for "aggregator": /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.key I0425 08:45:10.215733 450500 crypto.go:68] Generating cert /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.crt with IP's: [] I0425 08:45:10.448410 450500 crypto.go:156] Writing cert to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.crt ... I0425 08:45:10.448420 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.crt: {Name:mkf623ff323513c6374b2b4c386ff6d5cd211a1a Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:10.448527 450500 crypto.go:164] Writing key to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.key ... I0425 08:45:10.448532 450500 lock.go:35] WriteFile acquiring /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.key: {Name:mkd8c854d8a0310dd9e5ef040c7d068a53c7f67b Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:10.448655 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/ca-key.pem (1675 bytes) I0425 08:45:10.448682 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/ca.pem (1078 bytes) I0425 08:45:10.448697 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/cert.pem (1119 bytes) I0425 08:45:10.448713 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/key.pem (1675 bytes) I0425 08:45:10.449128 450500 ssh_runner.go:362] scp /home/eblake/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0425 08:45:10.470108 450500 ssh_runner.go:362] scp /home/eblake/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0425 08:45:10.489948 450500 ssh_runner.go:362] scp /home/eblake/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0425 08:45:10.509336 450500 ssh_runner.go:362] scp /home/eblake/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0425 08:45:10.527569 450500 ssh_runner.go:362] scp /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes) I0425 08:45:10.549938 450500 ssh_runner.go:362] scp /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes) I0425 08:45:10.571086 450500 ssh_runner.go:362] scp /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes) I0425 08:45:10.592598 450500 ssh_runner.go:362] scp /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes) I0425 08:45:10.615278 450500 ssh_runner.go:362] scp /home/eblake/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0425 08:45:10.634920 450500 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes) I0425 08:45:10.646852 450500 ssh_runner.go:195] Run: openssl version I0425 08:45:10.650608 450500 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0425 08:45:10.658257 450500 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0425 08:45:10.661034 450500 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 19 16:08 /usr/share/ca-certificates/minikubeCA.pem I0425 08:45:10.661069 450500 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0425 08:45:10.664867 450500 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0425 08:45:10.672323 450500 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt I0425 08:45:10.674821 450500 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1 stdout: stderr: stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory I0425 08:45:10.674858 450500 kubeadm.go:391] StartCluster: {Name:subprovisioner-test-2n-a KeepContext:true EmbedCerts:false MinikubeISO:https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2048 CPUs:2 DiskSize:5120 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.222 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/eblake:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} I0425 08:45:10.674953 450500 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}} I0425 08:45:10.687443 450500 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd I0425 08:45:10.693608 450500 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml I0425 08:45:10.700666 450500 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf I0425 08:45:10.707725 450500 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory I0425 08:45:10.707759 450500 kubeadm.go:156] found existing configuration files: I0425 08:45:10.707802 450500 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf I0425 08:45:10.713554 450500 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2 stdout: stderr: grep: /etc/kubernetes/admin.conf: No such file or directory I0425 08:45:10.713593 450500 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf I0425 08:45:10.720897 450500 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf I0425 08:45:10.727497 450500 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2 stdout: stderr: grep: /etc/kubernetes/kubelet.conf: No such file or directory I0425 08:45:10.727534 450500 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf I0425 08:45:10.734365 450500 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf I0425 08:45:10.741191 450500 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2 stdout: stderr: grep: /etc/kubernetes/controller-manager.conf: No such file or directory I0425 08:45:10.741229 450500 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf I0425 08:45:10.748225 450500 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf I0425 08:45:10.755365 450500 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2 stdout: stderr: grep: /etc/kubernetes/scheduler.conf: No such file or directory I0425 08:45:10.755420 450500 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf I0425 08:45:10.762363 450500 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem" I0425 08:45:10.827352 450500 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0 I0425 08:45:10.827412 450500 kubeadm.go:309] [preflight] Running pre-flight checks I0425 08:45:10.924926 450500 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster I0425 08:45:10.925032 450500 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection I0425 08:45:10.925112 450500 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull' I0425 08:45:11.165568 450500 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs" I0425 08:45:11.169394 450500 out.go:204] - Generating certificates and keys ... I0425 08:45:11.169472 450500 kubeadm.go:309] [certs] Using existing ca certificate authority I0425 08:45:11.169548 450500 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk I0425 08:45:11.288739 450500 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key I0425 08:45:11.471404 450500 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key I0425 08:45:11.553676 450500 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key I0425 08:45:11.675030 450500 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key I0425 08:45:11.828209 450500 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key I0425 08:45:11.828368 450500 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [localhost subprovisioner-test-2n-a] and IPs [192.168.50.222 127.0.0.1 ::1] I0425 08:45:11.897353 450500 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key I0425 08:45:11.897558 450500 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [localhost subprovisioner-test-2n-a] and IPs [192.168.50.222 127.0.0.1 ::1] I0425 08:45:12.271632 450500 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key I0425 08:45:12.341824 450500 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key I0425 08:45:12.566758 450500 kubeadm.go:309] [certs] Generating "sa" key and public key I0425 08:45:12.566855 450500 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes" I0425 08:45:12.788608 450500 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file I0425 08:45:13.062043 450500 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file I0425 08:45:13.419451 450500 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file I0425 08:45:13.575746 450500 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file I0425 08:45:13.805093 450500 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file I0425 08:45:13.805510 450500 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests" I0425 08:45:13.807427 450500 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests" I0425 08:45:13.832808 450500 out.go:204] - Booting up control plane ... I0425 08:45:13.832913 450500 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver" I0425 08:45:13.832978 450500 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager" I0425 08:45:13.833045 450500 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler" I0425 08:45:13.833131 450500 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env" I0425 08:45:13.833192 450500 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml" I0425 08:45:13.833223 450500 kubeadm.go:309] [kubelet-start] Starting the kubelet I0425 08:45:13.931749 450500 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests" I0425 08:45:13.931856 450500 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s I0425 08:45:14.432254 450500 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 500.691387ms I0425 08:45:14.432315 450500 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s I0425 08:45:21.432390 450500 kubeadm.go:309] [api-check] The API server is healthy after 7.002103049s I0425 08:45:21.465236 450500 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace I0425 08:45:21.501334 450500 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster I0425 08:45:21.567172 450500 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs I0425 08:45:21.567334 450500 kubeadm.go:309] [mark-control-plane] Marking the node subprovisioner-test-2n-a as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers] I0425 08:45:21.576415 450500 kubeadm.go:309] [bootstrap-token] Using token: u4tpzn.tmebteo38in0a3cz I0425 08:45:21.580441 450500 out.go:204] - Configuring RBAC rules ... I0425 08:45:21.580554 450500 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles I0425 08:45:21.591986 450500 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes I0425 08:45:21.615985 450500 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials I0425 08:45:21.623102 450500 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token I0425 08:45:21.628417 450500 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster I0425 08:45:21.634834 450500 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace I0425 08:45:21.841134 450500 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key I0425 08:45:22.280120 450500 kubeadm.go:309] [addons] Applied essential addon: CoreDNS I0425 08:45:22.840696 450500 kubeadm.go:309] [addons] Applied essential addon: kube-proxy I0425 08:45:22.841304 450500 kubeadm.go:309] I0425 08:45:22.841350 450500 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully! I0425 08:45:22.841352 450500 kubeadm.go:309] I0425 08:45:22.841424 450500 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user: I0425 08:45:22.841427 450500 kubeadm.go:309] I0425 08:45:22.841447 450500 kubeadm.go:309] mkdir -p $HOME/.kube I0425 08:45:22.841490 450500 kubeadm.go:309] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config I0425 08:45:22.841532 450500 kubeadm.go:309] sudo chown $(id -u):$(id -g) $HOME/.kube/config I0425 08:45:22.841534 450500 kubeadm.go:309] I0425 08:45:22.841575 450500 kubeadm.go:309] Alternatively, if you are the root user, you can run: I0425 08:45:22.841578 450500 kubeadm.go:309] I0425 08:45:22.841613 450500 kubeadm.go:309] export KUBECONFIG=/etc/kubernetes/admin.conf I0425 08:45:22.841615 450500 kubeadm.go:309] I0425 08:45:22.841654 450500 kubeadm.go:309] You should now deploy a pod network to the cluster. I0425 08:45:22.841709 450500 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at: I0425 08:45:22.841784 450500 kubeadm.go:309] https://kubernetes.io/docs/concepts/cluster-administration/addons/ I0425 08:45:22.841787 450500 kubeadm.go:309] I0425 08:45:22.841868 450500 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities I0425 08:45:22.841975 450500 kubeadm.go:309] and service account keys on each node and then running the following as root: I0425 08:45:22.841979 450500 kubeadm.go:309] I0425 08:45:22.842102 450500 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token u4tpzn.tmebteo38in0a3cz \ I0425 08:45:22.842236 450500 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:1a9a961cab1240cb2e82524f33a05f5813900a27173a0f3f534d3a2f974b1148 \ I0425 08:45:22.842263 450500 kubeadm.go:309] --control-plane I0425 08:45:22.842267 450500 kubeadm.go:309] I0425 08:45:22.842377 450500 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root: I0425 08:45:22.842381 450500 kubeadm.go:309] I0425 08:45:22.842490 450500 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token u4tpzn.tmebteo38in0a3cz \ I0425 08:45:22.842641 450500 kubeadm.go:309] --discovery-token-ca-cert-hash sha256:1a9a961cab1240cb2e82524f33a05f5813900a27173a0f3f534d3a2f974b1148 I0425 08:45:22.842793 450500 kubeadm.go:309] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service' I0425 08:45:22.842803 450500 cni.go:84] Creating CNI manager for "" I0425 08:45:22.842809 450500 cni.go:136] multinode detected (1 nodes found), recommending kindnet I0425 08:45:22.844997 450500 out.go:177] * Configuring CNI (Container Networking Interface) ... I0425 08:45:22.846591 450500 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap I0425 08:45:22.849630 450500 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0/kubectl ... I0425 08:45:22.849636 450500 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes) I0425 08:45:22.860587 450500 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml I0425 08:45:23.096104 450500 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj" I0425 08:45:23.096176 450500 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig I0425 08:45:23.096187 450500 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes subprovisioner-test-2n-a minikube.k8s.io/updated_at=2024_04_25T08_45_23_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=86fc9d54fca63f295d8737c8eacdbb7987e89c67 minikube.k8s.io/name=subprovisioner-test-2n-a minikube.k8s.io/primary=true I0425 08:45:23.103858 450500 ops.go:34] apiserver oom_adj: -16 I0425 08:45:23.193960 450500 kubeadm.go:1107] duration metric: took 97.830719ms to wait for elevateKubeSystemPrivileges W0425 08:45:23.206868 450500 kubeadm.go:286] apiserver tunnel failed: apiserver port not set I0425 08:45:23.206880 450500 kubeadm.go:393] duration metric: took 12.532025613s to StartCluster I0425 08:45:23.206891 450500 settings.go:142] acquiring lock: {Name:mk752f6da5982a4c6df0acbe94279ce9cc8417fc Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:23.206940 450500 settings.go:150] Updating kubeconfig: /home/eblake/.kube/config I0425 08:45:23.207818 450500 lock.go:35] WriteFile acquiring /home/eblake/.kube/config: {Name:mkbed33fba7cbb99942c300b87fff71b8c8ab908 Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:23.207942 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml" I0425 08:45:23.207960 450500 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.50.222 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true} I0425 08:45:23.210466 450500 out.go:177] * Verifying Kubernetes components... I0425 08:45:23.208023 450500 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] I0425 08:45:23.208125 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-a": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:45:23.217181 450500 addons.go:69] Setting storage-provisioner=true in profile "subprovisioner-test-2n-a" I0425 08:45:23.217183 450500 addons.go:69] Setting default-storageclass=true in profile "subprovisioner-test-2n-a" I0425 08:45:23.217205 450500 addons.go:234] Setting addon storage-provisioner=true in "subprovisioner-test-2n-a" I0425 08:45:23.217211 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:23.217213 450500 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "subprovisioner-test-2n-a" I0425 08:45:23.217233 450500 host.go:66] Checking if "subprovisioner-test-2n-a" exists ... I0425 08:45:23.217556 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:23.217562 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:23.217589 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:23.217706 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:23.231122 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42911 I0425 08:45:23.231362 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36437 I0425 08:45:23.231428 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:23.231638 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:23.231808 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:23.231819 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:23.231983 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:23.231993 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:23.232044 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:23.232157 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetState I0425 08:45:23.232194 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:23.232672 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:23.232699 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:23.242259 450500 addons.go:234] Setting addon default-storageclass=true in "subprovisioner-test-2n-a" I0425 08:45:23.242293 450500 host.go:66] Checking if "subprovisioner-test-2n-a" exists ... I0425 08:45:23.242631 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:23.242654 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:23.250064 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41141 I0425 08:45:23.250397 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:23.250808 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:23.250826 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:23.251084 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:23.251216 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetState I0425 08:45:23.257378 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:45:23.261859 450500 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5 I0425 08:45:23.259406 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36107 I0425 08:45:23.265529 450500 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml I0425 08:45:23.265537 450500 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes) I0425 08:45:23.265553 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:45:23.265792 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:23.266064 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:23.266072 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:23.266271 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:23.266707 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:23.266732 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:23.276919 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:23.278074 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:45:23.278091 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:23.278215 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:45:23.278340 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:45:23.278425 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:45:23.278511 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} I0425 08:45:23.281192 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36215 I0425 08:45:23.281485 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:23.281837 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:23.281845 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:23.282045 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:23.282157 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetState I0425 08:45:23.288226 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:45:23.288469 450500 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml I0425 08:45:23.288475 450500 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes) I0425 08:45:23.288487 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:45:23.299348 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:23.300707 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:45:23.300724 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:23.300839 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:45:23.300959 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:45:23.301061 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:45:23.301151 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} I0425 08:45:23.362706 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.50.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -" I0425 08:45:23.433633 450500 ssh_runner.go:195] Run: sudo systemctl start kubelet I0425 08:45:23.549141 450500 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml I0425 08:45:23.550527 450500 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml I0425 08:45:23.614145 450500 start.go:946] {"host.minikube.internal": 192.168.50.1} host record injected into CoreDNS's ConfigMap I0425 08:45:23.614781 450500 api_server.go:52] waiting for apiserver process to appear ... I0425 08:45:23.614814 450500 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.* I0425 08:45:23.881050 450500 main.go:141] libmachine: Making call to close driver server I0425 08:45:23.881050 450500 api_server.go:72] duration metric: took 673.074663ms to wait for apiserver process to appear ... I0425 08:45:23.881060 450500 api_server.go:88] waiting for apiserver healthz status ... I0425 08:45:23.881063 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .Close I0425 08:45:23.881072 450500 api_server.go:253] Checking apiserver healthz at https://192.168.50.222:8443/healthz ... I0425 08:45:23.881102 450500 main.go:141] libmachine: Making call to close driver server I0425 08:45:23.881112 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .Close I0425 08:45:23.881285 450500 main.go:141] libmachine: Successfully made call to close driver server I0425 08:45:23.881292 450500 main.go:141] libmachine: Making call to close connection to plugin binary I0425 08:45:23.881300 450500 main.go:141] libmachine: Making call to close driver server I0425 08:45:23.881306 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .Close I0425 08:45:23.881320 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Closing plugin on server side I0425 08:45:23.881345 450500 main.go:141] libmachine: Successfully made call to close driver server I0425 08:45:23.881349 450500 main.go:141] libmachine: Making call to close connection to plugin binary I0425 08:45:23.881354 450500 main.go:141] libmachine: Making call to close driver server I0425 08:45:23.881358 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .Close I0425 08:45:23.881550 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Closing plugin on server side I0425 08:45:23.881570 450500 main.go:141] libmachine: Successfully made call to close driver server I0425 08:45:23.881578 450500 main.go:141] libmachine: Making call to close connection to plugin binary I0425 08:45:23.881576 450500 main.go:141] libmachine: Successfully made call to close driver server I0425 08:45:23.881593 450500 main.go:141] libmachine: Making call to close connection to plugin binary I0425 08:45:23.888047 450500 api_server.go:279] https://192.168.50.222:8443/healthz returned 200: ok I0425 08:45:23.888709 450500 api_server.go:141] control plane version: v1.30.0 I0425 08:45:23.888722 450500 api_server.go:131] duration metric: took 7.655894ms to wait for apiserver health ... I0425 08:45:23.888729 450500 system_pods.go:43] waiting for kube-system pods to appear ... I0425 08:45:23.893463 450500 main.go:141] libmachine: Making call to close driver server I0425 08:45:23.893480 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .Close I0425 08:45:23.893657 450500 main.go:141] libmachine: Successfully made call to close driver server I0425 08:45:23.893666 450500 main.go:141] libmachine: Making call to close connection to plugin binary I0425 08:45:23.893678 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | Closing plugin on server side I0425 08:45:23.896980 450500 out.go:177] * Enabled addons: storage-provisioner, default-storageclass I0425 08:45:23.898858 450500 addons.go:505] duration metric: took 690.840758ms for enable addons: enabled=[storage-provisioner default-storageclass] I0425 08:45:23.896364 450500 system_pods.go:59] 5 kube-system pods found I0425 08:45:23.898889 450500 system_pods.go:61] "etcd-subprovisioner-test-2n-a" [630fbb8d-778b-4702-a923-bfd58cb7ea51] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd]) I0425 08:45:23.898896 450500 system_pods.go:61] "kube-apiserver-subprovisioner-test-2n-a" [ef18dab8-a44d-4ef5-b53f-765ffbef5679] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver]) I0425 08:45:23.898901 450500 system_pods.go:61] "kube-controller-manager-subprovisioner-test-2n-a" [2ae720fd-14f5-47b7-97c4-51772a3821e1] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager]) I0425 08:45:23.898907 450500 system_pods.go:61] "kube-scheduler-subprovisioner-test-2n-a" [2f00cdb3-8442-49fe-9f53-ca01f3cdad47] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler]) I0425 08:45:23.898911 450500 system_pods.go:61] "storage-provisioner" [b2b69909-278d-4d2b-a896-f347ba3e5539] Pending: PodScheduled:Unschedulable (0/1 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.) I0425 08:45:23.898916 450500 system_pods.go:74] duration metric: took 10.18344ms to wait for pod list to return data ... I0425 08:45:23.898924 450500 kubeadm.go:576] duration metric: took 690.950291ms to wait for: map[apiserver:true system_pods:true] I0425 08:45:23.898937 450500 node_conditions.go:102] verifying NodePressure condition ... I0425 08:45:23.901480 450500 node_conditions.go:122] node storage ephemeral capacity is 4482324Ki I0425 08:45:23.901490 450500 node_conditions.go:123] node cpu capacity is 2 I0425 08:45:23.901497 450500 node_conditions.go:105] duration metric: took 2.557362ms to run NodePressure ... I0425 08:45:23.901505 450500 start.go:240] waiting for startup goroutines ... I0425 08:45:24.117210 450500 kapi.go:248] "coredns" deployment in "kube-system" namespace and "subprovisioner-test-2n-a" context rescaled to 1 replicas I0425 08:45:24.117233 450500 start.go:245] waiting for cluster config update ... I0425 08:45:24.117243 450500 start.go:254] writing updated cluster config ... I0425 08:45:24.119829 450500 out.go:177] I0425 08:45:24.121640 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-a": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:45:24.121798 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-b": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:45:24.121862 450500 profile.go:143] Saving config to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/config.json ... I0425 08:45:24.123728 450500 out.go:177] * Starting "subprovisioner-test-2n-a-m02" worker node in "subprovisioner-test-2n-a" cluster I0425 08:45:24.129656 450500 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime docker I0425 08:45:24.129670 450500 cache.go:56] Caching tarball of preloaded images I0425 08:45:24.129729 450500 preload.go:173] Found /home/eblake/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download I0425 08:45:24.129734 450500 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on docker I0425 08:45:24.129784 450500 profile.go:143] Saving config to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/config.json ... I0425 08:45:24.129936 450500 start.go:360] acquireMachinesLock for subprovisioner-test-2n-a-m02: {Name:mkf7ef19c09ee03b82e3f02f4c680452e72cfa0d Clock:{} Delay:500ms Timeout:13m0s Cancel:} I0425 08:45:24.129991 450500 start.go:364] duration metric: took 45.587µs to acquireMachinesLock for "subprovisioner-test-2n-a-m02" I0425 08:45:24.130000 450500 start.go:93] Provisioning new machine with config: &{Name:subprovisioner-test-2n-a KeepContext:true EmbedCerts:false MinikubeISO:https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2048 CPUs:2 DiskSize:5120 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.222 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/eblake:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:false Worker:true} I0425 08:45:24.130049 450500 start.go:125] createHost starting for "m02" (driver="kvm2") I0425 08:45:24.132044 450500 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2048MB, Disk=5120MB) ... I0425 08:45:24.132085 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:24.132096 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:24.144012 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40799 I0425 08:45:24.144352 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:24.144696 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:24.144704 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:24.144876 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:24.144972 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetMachineName I0425 08:45:24.145045 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:24.145120 450500 start.go:159] libmachine.API.Create for "subprovisioner-test-2n-a" (driver="kvm2") I0425 08:45:24.145130 450500 client.go:168] LocalClient.Create starting I0425 08:45:24.145148 450500 main.go:141] libmachine: Reading certificate data from /home/eblake/.minikube/certs/ca.pem I0425 08:45:24.145166 450500 main.go:141] libmachine: Decoding PEM data... I0425 08:45:24.145175 450500 main.go:141] libmachine: Parsing certificate... I0425 08:45:24.145211 450500 main.go:141] libmachine: Reading certificate data from /home/eblake/.minikube/certs/cert.pem I0425 08:45:24.145224 450500 main.go:141] libmachine: Decoding PEM data... I0425 08:45:24.145230 450500 main.go:141] libmachine: Parsing certificate... I0425 08:45:24.145242 450500 main.go:141] libmachine: Running pre-create checks... I0425 08:45:24.145246 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .PreCreateCheck I0425 08:45:24.145328 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetConfigRaw I0425 08:45:24.145578 450500 main.go:141] libmachine: Creating machine... I0425 08:45:24.145582 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .Create I0425 08:45:24.145640 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Creating KVM machine... I0425 08:45:24.152057 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found existing default KVM network I0425 08:45:24.152209 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found existing private KVM network mk-subprovisioner-test-2n-a I0425 08:45:24.152291 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Setting up store path in /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02 ... I0425 08:45:24.152306 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Building disk image from file:///home/eblake/.minikube/cache/iso/amd64/download I0425 08:45:24.152364 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:24.152292 463714 common.go:145] Making disk image using store path: /home/eblake/.minikube I0425 08:45:24.152411 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Downloading /home/eblake/.minikube/cache/boot2docker.iso from file:///home/eblake/.minikube/cache/iso/amd64/download... I0425 08:45:24.153264 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:24.153242 463714 common.go:152] Creating ssh key: /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa... I0425 08:45:24.363198 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:24.363116 463714 common.go:158] Creating raw disk image: /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/subprovisioner-test-2n-a-m02.rawdisk... I0425 08:45:24.363255 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Writing magic tar header I0425 08:45:24.363274 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Writing SSH key tar header I0425 08:45:24.363306 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:24.363273 463714 common.go:172] Fixing permissions on /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02 ... I0425 08:45:24.363351 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Checking permissions on dir: /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02 I0425 08:45:24.363360 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Setting executable bit set on /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02 (perms=drwx------) I0425 08:45:24.363365 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Checking permissions on dir: /home/eblake/.minikube/machines I0425 08:45:24.363379 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Setting executable bit set on /home/eblake/.minikube/machines (perms=drwxr-xr-x) I0425 08:45:24.363388 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Checking permissions on dir: /home/eblake/.minikube I0425 08:45:24.363395 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Setting executable bit set on /home/eblake/.minikube (perms=drwxr-xr-x) I0425 08:45:24.363413 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Checking permissions on dir: /home/eblake I0425 08:45:24.363421 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Setting executable bit set on /home/eblake (perms=drwxr-xr-x) I0425 08:45:24.363436 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Creating domain... I0425 08:45:24.363450 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Checking permissions on dir: /home I0425 08:45:24.363457 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Skipping /home - not owner I0425 08:45:24.367853 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) define libvirt domain using xml: I0425 08:45:24.367874 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367881 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) subprovisioner-test-2n-a-m02 I0425 08:45:24.367886 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) 2048 I0425 08:45:24.367890 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) 2 I0425 08:45:24.367894 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367898 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367901 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367905 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367909 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367913 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367917 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367921 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367925 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367928 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367931 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) hvm I0425 08:45:24.367936 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367939 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367946 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367976 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367982 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367985 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367992 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.367995 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368022 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368032 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368041 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368048 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368056 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368059 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368064 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368068 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368073 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368076 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368080 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368083 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368087 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368094 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368101 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368106 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368110 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368113 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368118 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368123 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368128 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368133 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368140 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) /dev/random I0425 08:45:24.368145 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368151 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368156 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368160 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368164 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.368241 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) I0425 08:45:24.379941 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:c0:b1:10 in network default I0425 08:45:24.380870 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:24.380892 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Ensuring networks are active... I0425 08:45:24.390245 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Ensuring network default is active I0425 08:45:24.393209 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Ensuring network mk-subprovisioner-test-2n-a is active I0425 08:45:24.394135 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Getting domain xml... I0425 08:45:24.401171 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Creating domain... I0425 08:45:24.848320 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Waiting to get IP... I0425 08:45:24.849025 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:24.849376 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:24.849396 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:24.849370 463714 retry.go:31] will retry after 214.85136ms: waiting for machine to come up I0425 08:45:25.065696 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:25.066090 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:25.066113 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:25.066087 463714 retry.go:31] will retry after 287.446244ms: waiting for machine to come up I0425 08:45:25.355440 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:25.355887 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:25.355901 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:25.355861 463714 retry.go:31] will retry after 378.942861ms: waiting for machine to come up I0425 08:45:25.735826 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:25.736148 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:25.736159 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:25.736120 463714 retry.go:31] will retry after 395.586131ms: waiting for machine to come up I0425 08:45:26.133407 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:26.133756 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:26.133771 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:26.133739 463714 retry.go:31] will retry after 522.377089ms: waiting for machine to come up I0425 08:45:26.658167 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:26.658586 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:26.658605 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:26.658565 463714 retry.go:31] will retry after 817.620271ms: waiting for machine to come up I0425 08:45:27.477674 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:27.478028 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:27.478044 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:27.477994 463714 retry.go:31] will retry after 1.050937495s: waiting for machine to come up I0425 08:45:28.529744 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:28.529977 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:28.530019 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:28.529969 463714 retry.go:31] will retry after 1.185131986s: waiting for machine to come up I0425 08:45:29.716790 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:29.717173 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:29.717187 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:29.717131 463714 retry.go:31] will retry after 1.424515113s: waiting for machine to come up I0425 08:45:31.142818 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:31.143588 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:31.143604 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:31.143556 463714 retry.go:31] will retry after 1.822590713s: waiting for machine to come up I0425 08:45:32.968335 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:32.968642 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:32.968669 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:32.968630 463714 retry.go:31] will retry after 2.603726466s: waiting for machine to come up I0425 08:45:35.573872 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:35.574204 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:35.574220 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:35.574191 463714 retry.go:31] will retry after 2.185432213s: waiting for machine to come up I0425 08:45:37.762376 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:37.762773 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:37.762809 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:37.762767 463714 retry.go:31] will retry after 3.632404483s: waiting for machine to come up I0425 08:45:41.396787 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:41.397109 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find current IP address of domain subprovisioner-test-2n-a-m02 in network mk-subprovisioner-test-2n-a I0425 08:45:41.397126 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | I0425 08:45:41.397082 463714 retry.go:31] will retry after 4.504303773s: waiting for machine to come up I0425 08:45:45.902750 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:45.903075 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Found IP for machine: 192.168.50.25 I0425 08:45:45.903090 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has current primary IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:45.903099 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Reserving static IP address... I0425 08:45:45.905755 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | unable to find host DHCP lease matching {name: "subprovisioner-test-2n-a-m02", mac: "52:54:00:41:57:87", ip: "192.168.50.25"} in network mk-subprovisioner-test-2n-a I0425 08:45:46.083018 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Reserved static IP address: 192.168.50.25 I0425 08:45:46.083036 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Waiting for SSH to be available... I0425 08:45:46.083042 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Getting to WaitForSSH function... I0425 08:45:46.094086 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.095394 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:minikube Clientid:01:52:54:00:41:57:87} I0425 08:45:46.095408 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.095916 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Using SSH client type: external I0425 08:45:46.095925 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Using SSH private key: /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa (-rw-------) I0425 08:45:46.095942 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.50.25 -o IdentitiesOnly=yes -i /home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa -p 22] /usr/bin/ssh } I0425 08:45:46.095953 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | About to run SSH command: I0425 08:45:46.095964 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | exit 0 I0425 08:45:46.318809 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | SSH cmd err, output: : I0425 08:45:46.318998 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) KVM machine creation complete! I0425 08:45:46.319513 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetConfigRaw I0425 08:45:46.320548 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:46.320783 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:46.320913 450500 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes... I0425 08:45:46.320922 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetState I0425 08:45:46.326442 450500 main.go:141] libmachine: Detecting operating system of created instance... I0425 08:45:46.326455 450500 main.go:141] libmachine: Waiting for SSH to be available... I0425 08:45:46.326461 450500 main.go:141] libmachine: Getting to WaitForSSH function... I0425 08:45:46.326468 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:46.336614 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.338218 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:46.338270 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.338437 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:46.338629 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.338783 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.338911 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:46.339084 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:46.339355 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:46.339364 450500 main.go:141] libmachine: About to run SSH command: exit 0 I0425 08:45:46.449663 450500 main.go:141] libmachine: SSH cmd err, output: : I0425 08:45:46.449675 450500 main.go:141] libmachine: Detecting the provisioner... I0425 08:45:46.449682 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:46.460174 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.461320 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:46.461337 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.461498 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:46.461633 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.461741 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.461824 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:46.461931 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:46.462074 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:46.462078 450500 main.go:141] libmachine: About to run SSH command: cat /etc/os-release I0425 08:45:46.569080 450500 main.go:141] libmachine: SSH cmd err, output: : NAME=Buildroot VERSION=2023.02.9-2-gb5fa2c8c-dirty ID=buildroot VERSION_ID=2023.02.9 PRETTY_NAME="Buildroot 2023.02.9" I0425 08:45:46.569128 450500 main.go:141] libmachine: found compatible host: buildroot I0425 08:45:46.569134 450500 main.go:141] libmachine: Provisioning with buildroot... I0425 08:45:46.569141 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetMachineName I0425 08:45:46.569306 450500 buildroot.go:166] provisioning hostname "subprovisioner-test-2n-a-m02" I0425 08:45:46.569318 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetMachineName I0425 08:45:46.569421 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:46.578575 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.579723 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:46.579741 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.579857 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:46.579976 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.580090 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.580165 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:46.580256 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:46.580388 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:46.580394 450500 main.go:141] libmachine: About to run SSH command: sudo hostname subprovisioner-test-2n-a-m02 && echo "subprovisioner-test-2n-a-m02" | sudo tee /etc/hostname I0425 08:45:46.696108 450500 main.go:141] libmachine: SSH cmd err, output: : subprovisioner-test-2n-a-m02 I0425 08:45:46.696120 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:46.707976 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.709113 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:46.709131 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.709266 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:46.709385 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.709500 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:46.709591 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:46.709683 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:46.709799 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:46.709811 450500 main.go:141] libmachine: About to run SSH command: if ! grep -xq '.*\ssubprovisioner-test-2n-a-m02' /etc/hosts; then if grep -xq '127.0.1.1\s.*' /etc/hosts; then sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 subprovisioner-test-2n-a-m02/g' /etc/hosts; else echo '127.0.1.1 subprovisioner-test-2n-a-m02' | sudo tee -a /etc/hosts; fi fi I0425 08:45:46.821137 450500 main.go:141] libmachine: SSH cmd err, output: : I0425 08:45:46.821152 450500 buildroot.go:172] set auth options {CertDir:/home/eblake/.minikube CaCertPath:/home/eblake/.minikube/certs/ca.pem CaPrivateKeyPath:/home/eblake/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/eblake/.minikube/machines/server.pem ServerKeyPath:/home/eblake/.minikube/machines/server-key.pem ClientKeyPath:/home/eblake/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/eblake/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/eblake/.minikube} I0425 08:45:46.821163 450500 buildroot.go:174] setting up certificates I0425 08:45:46.821172 450500 provision.go:84] configureAuth start I0425 08:45:46.821179 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetMachineName I0425 08:45:46.821382 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetIP I0425 08:45:46.831631 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.833345 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:46.833363 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.833524 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:46.844884 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.846022 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:46.846040 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:46.846167 450500 provision.go:143] copyHostCerts I0425 08:45:46.846225 450500 exec_runner.go:144] found /home/eblake/.minikube/ca.pem, removing ... I0425 08:45:46.846230 450500 exec_runner.go:203] rm: /home/eblake/.minikube/ca.pem I0425 08:45:46.846274 450500 exec_runner.go:151] cp: /home/eblake/.minikube/certs/ca.pem --> /home/eblake/.minikube/ca.pem (1078 bytes) I0425 08:45:46.846366 450500 exec_runner.go:144] found /home/eblake/.minikube/cert.pem, removing ... I0425 08:45:46.846369 450500 exec_runner.go:203] rm: /home/eblake/.minikube/cert.pem I0425 08:45:46.846403 450500 exec_runner.go:151] cp: /home/eblake/.minikube/certs/cert.pem --> /home/eblake/.minikube/cert.pem (1119 bytes) I0425 08:45:46.846471 450500 exec_runner.go:144] found /home/eblake/.minikube/key.pem, removing ... I0425 08:45:46.846475 450500 exec_runner.go:203] rm: /home/eblake/.minikube/key.pem I0425 08:45:46.846500 450500 exec_runner.go:151] cp: /home/eblake/.minikube/certs/key.pem --> /home/eblake/.minikube/key.pem (1675 bytes) I0425 08:45:46.846769 450500 provision.go:117] generating server cert: /home/eblake/.minikube/machines/server.pem ca-key=/home/eblake/.minikube/certs/ca.pem private-key=/home/eblake/.minikube/certs/ca-key.pem org=eblake.subprovisioner-test-2n-a-m02 san=[127.0.0.1 192.168.50.25 localhost minikube subprovisioner-test-2n-a-m02] I0425 08:45:47.017470 450500 provision.go:177] copyRemoteCerts I0425 08:45:47.017814 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker I0425 08:45:47.017829 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:47.026583 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.027640 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:47.027662 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.027818 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:47.027934 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.028033 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:47.028108 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.25 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa Username:docker} I0425 08:45:47.106637 450500 ssh_runner.go:362] scp /home/eblake/.minikube/machines/server.pem --> /etc/docker/server.pem (1245 bytes) I0425 08:45:47.129221 450500 ssh_runner.go:362] scp /home/eblake/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes) I0425 08:45:47.153385 450500 ssh_runner.go:362] scp /home/eblake/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes) I0425 08:45:47.172189 450500 provision.go:87] duration metric: took 351.008326ms to configureAuth I0425 08:45:47.172202 450500 buildroot.go:189] setting minikube options for container-runtime I0425 08:45:47.172353 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-a": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:45:47.172366 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:47.172535 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:47.180851 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.181875 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:47.181887 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.182015 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:47.182128 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.182226 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.182296 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:47.182387 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:47.182514 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:47.182519 450500 main.go:141] libmachine: About to run SSH command: df --output=fstype / | tail -n 1 I0425 08:45:47.288770 450500 main.go:141] libmachine: SSH cmd err, output: : tmpfs I0425 08:45:47.288789 450500 buildroot.go:70] root file system type: tmpfs I0425 08:45:47.288946 450500 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ... I0425 08:45:47.288966 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:47.303765 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.305544 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:47.305563 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.305832 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:47.307225 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.307371 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.307463 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:47.307584 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:47.307737 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:47.307815 450500 main.go:141] libmachine: About to run SSH command: sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure Environment="NO_PROXY=192.168.50.222" # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP \$MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target " | sudo tee /lib/systemd/system/docker.service.new I0425 08:45:47.432015 450500 main.go:141] libmachine: SSH cmd err, output: : [Unit] Description=Docker Application Container Engine Documentation=https://docs.docker.com After=network.target minikube-automount.service docker.socket Requires= minikube-automount.service docker.socket StartLimitBurst=3 StartLimitIntervalSec=60 [Service] Type=notify Restart=on-failure Environment=NO_PROXY=192.168.50.222 # This file is a systemd drop-in unit that inherits from the base dockerd configuration. # The base configuration already specifies an 'ExecStart=...' command. The first directive # here is to clear out that command inherited from the base configuration. Without this, # the command from the base configuration and the command specified here are treated as # a sequence of commands, which is not the desired behavior, nor is it valid -- systemd # will catch this invalid input and refuse to start the service with an error like: # Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services. # NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other # container runtimes. If left unlimited, it may result in OOM issues with MySQL. ExecStart= ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 ExecReload=/bin/kill -s HUP $MAINPID # Having non-zero Limit*s causes performance problems due to accounting overhead # in the kernel. We recommend using cgroups to do container-local accounting. LimitNOFILE=infinity LimitNPROC=infinity LimitCORE=infinity # Uncomment TasksMax if your systemd version supports it. # Only systemd 226 and above support this version. TasksMax=infinity TimeoutStartSec=0 # set delegate yes so that systemd does not reset the cgroups of docker containers Delegate=yes # kill only the docker process, not all processes in the cgroup KillMode=process [Install] WantedBy=multi-user.target I0425 08:45:47.432029 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:47.441189 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.442485 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:47.442504 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:47.442637 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:47.442755 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.442862 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:47.442952 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:47.443102 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:47.443265 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:47.443292 450500 main.go:141] libmachine: About to run SSH command: sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; } I0425 08:45:49.149527 450500 main.go:141] libmachine: SSH cmd err, output: : diff: can't stat '/lib/systemd/system/docker.service': No such file or directory Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service. I0425 08:45:49.149541 450500 main.go:141] libmachine: Checking connection to Docker... I0425 08:45:49.149548 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetURL I0425 08:45:49.153341 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | Using libvirt version 10001000 I0425 08:45:49.160876 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.161879 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.161897 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.161982 450500 main.go:141] libmachine: Docker is up and running! I0425 08:45:49.161986 450500 main.go:141] libmachine: Reticulating splines... I0425 08:45:49.161990 450500 client.go:171] duration metric: took 25.016856517s to LocalClient.Create I0425 08:45:49.162014 450500 start.go:167] duration metric: took 25.016883305s to libmachine.API.Create "subprovisioner-test-2n-a" I0425 08:45:49.162023 450500 start.go:293] postStartSetup for "subprovisioner-test-2n-a-m02" (driver="kvm2") I0425 08:45:49.162030 450500 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs] I0425 08:45:49.162039 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:49.162192 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs I0425 08:45:49.162211 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:49.169217 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.170183 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.170195 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.170291 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:49.170416 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:49.170493 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:49.170567 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.25 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa Username:docker} I0425 08:45:49.247800 450500 ssh_runner.go:195] Run: cat /etc/os-release I0425 08:45:49.250721 450500 info.go:137] Remote host: Buildroot 2023.02.9 I0425 08:45:49.250736 450500 filesync.go:126] Scanning /home/eblake/.minikube/addons for local assets ... I0425 08:45:49.250791 450500 filesync.go:126] Scanning /home/eblake/.minikube/files for local assets ... I0425 08:45:49.250815 450500 start.go:296] duration metric: took 88.788897ms for postStartSetup I0425 08:45:49.250835 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetConfigRaw I0425 08:45:49.251349 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetIP I0425 08:45:49.261250 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.262346 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.262360 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.262517 450500 profile.go:143] Saving config to /home/eblake/.minikube/profiles/subprovisioner-test-2n-a/config.json ... I0425 08:45:49.262717 450500 start.go:128] duration metric: took 25.132661086s to createHost I0425 08:45:49.262730 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:49.271266 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.272538 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.272553 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.272691 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:49.272818 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:49.272918 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:49.273032 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:49.273129 450500 main.go:141] libmachine: Using SSH client type: native I0425 08:45:49.273249 450500 main.go:141] libmachine: &{{{ 0 [] [] []} docker [0x82d4e0] 0x830240 [] 0s} 192.168.50.25 22 } I0425 08:45:49.273254 450500 main.go:141] libmachine: About to run SSH command: date +%!s(MISSING).%!N(MISSING) I0425 08:45:49.380111 450500 main.go:141] libmachine: SSH cmd err, output: : 1714052749.358655642 I0425 08:45:49.380121 450500 fix.go:216] guest clock: 1714052749.358655642 I0425 08:45:49.380126 450500 fix.go:229] Guest: 2024-04-25 08:45:49.358655642 -0500 CDT Remote: 2024-04-25 08:45:49.262722792 -0500 CDT m=+71.487902774 (delta=95.93285ms) I0425 08:45:49.380141 450500 fix.go:200] guest clock delta is within tolerance: 95.93285ms I0425 08:45:49.380145 450500 start.go:83] releasing machines lock for "subprovisioner-test-2n-a-m02", held for 25.250148801s I0425 08:45:49.380162 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:49.380363 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetIP I0425 08:45:49.391423 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.393019 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.393045 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.398678 450500 out.go:177] * Found network options: I0425 08:45:49.402972 450500 out.go:177] - NO_PROXY=192.168.50.222 W0425 08:45:49.404799 450500 proxy.go:119] fail to check proxy env: Error ip not in block I0425 08:45:49.404825 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:49.405448 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName I0425 08:45:49.405629 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .DriverName W0425 08:45:49.405878 450500 proxy.go:119] fail to check proxy env: Error ip not in block I0425 08:45:49.406030 450500 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*" I0425 08:45:49.406046 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:49.406363 450500 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/ I0425 08:45:49.406400 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHHostname I0425 08:45:49.418912 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.420305 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.420326 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.420461 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:49.420600 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:49.420706 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:49.420801 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.25 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa Username:docker} I0425 08:45:49.421387 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.422576 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:49.422600 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:49.422748 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHPort I0425 08:45:49.422844 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHKeyPath I0425 08:45:49.422950 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetSSHUsername I0425 08:45:49.423053 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.25 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a-m02/id_rsa Username:docker} W0425 08:45:49.496203 450500 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found I0425 08:45:49.496256 450500 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ; I0425 08:45:49.659840 450500 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s) I0425 08:45:49.659869 450500 start.go:494] detecting cgroup driver to use... I0425 08:45:49.659984 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock " | sudo tee /etc/crictl.yaml" I0425 08:45:49.675779 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml" I0425 08:45:49.684102 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml" I0425 08:45:49.691803 450500 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver... I0425 08:45:49.691851 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml" I0425 08:45:49.699807 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0425 08:45:49.707321 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml" I0425 08:45:49.714883 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml" I0425 08:45:49.722901 450500 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk" I0425 08:45:49.730526 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml" I0425 08:45:49.738045 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml" I0425 08:45:49.746082 450500 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml" I0425 08:45:49.754877 450500 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables I0425 08:45:49.763870 450500 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward" I0425 08:45:49.771302 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:49.886413 450500 ssh_runner.go:195] Run: sudo systemctl restart containerd I0425 08:45:49.907278 450500 start.go:494] detecting cgroup driver to use... I0425 08:45:49.907337 450500 ssh_runner.go:195] Run: sudo systemctl cat docker.service I0425 08:45:49.922716 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd I0425 08:45:50.068662 450500 ssh_runner.go:195] Run: sudo systemctl stop -f containerd I0425 08:45:50.083588 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd I0425 08:45:50.095065 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0425 08:45:50.106395 450500 ssh_runner.go:195] Run: sudo systemctl stop -f crio I0425 08:45:50.154572 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio I0425 08:45:50.170957 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock " | sudo tee /etc/crictl.yaml" I0425 08:45:50.190286 450500 ssh_runner.go:195] Run: which cri-dockerd I0425 08:45:50.193294 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d I0425 08:45:50.201460 450500 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes) I0425 08:45:50.216312 450500 ssh_runner.go:195] Run: sudo systemctl unmask docker.service I0425 08:45:50.338921 450500 ssh_runner.go:195] Run: sudo systemctl enable docker.socket I0425 08:45:50.456281 450500 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver... I0425 08:45:50.456304 450500 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes) I0425 08:45:50.470439 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:50.603277 450500 ssh_runner.go:195] Run: sudo systemctl restart docker I0425 08:45:52.895610 450500 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.292315418s) I0425 08:45:52.895653 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket I0425 08:45:52.905594 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service I0425 08:45:52.915651 450500 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket I0425 08:45:53.019511 450500 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket I0425 08:45:53.125013 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:53.244658 450500 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket I0425 08:45:53.256795 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service I0425 08:45:53.266595 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:53.377324 450500 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service I0425 08:45:53.432148 450500 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock I0425 08:45:53.432623 450500 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock I0425 08:45:53.436371 450500 start.go:562] Will wait 60s for crictl version I0425 08:45:53.436424 450500 ssh_runner.go:195] Run: which crictl I0425 08:45:53.438847 450500 ssh_runner.go:195] Run: sudo /usr/bin/crictl version I0425 08:45:53.474290 450500 start.go:578] Version: 0.1.0 RuntimeName: docker RuntimeVersion: 25.0.4 RuntimeApiVersion: v1 I0425 08:45:53.474664 450500 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0425 08:45:53.491631 450500 ssh_runner.go:195] Run: docker version --format {{.Server.Version}} I0425 08:45:53.508479 450500 out.go:204] * Preparing Kubernetes v1.30.0 on Docker 25.0.4 ... I0425 08:45:53.514502 450500 out.go:177] - env NO_PROXY=192.168.50.222 I0425 08:45:53.516384 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) Calling .GetIP I0425 08:45:53.525848 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:53.526865 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:41:57:87", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:45:37 -0500 CDT Type:0 Mac:52:54:00:41:57:87 Iaid: IPaddr:192.168.50.25 Prefix:24 Hostname:subprovisioner-test-2n-a-m02 Clientid:01:52:54:00:41:57:87} I0425 08:45:53.526882 450500 main.go:141] libmachine: (subprovisioner-test-2n-a-m02) DBG | domain subprovisioner-test-2n-a-m02 has defined IP address 192.168.50.25 and MAC address 52:54:00:41:57:87 in network mk-subprovisioner-test-2n-a I0425 08:45:53.527038 450500 ssh_runner.go:195] Run: grep 192.168.50.1 host.minikube.internal$ /etc/hosts I0425 08:45:53.529571 450500 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.50.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0425 08:45:53.538803 450500 mustload.go:65] Loading cluster: subprovisioner-test-2n-a I0425 08:45:53.538931 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-a": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:45:53.539192 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:53.539208 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:53.554438 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42923 I0425 08:45:53.554753 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:53.555057 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:53.555065 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:53.555245 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:53.555346 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetState I0425 08:45:53.561404 450500 host.go:66] Checking if "subprovisioner-test-2n-a" exists ... I0425 08:45:53.561627 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:53.561653 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:53.574028 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35723 I0425 08:45:53.574365 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:53.574625 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:53.574633 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:53.574825 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:53.574924 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:45:53.575023 450500 certs.go:68] Setting up /home/eblake/.minikube/profiles/subprovisioner-test-2n-a for IP: 192.168.50.25 I0425 08:45:53.575029 450500 certs.go:194] generating shared ca certs ... I0425 08:45:53.575050 450500 certs.go:226] acquiring lock for ca certs: {Name:mk73484ff16617e22c86e8ccdad36aa85d03d96e Clock:{} Delay:500ms Timeout:1m0s Cancel:} I0425 08:45:53.575142 450500 certs.go:235] skipping valid "minikubeCA" ca cert: /home/eblake/.minikube/ca.key I0425 08:45:53.575196 450500 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/eblake/.minikube/proxy-client-ca.key I0425 08:45:53.575251 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/ca-key.pem (1675 bytes) I0425 08:45:53.575270 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/ca.pem (1078 bytes) I0425 08:45:53.575285 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/cert.pem (1119 bytes) I0425 08:45:53.575299 450500 certs.go:484] found cert: /home/eblake/.minikube/certs/key.pem (1675 bytes) I0425 08:45:53.575331 450500 ssh_runner.go:362] scp /home/eblake/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes) I0425 08:45:53.592060 450500 ssh_runner.go:362] scp /home/eblake/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes) I0425 08:45:53.610288 450500 ssh_runner.go:362] scp /home/eblake/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes) I0425 08:45:53.627874 450500 ssh_runner.go:362] scp /home/eblake/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes) I0425 08:45:53.646589 450500 ssh_runner.go:362] scp /home/eblake/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes) I0425 08:45:53.664522 450500 ssh_runner.go:195] Run: openssl version I0425 08:45:53.668589 450500 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem" I0425 08:45:53.676474 450500 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem I0425 08:45:53.679519 450500 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Dec 19 16:08 /usr/share/ca-certificates/minikubeCA.pem I0425 08:45:53.679579 450500 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem I0425 08:45:53.683389 450500 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0" I0425 08:45:53.690809 450500 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt I0425 08:45:53.693671 450500 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1 stdout: stderr: stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory I0425 08:45:53.693695 450500 kubeadm.go:928] updating node {m02 192.168.50.25 8443 v1.30.0 docker false true} ... I0425 08:45:53.693769 450500 kubeadm.go:940] kubelet [Unit] Wants=docker.socket [Service] ExecStart= ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=subprovisioner-test-2n-a-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.50.25 [Install] config: {KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} I0425 08:45:53.693823 450500 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0 I0425 08:45:53.700039 450500 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2 stdout: stderr: ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory Initiating transfer... I0425 08:45:53.700093 450500 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0 I0425 08:45:53.707087 450500 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256 I0425 08:45:53.707087 450500 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256 I0425 08:45:53.707087 450500 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256 I0425 08:45:53.707124 450500 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet I0425 08:45:53.707146 450500 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl I0425 08:45:53.707146 450500 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm I0425 08:45:53.719980 450500 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1 stdout: stderr: stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory I0425 08:45:53.719995 450500 ssh_runner.go:362] scp /home/eblake/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes) I0425 08:45:53.720050 450500 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1 stdout: stderr: stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory I0425 08:45:53.720057 450500 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet I0425 08:45:53.720065 450500 ssh_runner.go:362] scp /home/eblake/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes) I0425 08:45:53.742988 450500 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1 stdout: stderr: stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory I0425 08:45:53.743019 450500 ssh_runner.go:362] scp /home/eblake/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes) I0425 08:45:54.957035 450500 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system I0425 08:45:54.966714 450500 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (328 bytes) I0425 08:45:54.982025 450500 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes) I0425 08:45:54.996865 450500 ssh_runner.go:195] Run: grep 192.168.50.222 control-plane.minikube.internal$ /etc/hosts I0425 08:45:54.999627 450500 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.50.222 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts"" I0425 08:45:55.008570 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:55.131851 450500 ssh_runner.go:195] Run: sudo systemctl start kubelet I0425 08:45:55.154152 450500 host.go:66] Checking if "subprovisioner-test-2n-a" exists ... I0425 08:45:55.154420 450500 main.go:141] libmachine: Found binary path at /home/eblake/.minikube/bin/docker-machine-driver-kvm2 I0425 08:45:55.154435 450500 main.go:141] libmachine: Launching plugin server for driver kvm2 I0425 08:45:55.179641 450500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34137 I0425 08:45:55.180366 450500 main.go:141] libmachine: () Calling .GetVersion I0425 08:45:55.180940 450500 main.go:141] libmachine: Using API Version 1 I0425 08:45:55.180952 450500 main.go:141] libmachine: () Calling .SetConfigRaw I0425 08:45:55.181334 450500 main.go:141] libmachine: () Calling .GetMachineName I0425 08:45:55.181482 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .DriverName I0425 08:45:55.181613 450500 start.go:316] joinCluster: &{Name:subprovisioner-test-2n-a KeepContext:true EmbedCerts:false MinikubeISO:https://gitlab.com/subprovisioner/minikube/-/package_files/123597630/download KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.43@sha256:7ff490df401cc0fbf19a4521544ae8f4a00cc163e92a95017a8d8bfdb1422737 Memory:2048 CPUs:2 DiskSize:5120 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:subprovisioner-test-2n-a Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.50.222 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.50.25 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop: ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/eblake:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} I0425 08:45:55.181706 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0" I0425 08:45:55.181723 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHHostname I0425 08:45:55.200645 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:55.203042 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:45:16:af", ip: ""} in network mk-subprovisioner-test-2n-a: {Iface:virbr2 ExpiryTime:2024-04-25 09:44:50 -0500 CDT Type:0 Mac:52:54:00:45:16:af Iaid: IPaddr:192.168.50.222 Prefix:24 Hostname:subprovisioner-test-2n-a Clientid:01:52:54:00:45:16:af} I0425 08:45:55.203076 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) DBG | domain subprovisioner-test-2n-a has defined IP address 192.168.50.222 and MAC address 52:54:00:45:16:af in network mk-subprovisioner-test-2n-a I0425 08:45:55.203264 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHPort I0425 08:45:55.203491 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHKeyPath I0425 08:45:55.203674 450500 main.go:141] libmachine: (subprovisioner-test-2n-a) Calling .GetSSHUsername I0425 08:45:55.203836 450500 sshutil.go:53] new ssh client: &{IP:192.168.50.222 Port:22 SSHKeyPath:/home/eblake/.minikube/machines/subprovisioner-test-2n-a/id_rsa Username:docker} I0425 08:45:55.358759 450500 start.go:342] trying to join worker node "m02" to cluster: &{Name:m02 IP:192.168.50.25 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:false Worker:true} I0425 08:45:55.358785 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token t1prn0.rd3s6vzc81bc3nf3 --discovery-token-ca-cert-hash sha256:1a9a961cab1240cb2e82524f33a05f5813900a27173a0f3f534d3a2f974b1148 --ignore-preflight-errors=all --cri-socket unix:///var/run/cri-dockerd.sock --node-name=subprovisioner-test-2n-a-m02" I0425 08:45:56.295244 450500 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet" I0425 08:45:56.525502 450500 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes subprovisioner-test-2n-a-m02 minikube.k8s.io/updated_at=2024_04_25T08_45_56_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=86fc9d54fca63f295d8737c8eacdbb7987e89c67 minikube.k8s.io/name=subprovisioner-test-2n-a minikube.k8s.io/primary=false I0425 08:45:56.588073 450500 start.go:318] duration metric: took 1.406460139s to joinCluster I0425 08:45:56.588112 450500 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.50.25 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:docker ControlPlane:false Worker:true} I0425 08:45:56.593097 450500 out.go:177] * Verifying Kubernetes components... I0425 08:45:56.588375 450500 config.go:182] Loaded profile config "subprovisioner-test-2n-a": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.0 I0425 08:45:56.596531 450500 ssh_runner.go:195] Run: sudo systemctl daemon-reload I0425 08:45:56.695831 450500 ssh_runner.go:195] Run: sudo systemctl start kubelet I0425 08:45:56.707439 450500 kubeadm.go:576] duration metric: took 119.308217ms to wait for: map[apiserver:true system_pods:true] I0425 08:45:56.707457 450500 node_conditions.go:102] verifying NodePressure condition ... I0425 08:45:56.709465 450500 node_conditions.go:122] node storage ephemeral capacity is 4482324Ki I0425 08:45:56.709472 450500 node_conditions.go:123] node cpu capacity is 2 I0425 08:45:56.709478 450500 node_conditions.go:122] node storage ephemeral capacity is 4482324Ki I0425 08:45:56.709480 450500 node_conditions.go:123] node cpu capacity is 2 I0425 08:45:56.709483 450500 node_conditions.go:105] duration metric: took 2.023021ms to run NodePressure ... I0425 08:45:56.709490 450500 start.go:240] waiting for startup goroutines ... I0425 08:45:56.709506 450500 start.go:254] writing updated cluster config ... I0425 08:45:56.709693 450500 ssh_runner.go:195] Run: rm -f paused I0425 08:45:56.752179 450500 start.go:600] kubectl: 1.29.4, cluster: 1.30.0 (minor skew: 1) I0425 08:45:56.754158 450500 out.go:177] * To connect to this cluster, use: --context=subprovisioner-test-2n-a