make sure the rust example in testground examples works

[laurentsenta]

No description provided.

[laurentsenta]

At the moment, trying to run the example, I get a sidecar error (on local machine, ubuntu server, stagin ipdx)

Apr 29 12:27:29.523437	�[34mINFO�[0m	0.7505s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.552671	�[34mINFO�[0m	resolved route to host	{"host": "testground-redis", "ip": "192.18.0.3"}
Apr 29 12:27:29.524434	�[34mINFO�[0m	started containers	{"runner": "local:docker", "run_id": "c9ltj8lvqc7ik10ovcm0", "count": 2}
Apr 29 12:27:29.524517	�[34mINFO�[0m	0.7515s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.553279	�[34mINFO�[0m	resolved route to host	{"host": "testground-sync-service", "ip": "192.18.0.4"}
Apr 29 12:27:29.525696	�[34mINFO�[0m	0.7527s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.553979	�[34mINFO�[0m	resolved route to host	{"host": "testground-influxdb", "ip": "192.18.0.5"}
Apr 29 12:27:29.526080	�[34mINFO�[0m	0.7814s �[30;47m   MESSAGE�[0m �[31m<< sidecar      >>�[0m InfluxDB unavailable; no metrics will be dispatched: no InfluxDB URL in $INFLUXDB_URL env var
Apr 29 12:27:29.530401	�[34mINFO�[0m	0.7574s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.557732	�[34mINFO�[0m	successfully resolved route to host	{"container_id": "4e323101ef3fd0775d85219145752028df36e4bc2f5fbd2cbdf214a54cd0ef7d"}
Apr 29 12:27:29.530480	�[34mINFO�[0m	0.7575s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.559004	�[34mINFO�[0m	external routing disabled
Apr 29 12:27:29.530517	�[34mINFO�[0m	0.7576s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.559072	�[34mINFO�[0m	waiting for all networks to be ready	{"sidecar": true, "run_id": "c9ltj8lvqc7ik10ovcm0"}
Apr 29 12:27:29.530620	�[34mINFO�[0m	0.7866s �[30;47m   MESSAGE�[0m �[31m<< sidecar      >>�[0m InfluxDB unavailable; no metrics will be dispatched: no InfluxDB URL in $INFLUXDB_URL env var
Apr 29 12:27:29.533352	�[34mINFO�[0m	0.7604s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.562208	�[31mERROR�[0m	sidecar worker failed: failed to initialise the container: failed to lookup the net namespace: no such file or directory	{"host": "unix:///var/run/docker.sock", "container": "39e959e903e1636d6c6ed0befc7bc67bfc1dea0762138e170c03df08f3352d44"}
Apr 29 12:27:29.576200	�[34mINFO�[0m	0.8032s �[37;45m     OTHER�[0m �[31m<< sidecar      >>�[0m Apr 29 12:27:29.605182	�[31mERROR�[0m	sidecar worker failed: container worker failed: failed to signal network ready: channel closed before getting response	{"host": "unix:///var/run/docker.sock", "container": "4e323101ef3fd0775d85219145752028df36e4bc2f5fbd2cbdf214a54cd0ef7d"}
Apr 29 12:27:29.578846	�[34mINFO�[0m	0.8059s �[37;101mINCOMPLETE�[0m �[32m<< single[001] (4e3231) >>�[0m 
Apr 29 12:27:29.578871	�[34mINFO�[0m	0.8059s �[37;101mINCOMPLETE�[0m �[33m<< single[000] (39e959) >>�[0m 
Apr 29 12:27:29.579152	�[34mINFO�[0m	deleting containers	{"runner": "local:docker", "run_id": "c9ltj8lvqc7ik10ovcm0", "ids": ["39e959e903e1636d6c6ed0befc7bc67bfc1dea0762138e170c03df08f3352d44", "4e323101ef3fd0775d85219145752028df36e4bc2f5fbd2cbdf214a54cd0ef7d"]}
Apr 29 12:27:29.579228	�[34mINFO�[0m	deleting container	{"runner": "local:docker", "run_id": "c9ltj8lvqc7ik10ovcm0", "id": "4e323101ef3fd0775d85219145752028df36e4bc2f5fbd2cbdf214a54cd0ef7d"}
Apr 29 12:27:29.579237	�[34mINFO�[0m	deleting container	{"runner": "local:docker", "run_id": "c9ltj8lvqc7ik10ovcm0", "id": "39e959e903e1636d6c6ed0befc7bc67bfc1dea0762138e170c03df08f3352d44"}
Apr 29 12:27:29.890251	�[33mWARN�[0m	run finished in error	{"run_id": "c9ltj8lvqc7ik10ovcm0", "plan": "example-rust", "case": "tcp-connect", "runner": "local:docker", "instances": 2, "error": "2 nodes failed"}

Something is broken with the sidecar,
using regular example and this branch:
https://github.com/testground/testground/tree/devx/improve-rust-tests
(current commit: testground/testground@cd1f83a)

Taking some time to figure out how to run debug tools with the sidecar (goland -> docker -> sidecar ran by testground)

[laurentsenta]

Debugging:

• change the Dockerfile.sidecar to start with dlv (inspiration from https://blog.jetbrains.com/go/2020/05/06/debugging-a-go-application-inside-a-docker-container/)
• change the local_docker.go runner to pass additional parameters (app armor, sys_ptrace), port binding, remove the entry point parameter (keep dlv),

see the commit: testground/testground@51cfc8b

• build again, make docker-sidecar && make doinstall && testground daemon

Run healthcheck to restart container:

testground healthcheck --runner local:docker --fix

The port mapping doesn't always work, but you can always docker inspect testground-sidecar, find the port and connect to it from the IDE.

[laurentsenta]

debug containers built & run with local docker:

--run-cfg keep_containers=true