Infinite time to (load?) and then it doen't even work??

[NerdHusky]

Hi. Sorry to bother you again. I didn't want to file a bug as I thought maybe the issue was on my side. But after numerous tries, having read eveything over and over it can't be a coincidence.
Every time I use ./launch it should open in my mind, I already downloaded the data.
But no, it starts donwnloading again. A lot. And then, at almost 10% from the finish it crashes. EVERY SINGLE TIME

=> ERROR [1/3] FROM docker.io/moyix/triton_with_ft:22.09@sha256:5a15c1f29c6b018967b49c588eb0ea67acbf897abb7f26e509ec21844574c9b1                                                     9424.3s
 => => resolve docker.io/moyix/triton_with_ft:22.09@sha256:5a15c1f29c6b018967b49c588eb0ea67acbf897abb7f26e509ec21844574c9b1                                                              0.0s
 => => sha256:5a15c1f29c6b018967b49c588eb0ea67acbf897abb7f26e509ec21844574c9b1 6.63kB / 6.63kB                                                                                           0.0s
 => => sha256:61ad5a82b2aa4c888a15ab025783a869ba7fcc4afebc298ae6c1db6d8c88d245 30.90kB / 30.90kB                                                                                         0.0s
 => => sha256:4256836e525fb6be06e949690b3678503e5634576ac06bf47d3f77b817014690 109.46MB / 109.46MB                                                                                     220.1s
 => => sha256:19f0d80655c9ce2e0b0f4c988a6129d02a80851532ac431639803b35ac9388fe 116.11MB / 116.11MB                                                                                     249.7s
 => => sha256:d7bfe07ed8476565a440c2113cc64d7c0409dba8ef761fb3ec019d7e6b5952df 28.57MB / 28.57MB                                                                                      1038.7s
 => => sha256:58206f9095ade1626a6a3631f360506c2e8a2d2db992f336f8403e7ac6616de9 182.12kB / 182.12kB                                                                                     221.0s
 => => sha256:d2a30fa05b2604a68a60e2d7ca7717a195811af7788717291ae097d3b508bb1c 105.91MB / 2.19GB                                                                                      9424.2s
 => => sha256:fc77cb5b926d5dded1900a15b90cbde73a8ef5c6332d5caa59e6f86fc796aebb 11.54kB / 11.54kB                                                                                       250.5s
 => => sha256:ef352a62ee1ad6992927650cbad5087f7a9c49f137d4cfaf3f1fda62205ecc83 187B / 187B                                                                                             251.2s
 => => sha256:a3bd3aeb5effd188cf6588b7b81ebe60c7206075131c78ce15343a34ce8282e2 5.11kB / 5.11kB                                                                                         251.8s
 => => sha256:1e4275fc348ac7f7e78cebd123240879b138a18d28f0beb2e7eb81fc0d793e89 139.30kB / 139.30kB                                                                                     252.9s
 => => sha256:c4ee4e3a08c4254f6a6606f6b48816f9cbee18a06932149806b33dfb71c725f5 40.73MB / 40.73MB                                                                                      1024.1s
 => => sha256:cec49411216ff5119f78d701933b1d9a67332b262a4864984cbc14591576fc02 89.19MB / 89.19MB                                                                                      1212.0s
 => => sha256:ba316fa6251763af102cd3986c3c816d3875ab38aeab678e982774c5ba4fece6 510B / 510B                                                                                            1046.9s
 => => extracting sha256:d7bfe07ed8476565a440c2113cc64d7c0409dba8ef761fb3ec019d7e6b5952df                                                                                                1.4s
 => => extracting sha256:4256836e525fb6be06e949690b3678503e5634576ac06bf47d3f77b817014690                                                                                                5.2s
 => => extracting sha256:19f0d80655c9ce2e0b0f4c988a6129d02a80851532ac431639803b35ac9388fe                                                                                                5.0s
 => => sha256:96c199ab7e47e7cf2c7904b658e5b0998e9a8bbe16fe65c09364813c8ad4d508 343.52MB / 343.52MB                                                                                    3946.1s
 => => extracting sha256:58206f9095ade1626a6a3631f360506c2e8a2d2db992f336f8403e7ac6616de9                                                                                                0.0s
 => => sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1 32B / 32B                                                                                              1213.5s
 => => sha256:9117ffb2d6c9c80f3d960b83180d957850c21589b071f26bce291912554161d9 1.85kB / 1.85kB                                                                                        1214.0s
 => => sha256:f3c931f6ec51555073fc0e6e774bb2818f144695e1278da53726c3d97ce462f3 33.49MB / 33.49MB                                                                                      1263.3s
 => => sha256:4f9f9e6af713c19ab3b3f98908a8bd3d84309d6bc267cf833bd19b96fe7736ce 223.12MB / 223.12MB                                                                                    1508.5s
 => => sha256:c02344e4bf2050ab3bc22c54f27818329425989133b6cb478455ab9af25cfeda 11.70kB / 11.70kB                                                                                      1509.8s
 => => sha256:1d64355c71c116b7921e8f99d2f7aa9546f9c3f23a5c2e42caec6dcd641e99ab 57.57MB / 57.57MB                                                                                      1563.0s
 => => sha256:0b73bcf5d4b7466ae8886232d1fd1dc46797fd356d7df48b6e62f0eca3f1c8fa 154B / 154B                                                                                            1563.5s
 => => sha256:4de67e4565c24fe85120e66fb98d2f959f9ed2c533366b3c79dadd9017b55003 759B / 759B                                                                                            1563.8s
 => => sha256:72c1f1a85bcc2f724643cf77e7cfa2a6fdc924b3f3413fc4a8966b7f65d59e5b 85.98MB / 2.05GB                                                                                       9424.2s
 => => sha256:89674754f7108241283a5471fceabe0cb61fdc0096696e7e60c53ac56cbbe6ce 2.80MB / 2.80MB                                                                                        3950.1s
 => => sha256:6c30ef9533b48071705d32c5542c9a26648da014e5d9f70a55db72ffb8b21fb9 1.96kB / 1.96kB                                                                                        3950.4s
 => => sha256:ee2229eb7915a6a32446ea1c6a1789ad6af05fb210493316ba0dae80fb026add 106.69MB / 106.69MB                                                                                    4061.5s
 => => sha256:f36b1c387933572355aa844233ecf033e2afa1edc6d5d3db6b37c4b14dbb2f52 4.15GB / 4.15GB                                                                                        9424.2s
 => => sha256:ea77bc02b274ed2e356491fef5e519978292b079f876556336561974ea0ea90f 133.88MB / 133.88MB                                                                                    5675.9s
 => => sha256:9fa86b1e8da475c00ba976b7037722c63d33fedeaa30f1c649451780c00fff7c 1.65kB / 1.65kB                                                                                        5036.4s
 => => sha256:5982b80a971a9924c1538c296da667072f834e34d2319aee5a142431e995c201 111B / 111B                                                                                            5037.4s 
 => => sha256:344ef016a1aed27cd5162fca0023020e219805b15e327eafc6bf5ba04e30f0ea 468.35kB / 468.35kB                                                                                    5042.6s
------
 > [1/3] FROM docker.io/moyix/triton_with_ft:22.09@sha256:5a15c1f29c6b018967b49c588eb0ea67acbf897abb7f26e509ec21844574c9b1:

Just a little proof from the last try. I have also another issue open (but not as a bug) which no one saw...

Best Regards and I hope that we can do something together....

[moyix]

cc @thakkarparth007 -- can we avoid doing a build here every time? Maybe make it a feature that you enable for developers but otherwise just pull an image from Docker Hub?

[thakkarparth007]

Yes, we can remove the build flag. Somehow it hadn't slowed my launches (I think), but taking another look at docker docs it seems --build builds the images even when not needed. So I think we can remove that safely.

[NerdHusky]

cc @thakkarparth007 -- can we avoid doing a build here every time? Maybe make it a feature that you enable for developers but otherwise just pull an image from Docker Hub?

Yeah please! And in the meantime, is there something I could do to download the docker image separately and then starting the server without having it redownload again? Like the the models I only downloaded once.

In the other thread, @monik3r in the other did say like:

It seems like you might be timing out while downloading or extracting the docker.io/moyix/triton_with_ft image. You could try to docker pull the image, though that wouldn't change your connection speed with docker.io.

Can someone elaborate on this?

[NerdHusky]

Sooo...I made it working in my case with this change in the lauch.sh file:

if [[ "$smaller" == "20.10.2" ]]; then
  # docker compose up $options --parallel 1
  docker compose up $options --remove-orphans --no-recreate
else
  docker-compose up $options --remove-orphans --build
fi;

I'm using NixOS btw, so if someone is interested I could make a pull request to have it packaged in nix. I would also like to improve the setup/iaunch shells scripts with a nice CLI to manage everything.
I don't know if this is a project open to contributions of this kind...