Unable to hand in my .tar file due to unknown issues

[Christian-Stefan]

Hi.

For some reasons, which remain unknown to me, my submission appears to have been successfully uploaded on the server, yet when checking the leaderboard, the model doesn't show up. Using two different browsers for submission will make no difference, as I already undertook the same exercise via Microsoft Edge and Brave, yielding no success.

The image below displays the very message I am receiving stating that the submission was received by the server. However, as previously mentioned, the model's score does not show up, nor do I receive any confirmation email (already checked in both junk and spam folders).

To provide further information that might help in puzzling out this issue, I will share the code of the Docker image upon which the container was built. Furthermore, some minor modifications were done in the predict.py and train.py Python scripts. If you consider those to be of some interest, then let me know and I will attach the modified parts in the commentary section.

Dockerfile

FROM pytorch/pytorch:2.10.0-cuda12.6-cudnn9-runtime

ENV PYTHONDONTWRITEBYTECODE=1
ENV PYTHONUNBUFFERED=1

RUN apt-get update && apt-get install -y \
    python3 \
    python3-pip \
    python3-dev \
    python3-venv \
    && rm -rf /var/lib/apt/lists/*


# create virtual environment
RUN python3 -m venv /opt/venv
ENV PATH="/opt/venv/bin:$PATH"


# install dependencies (add any additional dependencies your project requires)
RUN pip install --no-cache-dir \
    torch torchvision --index-url https://download.pytorch.org/whl/cu126
RUN pip install --no-cache-dir \
    pillow

WORKDIR /app
COPY predict.py /app/predict.py
COPY model.py /app/model.py
COPY model.pt /app/model.pt

ENTRYPOINT ["python", "/app/predict.py"]

Lastly, none of these changes were negatively impacting the sanity check (step 4 in README-Submission.md) you recommended to be executed right before saving the image. The /input and /output are shown bellow

[TimJaspers0801]

This issue should be fixed, google suspended our email address that we used for this course causing an error in the evaluation code. Could you please try again.

[Christian-Stefan]

Hey @TimJaspers0801 ,
Apparently the email feature is up and running now since I received a comprehensive error log that is pretty much a blocking point due to which I cannot upload my submission to the server. I can see that the error stems from one of your back-end files, course-challenge-efficiency/runner.py," line 254, in run_submission. Could you help me debug this? Or at least confirm that your backend has no problem with downloading the weights of the EfficientNet family as I am using:

Part of the code in my model.py

  encoder_weights="imagenet",            # Start with pre-trained knowledge
        in_channels=3,                         # RGB input
        classes=30                            # 19 Cityscapes evaluation classes
    )

The error

Error details:
Traceback (most recent call last):
  File "/home/cclaess/Documents/course-challenge-efficiency/runner.py", line 254, in run_submission
    raise RuntimeError(
RuntimeError: Container exited with code 1
Logs:
'[Errno -3] Temporary failure in name resolution' thrown while requesting HEAD https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhuggingface.co%2Fsmp-hub%2Fefficientnet-b2.imagenet%2Fresolve%2Fa96d4f0295ffbae18ebba173bf7f3c0c8f21990e%2Fconfig.json&data=05%7C02%7Cc.gheorghiu1%40student.tue.nl%7Cf710632d002b46b2709308de8b4a6e89%7Ccc7df24760ce4a0f9d75704cf60efc64%7C0%7C0%7C639101349721228792%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C60000%7C%7C%7C&sdata=eHtMvu%2BIg0BZUJAKh3WfYqZF6Cyc5c5vzIS8u6iYJZs%3D&reserved=0
Retrying in 1s [Retry 1/5].
/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/encoders/__init__.py:136: UserWarning: Error loading efficientnet-b2 `imagenet` weights from Hugging Face Hub, trying loading from original url...
  warnings.warn(message, UserWarning)
Downloading: "https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Flukemelas%2FEfficientNet-PyTorch%2Freleases%2Fdownload%2F1.0%2Fefficientnet-b2-8bb594d6.pth&data=05%7C02%7Cc.gheorghiu1%40student.tue.nl%7Cf710632d002b46b2709308de8b4a6e89%7Ccc7df24760ce4a0f9d75704cf60efc64%7C0%7C0%7C639101349721252407%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C60000%7C%7C%7C&sdata=Q%2B1svKEtwIVAGGSgTVTgjl%2F7cPV0JRpVbHvXZ1%2FWRCM%3D&reserved=0" to /root/.cache/torch/hub/checkpoints/efficientnet-b2-8bb594d6.pth
Traceback (most recent call last):
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/encoders/__init__.py", line 126, in get_encoder
    hf_hub_download(repo_id, filename="config.json", revision=revision)
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 89, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 986, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1119, in _hf_hub_download_to_cache_dir
    _get_metadata_or_catch_error(
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1653, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 89, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1576, in get_hf_file_metadata
    response = _httpx_follow_relative_redirects_with_backoff(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 685, in _httpx_follow_relative_redirects_with_backoff
    response = http_backoff(
               ^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 559, in http_backoff
    return next(
           ^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 467, in _http_backoff_base
    response = client.request(method=method, url=url, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/httpx/_client.py", line 825, in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/httpx/_client.py", line 901, in send
    raise RuntimeError("Cannot send a request, as the client has been closed.")
RuntimeError: Cannot send a request, as the client has been closed.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.12/urllib/request.py", line 1344, in do_open
    h.request(req.get_method(), req.selector, req.data, headers,
  File "/usr/lib/python3.12/http/client.py", line 1356, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.12/http/client.py", line 1402, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.12/http/client.py", line 1351, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.12/http/client.py", line 1111, in _send_output
    self.send(msg)
  File "/usr/lib/python3.12/http/client.py", line 1055, in send
    self.connect()
  File "/usr/lib/python3.12/http/client.py", line 1490, in connect
    super().connect()
  File "/usr/lib/python3.12/http/client.py", line 1021, in connect
    self.sock = self._create_connection(
                ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/socket.py", line 828, in create_connection
    for res in getaddrinfo(host, port, 0, SOCK_STREAM):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/socket.py", line 963, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -3] Temporary failure in name resolution

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/app/predict.py", line 108, in <module>
    main()
  File "/app/predict.py", line 70, in main
    model = get_model()
            ^^^^^^^^^^^
  File "/app/model.py", line 33, in get_model
    return smp.Unet(
           ^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/base/hub_mixin.py", line 153, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/decoders/unet/model.py", line 132, in __init__
    self.encoder = get_encoder(
                   ^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/encoders/__init__.py", line 138, in get_encoder
    state_dict = load_url(url, map_location="cpu")
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/torch/hub.py", line 880, in load_state_dict_from_url
    download_url_to_file(url, cached_file, hash_prefix, progress=progress)
  File "/opt/venv/lib/python3.12/site-packages/torch/hub.py", line 736, in download_url_to_file
    with urlopen(req) as u:
         ^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 215, in urlopen
    return opener.open(url, data, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 515, in open
    response = self._open(req, data)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 532, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 492, in _call_chain
    result = func(*args)
             ^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 1392, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 1347, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution>



Container logs:
'[Errno -3] Temporary failure in name resolution' thrown while requesting HEAD https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhuggingface.co%2Fsmp-hub%2Fefficientnet-b2.imagenet%2Fresolve%2Fa96d4f0295ffbae18ebba173bf7f3c0c8f21990e%2Fconfig.json&data=05%7C02%7Cc.gheorghiu1%40student.tue.nl%7Cf710632d002b46b2709308de8b4a6e89%7Ccc7df24760ce4a0f9d75704cf60efc64%7C0%7C0%7C639101349721267488%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C60000%7C%7C%7C&sdata=zzI9EGgy6PPZeaXath%2B3kUkIvbc1UlM9k5w2oOGBdNE%3D&reserved=0
Retrying in 1s [Retry 1/5].
/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/encoders/__init__.py:136: UserWarning: Error loading efficientnet-b2 `imagenet` weights from Hugging Face Hub, trying loading from original url...
  warnings.warn(message, UserWarning)
Downloading: "https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Flukemelas%2FEfficientNet-PyTorch%2Freleases%2Fdownload%2F1.0%2Fefficientnet-b2-8bb594d6.pth&data=05%7C02%7Cc.gheorghiu1%40student.tue.nl%7Cf710632d002b46b2709308de8b4a6e89%7Ccc7df24760ce4a0f9d75704cf60efc64%7C0%7C0%7C639101349721284869%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C60000%7C%7C%7C&sdata=lPfDJtwWyN%2BOSJTb94RAyRSHNhq4TtQQjhw%2BedP6wbE%3D&reserved=0" to /root/.cache/torch/hub/checkpoints/efficientnet-b2-8bb594d6.pth
Traceback (most recent call last):
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/encoders/__init__.py", line 126, in get_encoder
    hf_hub_download(repo_id, filename="config.json", revision=revision)
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 89, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 986, in hf_hub_download
    return _hf_hub_download_to_cache_dir(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1119, in _hf_hub_download_to_cache_dir
    _get_metadata_or_catch_error(
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1653, in _get_metadata_or_catch_error
    metadata = get_hf_file_metadata(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 89, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/file_download.py", line 1576, in get_hf_file_metadata
    response = _httpx_follow_relative_redirects_with_backoff(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 685, in _httpx_follow_relative_redirects_with_backoff
    response = http_backoff(
               ^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 559, in http_backoff
    return next(
           ^^^^^
  File "/opt/venv/lib/python3.12/site-packages/huggingface_hub/utils/_http.py", line 467, in _http_backoff_base
    response = client.request(method=method, url=url, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/httpx/_client.py", line 825, in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/httpx/_client.py", line 901, in send
    raise RuntimeError("Cannot send a request, as the client has been closed.")
RuntimeError: Cannot send a request, as the client has been closed.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.12/urllib/request.py", line 1344, in do_open
    h.request(req.get_method(), req.selector, req.data, headers,
  File "/usr/lib/python3.12/http/client.py", line 1356, in request
    self._send_request(method, url, body, headers, encode_chunked)
  File "/usr/lib/python3.12/http/client.py", line 1402, in _send_request
    self.endheaders(body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.12/http/client.py", line 1351, in endheaders
    self._send_output(message_body, encode_chunked=encode_chunked)
  File "/usr/lib/python3.12/http/client.py", line 1111, in _send_output
    self.send(msg)
  File "/usr/lib/python3.12/http/client.py", line 1055, in send
    self.connect()
  File "/usr/lib/python3.12/http/client.py", line 1490, in connect
    super().connect()
  File "/usr/lib/python3.12/http/client.py", line 1021, in connect
    self.sock = self._create_connection(
                ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/socket.py", line 828, in create_connection
    for res in getaddrinfo(host, port, 0, SOCK_STREAM):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/socket.py", line 963, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
socket.gaierror: [Errno -3] Temporary failure in name resolution

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/app/predict.py", line 108, in <module>
    main()
  File "/app/predict.py", line 70, in main
    model = get_model()
            ^^^^^^^^^^^
  File "/app/model.py", line 33, in get_model
    return smp.Unet(
           ^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/base/hub_mixin.py", line 153, in wrapper
    return func(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/decoders/unet/model.py", line 132, in __init__
    self.encoder = get_encoder(
                   ^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/segmentation_models_pytorch/encoders/__init__.py", line 138, in get_encoder
    state_dict = load_url(url, map_location="cpu")
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/venv/lib/python3.12/site-packages/torch/hub.py", line 880, in load_state_dict_from_url
    download_url_to_file(url, cached_file, hash_prefix, progress=progress)
  File "/opt/venv/lib/python3.12/site-packages/torch/hub.py", line 736, in download_url_to_file
    with urlopen(req) as u:
         ^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 215, in urlopen
    return opener.open(url, data, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 515, in open
    response = self._open(req, data)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 532, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 492, in _call_chain
    result = func(*args)
             ^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 1392, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/urllib/request.py", line 1347, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution>

[caetas]

Hi @Christian-Stefan, it looks like you are loading a model from HuggingFace. Even if you have the weights saved locally, your code is trying to fetch the config.json file from HF (which throws out an error because you don't have internet access during evaluation on the server).

It should be an easy fix, though!