Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add MinkowskiEngine #23

Merged
merged 1 commit into from May 2, 2023
Merged

Conversation

akisman
Copy link
Contributor

@akisman akisman commented Apr 29, 2023

This pull request adds MinkowskiEngine, an auto-diff neural network library for high-dimensional sparse tensors from NVIDIA.

Because the base CUDA image doesn't include the development tools needed to build the library I've updated it to the devel image. Hopefully this isn't an issue since it's in essence the same image but also includes headers & development tools. Reference: https://hub.docker.com/r/nvidia/cuda

@ejm714
Copy link
Collaborator

ejm714 commented May 2, 2023

@akisman Thanks for following the style of the previous PR for this add. Can you do the following:

  • run make build and share the size of the new image (and comparisons with the previous one) for GPU and CPU
  • run make pack-example and make test-submission and drop the logs here so we can confirm that the benchmark code still runs without error using the updated image

If that all looks good, we'll be able to merge.

@akisman
Copy link
Contributor Author

akisman commented May 2, 2023

@ejm714 Sure thing! I've pasted the image size for CPU and GPU below (Github actions build both without issue) and the log file form make pack-example && make test-submission.

Image Size

Before:
visiomelmelanoma-competition:cpu-local      5.43GB
visiomelmelanoma-competition:gpu-local      10.8GB

After:
visiomelmelanoma-competition:cpu-local      9.26GB
visiomelmelanoma-competition:gpu-local      14.7GB

Example Submission Log

+ expected_filename=main.py
+ cd /code_execution
++ zip -sf ./submission/submission.zip
+ submission_files='Archive contains:
  assets/
  assets/history_encoder.joblib
  assets/random_forest_model.joblib
  main.py
Total 4 entries (7673185 bytes)'
+ grep -q main.py
+ echo Installed packages
Installed packages
+ echo '######################################'
######################################
+ conda list -n condaenv
# packages in environment at /opt/conda/envs/condaenv:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                  2_kmp_llvm    conda-forge
_py-xgboost-mutex         2.0                       cpu_0    conda-forge
absl-py                   1.4.0              pyhd8ed1ab_0    conda-forge
aiohttp                   3.7.4.post0     py310h6acc77f_1    conda-forge
aom                       3.5.0                h27087fc_0    conda-forge
arrow-cpp                 11.0.0           ha770c72_5_cpu    conda-forge
astunparse                1.6.3              pyhd8ed1ab_0    conda-forge
async-timeout             3.0.1                   py_1000    conda-forge
atk-1.0                   2.38.0               hd4edc92_1    conda-forge
attrs                     22.2.0             pyh71513ae_0    conda-forge
aws-c-auth                0.6.24               h84a1944_5    conda-forge
aws-c-cal                 0.5.20               hc60faf5_6    conda-forge
aws-c-common              0.8.11               h0b41bf4_0    conda-forge
aws-c-compression         0.2.16               h034cb4b_3    conda-forge
aws-c-event-stream        0.2.18               h75388cd_6    conda-forge
aws-c-http                0.7.4                hf084cc8_2    conda-forge
aws-c-io                  0.13.17              h10df833_2    conda-forge
aws-c-mqtt                0.8.6                hc41645a_6    conda-forge
aws-c-s3                  0.2.4                h1b8f470_3    conda-forge
aws-c-sdkutils            0.1.7                h034cb4b_3    conda-forge
aws-checksums             0.1.14               h034cb4b_3    conda-forge
aws-crt-cpp               0.19.7               h0073717_7    conda-forge
aws-sdk-cpp               1.10.57              h4707e7a_4    conda-forge
blinker                   1.6.2              pyhd8ed1ab_0    conda-forge
blosc                     1.21.3               hafa529b_0    conda-forge
boost-cpp                 1.78.0               h5adbc97_2    conda-forge
brotli                    1.0.9                h166bdaf_8    conda-forge
brotli-bin                1.0.9                h166bdaf_8    conda-forge
brotlipy                  0.7.0           py310h5764c6d_1005    conda-forge
brunsli                   0.1                  h9c3ff4c_0    conda-forge
bzip2                     1.0.8                h7f98852_4    conda-forge
c-ares                    1.18.1               h7f98852_0    conda-forge
c-blosc2                  2.8.0                hf91038e_1    conda-forge
ca-certificates           2022.12.7            ha878542_0    conda-forge
cached-property           1.5.2                hd8ed1ab_1    conda-forge
cached_property           1.5.2              pyha770c72_1    conda-forge
cachetools                5.3.0              pyhd8ed1ab_0    conda-forge
cairo                     1.16.0            ha61ee94_1014    conda-forge
certifi                   2022.12.7          pyhd8ed1ab_0    conda-forge
cffi                      1.15.1          py310h255011f_3    conda-forge
cfitsio                   4.2.0                hd9d235c_0    conda-forge
chardet                   4.0.0           py310hff52083_3    conda-forge
charls                    2.4.1                hcb278e6_0    conda-forge
charset-normalizer        3.1.0              pyhd8ed1ab_0    conda-forge
click                     8.1.3           unix_pyhd8ed1ab_2    conda-forge
cloudpickle               2.2.1              pyhd8ed1ab_0    conda-forge
colorama                  0.4.6              pyhd8ed1ab_0    conda-forge
contourpy                 1.0.7                    pypi_0    pypi
cryptography              40.0.2          py310h34c0648_0    conda-forge
cycler                    0.11.0                   pypi_0    pypi
cytoolz                   0.12.0          py310h5764c6d_1    conda-forge
dask-core                 2023.4.1           pyhd8ed1ab_0    conda-forge
dataclasses               0.8                pyhc8e2a94_3    conda-forge
datasets                  2.12.0             pyhd8ed1ab_0    conda-forge
dav1d                     1.0.0                h166bdaf_1    conda-forge
dill                      0.3.6              pyhd8ed1ab_1    conda-forge
efficientnet-pytorch      0.6.3              pyh9f0ad1d_0    conda-forge
eigen                     3.4.0                h4bd325d_0    conda-forge
einops                    0.6.1              pyhd8ed1ab_0    conda-forge
exceptiongroup            1.1.1              pyhd8ed1ab_0    conda-forge
expat                     2.5.0                hcb278e6_1    conda-forge
fftw                      3.3.10          nompi_hc118613_107    conda-forge
filelock                  3.12.0             pyhd8ed1ab_0    conda-forge
flatbuffers               22.12.06             hcb278e6_2    conda-forge
font-ttf-dejavu-sans-mono 2.37                 hab24e00_0    conda-forge
font-ttf-inconsolata      3.000                h77eed37_0    conda-forge
font-ttf-source-code-pro  2.038                h77eed37_0    conda-forge
font-ttf-ubuntu           0.83                 hab24e00_0    conda-forge
fontconfig                2.14.2               h14ed4e7_0    conda-forge
fonts-conda-ecosystem     1                             0    conda-forge
fonts-conda-forge         1                             0    conda-forge
fonttools                 4.39.3                   pypi_0    pypi
freetype                  2.12.1               hca18f0e_1    conda-forge
fribidi                   1.0.10               h36c2ea0_0    conda-forge
fsspec                    2023.4.0           pyh1a96a4e_0    conda-forge
gast                      0.4.0              pyh9f0ad1d_0    conda-forge
gdk-pixbuf                2.42.10              h05c8ddd_0    conda-forge
geos                      3.11.2               hcb278e6_0    conda-forge
gettext                   0.21.1               h27087fc_0    conda-forge
gflags                    2.2.2             he1b5a44_1004    conda-forge
ghostscript               9.54.0               h27087fc_2    conda-forge
giflib                    5.2.1                h0b41bf4_3    conda-forge
glib                      2.76.2               hfc55251_0    conda-forge
glib-tools                2.76.2               hfc55251_0    conda-forge
glog                      0.6.0                h6f12383_0    conda-forge
google-auth               2.17.3             pyh1a96a4e_0    conda-forge
google-auth-oauthlib      0.4.6              pyhd8ed1ab_0    conda-forge
google-pasta              0.2.0              pyh8c360ce_0    conda-forge
graphite2                 1.3.13            h58526e2_1001    conda-forge
graphviz                  7.1.0                h2e5815a_0    conda-forge
grpcio                    1.51.1          py310h4a5735c_1    conda-forge
gstreamer-orc             0.4.33               h166bdaf_0    conda-forge
gtk2                      2.24.33              h90689f9_2    conda-forge
gts                       0.7.6                h64030ff_2    conda-forge
h5py                      3.8.0           nompi_py310ha66b2ad_101    conda-forge
harfbuzz                  6.0.0                h8e241bc_0    conda-forge
hdf5                      1.14.0          nompi_hb72d44e_103    conda-forge
huggingface_hub           0.14.1             pyhd8ed1ab_0    conda-forge
icu                       70.1                 h27087fc_0    conda-forge
idna                      3.4                pyhd8ed1ab_0    conda-forge
imagecodecs               2023.1.23       py310ha3ed6a1_0    conda-forge
imageio                   2.28.0             pyh24c5eb1_0    conda-forge
imagemagick               7.1.1_5         pl5321h211c493_1    conda-forge
importlib-metadata        6.6.0              pyha770c72_0    conda-forge
importlib_metadata        6.6.0                hd8ed1ab_0    conda-forge
iniconfig                 2.0.0              pyhd8ed1ab_0    conda-forge
jbig                      2.1               h7f98852_2003    conda-forge
joblib                    1.2.0              pyhd8ed1ab_0    conda-forge
jpeg                      9e                   h0b41bf4_3    conda-forge
jxrlib                    1.1                  h7f98852_2    conda-forge
keras                     2.11.0             pyhd8ed1ab_0    conda-forge
keras-preprocessing       1.1.2              pyhd8ed1ab_0    conda-forge
keyutils                  1.6.1                h166bdaf_0    conda-forge
kiwisolver                1.4.4                    pypi_0    pypi
krb5                      1.20.1               h81ceb04_0    conda-forge
lcms2                     2.15                 hfd0df8a_0    conda-forge
ld_impl_linux-64          2.40                 h41732ed_0    conda-forge
lerc                      4.0.0                h27087fc_0    conda-forge
libabseil                 20220623.0      cxx17_h05df665_6    conda-forge
libaec                    1.0.6                hcb278e6_1    conda-forge
libarrow                  11.0.0           h2ebd325_5_cpu    conda-forge
libavif                   0.11.1               h5cdd6b5_0    conda-forge
libblas                   3.9.0           16_linux64_openblas    conda-forge
libbrotlicommon           1.0.9                h166bdaf_8    conda-forge
libbrotlidec              1.0.9                h166bdaf_8    conda-forge
libbrotlienc              1.0.9                h166bdaf_8    conda-forge
libcblas                  3.9.0           16_linux64_openblas    conda-forge
libcrc32c                 1.1.2                h9c3ff4c_0    conda-forge
libcurl                   8.0.1                h588be90_0    conda-forge
libdeflate                1.17                 h0b41bf4_0    conda-forge
libedit                   3.1.20191231         he28a2e2_2    conda-forge
libev                     4.33                 h516909a_1    conda-forge
libevent                  2.1.10               h28343ad_4    conda-forge
libexif                   0.6.21               h7f98852_0    conda-forge
libexpat                  2.5.0                hcb278e6_1    conda-forge
libffi                    3.4.2                h7f98852_5    conda-forge
libgcc-ng                 12.2.0              h65d4601_19    conda-forge
libgd                     2.3.3                h5aea950_4    conda-forge
libgfortran-ng            12.2.0              h69a702a_19    conda-forge
libgfortran5              12.2.0              h337968e_19    conda-forge
libglib                   2.76.2               hebfc3b9_0    conda-forge
libgoogle-cloud           2.7.0                h21dfe5b_1    conda-forge
libgrpc                   1.51.1               h4fad500_1    conda-forge
libgsf                    1.14.50              he99f2b3_0    conda-forge
libhwloc                  2.9.1                hd6dc26d_0    conda-forge
libiconv                  1.17                 h166bdaf_0    conda-forge
liblapack                 3.9.0           16_linux64_openblas    conda-forge
libllvm11                 11.1.0               he0ac6c6_5    conda-forge
libmatio                  1.5.23               he7c39e3_2    conda-forge
libnghttp2                1.52.0               h61bc06f_0    conda-forge
libnsl                    2.0.0                h7f98852_0    conda-forge
libopenblas               0.3.21          pthreads_h78a6416_3    conda-forge
libpng                    1.6.39               h753d276_0    conda-forge
libprotobuf               3.21.12              h3eb15da_0    conda-forge
librsvg                   2.54.4               h7abd40a_0    conda-forge
libspatialindex           1.9.3                h9c3ff4c_4    conda-forge
libsqlite                 3.40.0               h753d276_1    conda-forge
libssh2                   1.10.0               hf14f497_3    conda-forge
libstdcxx-ng              12.2.0              h46fd767_19    conda-forge
libthrift                 0.18.0               h5e4af38_0    conda-forge
libtiff                   4.5.0                h6adf6a1_2    conda-forge
libtool                   2.4.7                h27087fc_0    conda-forge
libutf8proc               2.8.0                h166bdaf_0    conda-forge
libuuid                   2.38.1               h0b41bf4_0    conda-forge
libvips                   8.13.3               h332b9f1_7    conda-forge
libwebp                   1.2.4                h1daa5a0_1    conda-forge
libwebp-base              1.2.4                h166bdaf_0    conda-forge
libxcb                    1.13              h7f98852_1004    conda-forge
libxgboost                1.7.4            cpu_h6e95104_0    conda-forge
libxml2                   2.10.3               hca2bb57_4    conda-forge
libzlib                   1.2.13               h166bdaf_4    conda-forge
libzopfli                 1.0.3                h9c3ff4c_0    conda-forge
lightning-utilities       0.8.0              pyhd8ed1ab_0    conda-forge
llvm-openmp               16.0.2               h4dfa4b3_0    conda-forge
llvmlite                  0.39.1          py310h58363a5_1    conda-forge
locket                    1.0.0              pyhd8ed1ab_0    conda-forge
loguru                    0.6.0           py310hff52083_2    conda-forge
lz4-c                     1.9.4                hcb278e6_0    conda-forge
markdown                  3.4.3              pyhd8ed1ab_0    conda-forge
markupsafe                2.1.2           py310h1fa729e_0    conda-forge
matplotlib                3.7.1                    pypi_0    pypi
minkowskiengine           0.5.4                    pypi_0    pypi
mkl                       2022.2.1         h84fe81f_16997    conda-forge
multidict                 6.0.4           py310h1fa729e_0    conda-forge
multiprocess              0.70.14         py310h5764c6d_3    conda-forge
munch                     2.5.0                      py_0    conda-forge
ncurses                   6.3                  h27087fc_1    conda-forge
networkx                  3.0                pyhd8ed1ab_0    conda-forge
nspr                      4.35                 h27087fc_0    conda-forge
nss                       3.89                 he45b914_0    conda-forge
numba                     0.56.4          py310h0e39c9b_1    conda-forge
numpy                     1.23.5          py310h53a5b5f_0    conda-forge
oauthlib                  3.2.2              pyhd8ed1ab_0    conda-forge
opencv-python             4.7.0.72                 pypi_0    pypi
opencv-python-headless    4.7.0.72                py310_0    fastai
openjpeg                  2.5.0                hfec8fc6_2    conda-forge
openslide                 3.4.1                h7773abc_6    conda-forge
openslide-python          1.2.0           py310h5764c6d_2    conda-forge
openssl                   3.1.0                hd590300_2    conda-forge
opt_einsum                3.3.0              pyhd8ed1ab_1    conda-forge
orc                       1.8.2                hfdbbad2_2    conda-forge
packaging                 23.1               pyhd8ed1ab_0    conda-forge
pandas                    1.5.3           py310h9b08913_1    conda-forge
pango                     1.50.14              hd33c08f_0    conda-forge
parquet-cpp               1.5.1                         2    conda-forge
partd                     1.4.0              pyhd8ed1ab_0    conda-forge
pcre                      8.45                 h9c3ff4c_0    conda-forge
pcre2                     10.40                hc3806b6_0    conda-forge
perl                      5.32.1          2_h7f98852_perl5    conda-forge
pillow                    9.4.0           py310h023d228_1    conda-forge
pip                       23.0.1             pyhd8ed1ab_0    conda-forge
pixman                    0.40.0               h36c2ea0_0    conda-forge
pkg-config                0.29.2            h36c2ea0_1008    conda-forge
pkgconfig                 1.5.5              pyhd8ed1ab_4    conda-forge
platformdirs              3.5.0              pyhd8ed1ab_0    conda-forge
pluggy                    1.0.0              pyhd8ed1ab_5    conda-forge
pooch                     1.7.0              pyha770c72_3    conda-forge
poppler                   23.03.0              h091648b_0    conda-forge
poppler-data              0.4.12               hd8ed1ab_0    conda-forge
pretrainedmodels          0.7.4              pyhd8ed1ab_2    conda-forge
protobuf                  4.21.12         py310heca2aa9_0    conda-forge
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
py-xgboost                1.7.4           cpu_py310hd1aba9c_0    conda-forge
pyarrow                   11.0.0          py310h633f555_5_cpu    conda-forge
pyasn1                    0.4.8                      py_0    conda-forge
pyasn1-modules            0.2.7                      py_0    conda-forge
pycparser                 2.21               pyhd8ed1ab_0    conda-forge
pyjwt                     2.6.0              pyhd8ed1ab_0    conda-forge
pyopenssl                 23.1.1             pyhd8ed1ab_0    conda-forge
pyparsing                 3.0.9                    pypi_0    pypi
pysocks                   1.7.1              pyha2e5f31_6    conda-forge
pytest                    7.2.1              pyhd8ed1ab_0    conda-forge
python                    3.10.9          he550d4f_0_cpython    conda-forge
python-dateutil           2.8.2              pyhd8ed1ab_0    conda-forge
python-flatbuffers        23.1.21            pyhd8ed1ab_0    conda-forge
python-xxhash             3.2.0           py310h1fa729e_0    conda-forge
python_abi                3.10                    3_cp310    conda-forge
pytorch                   1.13.1          cpu_py310hd11e9c7_1    conda-forge
pytorch-cpu               1.13.1          cpu_py310hdb170b5_1    conda-forge
pytorch-lightning         1.9.1              pyhd8ed1ab_0    conda-forge
pytz                      2023.3             pyhd8ed1ab_0    conda-forge
pyu2f                     0.1.5              pyhd8ed1ab_0    conda-forge
pyvips                    2.2.1           py310h39a615a_1    conda-forge
pywavelets                1.4.1           py310h0a54255_0    conda-forge
pyyaml                    6.0             py310h5764c6d_5    conda-forge
re2                       2023.02.01           hcb278e6_0    conda-forge
readline                  8.2                  h8228510_1    conda-forge
regex                     2023.3.23       py310h1fa729e_0    conda-forge
requests                  2.29.0             pyhd8ed1ab_0    conda-forge
requests-oauthlib         1.3.1              pyhd8ed1ab_0    conda-forge
responses                 0.18.0             pyhd8ed1ab_0    conda-forge
rsa                       4.9                pyhd8ed1ab_0    conda-forge
rtree                     1.0.1           py310hbdcdc62_1    conda-forge
s2n                       1.3.37               h3358134_0    conda-forge
sacremoses                0.0.53             pyhd8ed1ab_0    conda-forge
scikit-image              0.19.3          py310h769672d_2    conda-forge
scikit-learn              1.2.2           py310h41b6a48_1    conda-forge
scipy                     1.10.0          py310h8deb116_2    conda-forge
segmentation-models-pytorch 0.2.1              pyhd8ed1ab_0    conda-forge
setuptools                67.1.0             pyhd8ed1ab_0    conda-forge
shapely                   2.0.1           py310h056c13c_1    conda-forge
six                       1.16.0             pyh6c4a22f_0    conda-forge
sleef                     3.5.1                h9b69904_2    conda-forge
snappy                    1.1.9                hbd366e4_2    conda-forge
spams                     2.6.5.4                  pypi_0    pypi
sqlite                    3.40.0               h4ff8645_1    conda-forge
staintools                2.1.2                    pypi_0    pypi
tbb                       2021.9.0             hf52228f_0    conda-forge
tensorboard               2.11.2             pyhd8ed1ab_0    conda-forge
tensorboard-data-server   0.6.1           py310h600f1e7_4    conda-forge
tensorboard-plugin-wit    1.8.1              pyhd8ed1ab_0    conda-forge
tensorflow                2.11.0          cpu_py310hd1aba9c_0    conda-forge
tensorflow-base           2.11.0          cpu_py310hc9b7e7f_0    conda-forge
tensorflow-cpu            2.11.0          cpu_py310h718b53a_0    conda-forge
tensorflow-estimator      2.11.0          cpu_py310hfed9998_0    conda-forge
termcolor                 2.3.0              pyhd8ed1ab_0    conda-forge
threadpoolctl             3.1.0              pyh8a188c0_0    conda-forge
tifffile                  2023.4.12          pyhd8ed1ab_0    conda-forge
timm                      0.4.12             pyhd8ed1ab_0    conda-forge
tk                        8.6.12               h27826a3_0    conda-forge
tokenizers                0.13.3          py310he1f1126_0    conda-forge
tomli                     2.0.1              pyhd8ed1ab_0    conda-forge
toolz                     0.12.0             pyhd8ed1ab_0    conda-forge
torchmetrics              0.11.1             pyhd8ed1ab_0    conda-forge
torchvision               0.14.1          cpu_py310hdfb2906_0    conda-forge
tqdm                      4.64.1             pyhd8ed1ab_0    conda-forge
transformers              4.27.4             pyhd8ed1ab_0    conda-forge
typing-extensions         4.5.0                hd8ed1ab_0    conda-forge
typing_extensions         4.5.0              pyha770c72_0    conda-forge
tzdata                    2023c                h71feb2d_0    conda-forge
urllib3                   1.26.15            pyhd8ed1ab_0    conda-forge
werkzeug                  2.3.3              pyhd8ed1ab_0    conda-forge
wheel                     0.40.0             pyhd8ed1ab_0    conda-forge
wrapt                     1.15.0          py310h1fa729e_0    conda-forge
xgboost                   1.7.4           cpu_py310hd1aba9c_0    conda-forge
xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
xorg-libice               1.0.10               h7f98852_0    conda-forge
xorg-libsm                1.2.3             hd9c2040_1000    conda-forge
xorg-libx11               1.8.4                h0b41bf4_0    conda-forge
xorg-libxau               1.0.9                h7f98852_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xorg-libxext              1.3.4                h0b41bf4_2    conda-forge
xorg-libxrender           0.9.10            h7f98852_1003    conda-forge
xorg-libxt                1.2.1                h7f98852_2    conda-forge
xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
xorg-xextproto            7.3.0             h0b41bf4_1003    conda-forge
xorg-xproto               7.0.31            h7f98852_1007    conda-forge
xxhash                    0.8.1                h0b41bf4_0    conda-forge
xz                        5.2.6                h166bdaf_0    conda-forge
yaml                      0.2.5                h7f98852_2    conda-forge
yarl                      1.9.1           py310h2372a71_0    conda-forge
zfp                       1.0.0                h27087fc_3    conda-forge
zipp                      3.15.0             pyhd8ed1ab_0    conda-forge
zlib                      1.2.13               h166bdaf_4    conda-forge
zlib-ng                   2.0.7                h0b41bf4_0    conda-forge
zstd                      1.5.2                h3eb15da_6    conda-forge
+ echo '######################################'
######################################
+ echo Unpacking submission
Unpacking submission
+ unzip ./submission/submission.zip -d ./
Archive:  ./submission/submission.zip
   creating: ./assets/
  inflating: ./assets/history_encoder.joblib  
  inflating: ./assets/random_forest_model.joblib  
  inflating: ./main.py               
+ ls -alh
total 28K
drwxr-xr-x 1 appuser appuser 4.0K May  2 10:50 .
drwxr-xr-x 1 root    root    4.0K May  2 10:50 ..
drwxrwxr-x 2 appuser appuser 4.0K Apr 26 16:40 assets
drwxrwxr-x 2    1004    1004 4.0K May  2 10:49 data
-rw-rw-r-- 1 appuser appuser 1.9K Apr 26 16:40 main.py
drwxrwxrwx 2    1004    1004 4.0K May  2 10:50 submission
drwxr-xr-x 2 root    root    4.0K May  2 09:52 tests
+ echo 'Running code submission with Python'
Running code submission with Python
+ conda run --no-capture-output -n condaenv python main.py
2023-05-02 10:50:11.853 | INFO     | __main__:main:39 - Loading feature encoder and model
2023-05-02 10:50:13.087 | INFO     | __main__:main:43 - Preprocessing features
2023-05-02 10:50:13.090 | INFO     | __main__:main:46 - Checking test feature filenames are in the same order as the submission format
2023-05-02 10:50:13.091 | INFO     | __main__:main:49 - Checking test feature columns align with loaded model
2023-05-02 10:50:13.091 | INFO     | __main__:main:52 - Generating predictions
2023-05-02 10:50:13.134 | INFO     | __main__:main:56 - Writing out submission.csv
+ echo 'Exporting submission.csv result...'
Exporting submission.csv result...
+ '[' -f submission.csv ']'
+ echo 'Script completed its run.'
Script completed its run.
+ cp submission.csv ./submission/submission.csv
+ echo '================ END ================'
================ END ================

@ejm714 ejm714 self-requested a review May 2, 2023 13:06
Copy link
Collaborator

@ejm714 ejm714 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @akisman!

Noting for posterity that this PR does increase each image by around 5GB. This matters when people pull this image to test locally. Given the general large size of the data in this competition, we'll assume this is workable.

@ejm714 ejm714 merged commit 9c32394 into drivendataorg:main May 2, 2023
2 checks passed
ejm714 added a commit that referenced this pull request May 7, 2023
ejm714 added a commit that referenced this pull request May 7, 2023
ejm714 added a commit that referenced this pull request May 7, 2023
ejm714 added a commit that referenced this pull request May 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants