Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metrics changes #286

Merged
merged 20 commits into from
Jun 7, 2022
Merged

Metrics changes #286

merged 20 commits into from
Jun 7, 2022

Conversation

eugskim
Copy link
Contributor

@eugskim eugskim commented May 19, 2022

Issue #, if available:

Description of changes:
Adding new metrics and tests

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@NikhilRaverkar
Copy link
Contributor

Build is failing with an error: No such file or directory: '/miniconda3/lib/python3.7/site-packages/numpy-1.21.6.dist-info/METADATA'

Please replace these lines with following:

RUN conda install numpy --force-reinstall && \
   rm -rf /miniconda3/lib/python3.7/site-packages/numpy-1.21.2.dist-info && \
    python3 -m pip install --no-cache /sagemaker_xgboost_container-1.0-py2.py3-none-any.whl && \
    python3 -m pip uninstall -y typing && \
    rm /sagemaker_xgboost_container-1.0-py2.py3-none-any.whl

@@ -1,4 +1,4 @@
ARG SAGEMAKER_XGBOOST_VERSION=1.5-1
iARG SAGEMAKER_XGBOOST_VERSION=1.5-1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit should be ARG

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh oops, sorry about that!

@eugskim eugskim marked this pull request as draft May 23, 2022 19:33
@eugskim eugskim marked this pull request as ready for review May 23, 2022 19:34
@@ -15,7 +15,9 @@ RUN python3 -m pip install -r /requirements.txt && rm /requirements.txt
# Copy wheel to container #
###########################
COPY dist/sagemaker_xgboost_container-2.0-py2.py3-none-any.whl /sagemaker_xgboost_container-1.0-py2.py3-none-any.whl
RUN rm -rf /miniconda3/lib/python3.7/site-packages/numpy-1.21.2.dist-info && \

RUN conda install numpy --force-reinstall && \
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we force-reinstall the numpy here? Will it install the latest numpy version? Shouldn't we pin https://github.com/aws/sagemaker-xgboost-container/blob/master/requirements.txt#L11 here and use pinned numpy?

Copy link
Contributor Author

@eugskim eugskim Jun 1, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The force-reinstall was due to an earlier comment. I did try running it without and there is a build error associated with numpy. I believe the reinstall will reinstall the current version and not the latest version but I will confirm this is the case when the check finishes.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you please try to update numpy version to numpy==1.21.6 in requirements.txt and check if this change can be avoided?

Copy link
Contributor Author

@eugskim eugskim Jun 6, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The change to the numpy version has been added!

@eugskim
Copy link
Contributor Author

eugskim commented Jun 1, 2022

Integration Tests for the new metrics (MAE and RMSE): [mxnet-algorithms-integ-test-220601-191722-724128]

@eugskim eugskim force-pushed the MetricsChanges branch 2 times, most recently from 5abd69d to 2552292 Compare June 1, 2022 23:26
@NikhilRaverkar
Copy link
Contributor

Can you please confirm if the integ tests were run for an image containing these changes?

@eugskim
Copy link
Contributor Author

eugskim commented Jun 3, 2022

Can you please confirm if the integ tests were run for an image containing these changes?

Yes, the integration testing was ran on a docker image with the new changes in this PR

@NikhilRaverkar NikhilRaverkar requested review from dewan-c and removed request for yusharon June 6, 2022 13:55
@eugskim eugskim requested a review from yusharon June 6, 2022 16:15
@NikhilRaverkar NikhilRaverkar merged commit 4723e36 into aws:master Jun 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
5 participants