Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BLD: Update environment to ubuntu16.04 #389

Merged
merged 13 commits into from Aug 12, 2019

Conversation

seanpmorgan
Copy link
Member

Preparing to close #75 and #119 now that the docker containers are available. At the moment the packaged whls are failing manylinux2010 compliance but it could be because we link to the tf-nightly which is not yet built in this env. The switch for nightlies on core should be within a couple weeks.

Also need to setup the cuda crosstool (though we haven't finalized our gpu pip package):
tensorflow/custom-op@b74be35

Another note: this will drop py34 support as tf-core has done the same.

@seanpmorgan seanpmorgan requested a review from a team as a code owner August 2, 2019 03:09
# Conflicts:
#	build_deps/gpu/cuda/BUILD.tpl
#	build_deps/requirements.txt
#	build_deps/requirements_gpu.txt
#	tools/ci_build/builds/release_linux.sh
#	tools/ci_build/builds/release_macos.sh
@seanpmorgan seanpmorgan changed the title [WIP] BLD: Update environment to ubuntu16.04 BLD: Update environment to ubuntu16.04 Aug 11, 2019
Copy link
Member

@WindQAQ WindQAQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@@ -1 +1 @@
tf-nightly-gpu-2.0-preview==2.0.0.dev20190731
tf-nightly-gpu-2.0-preview>=2.0.0.dev20190802
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this related to #407 so we do not pin to latest version?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So this is the date when tensorflow began publishing manylinux2010 whls. The greater or equal to will need to stay so I added a comment to the files. Thanks!

Lint

Add missing files

Create crosstool_wrapper_driver_is_not_gcc.tpl

Create msvc_wrapper_for_nvcc.py.tpl

Update permission
@@ -466,7 +466,8 @@ def _testWithMaybeMultiAttention(self,
expected_final_alignment_history,
final_alignment_history_info)

@parameterized.parameters([np.float32, np.float64])
# TODO: #407 Float64 test is failing
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Related to #407

@seanpmorgan seanpmorgan removed the request for review from qlzh727 August 11, 2019 13:07
@seanpmorgan
Copy link
Member Author

@tensorflow/sig-addons-maintainers Fixed the issues... ready for review.

Copy link
Member

@WindQAQ WindQAQ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@seanpmorgan Nice PR :P

@@ -44,6 +44,7 @@ function main() {
cp ${PIP_FILE_PREFIX}setup.py "${TMPDIR}"
cp ${PIP_FILE_PREFIX}MANIFEST.in "${TMPDIR}"
cp ${PIP_FILE_PREFIX}LICENSE "${TMPDIR}"
touch ${TMPDIR}/stub.cc
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sean, I don't find where we use this file. Could you point out the place or it is just for testing?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah good find... without that sort-of hack the whl fails manylinux2010 compliance because:

RuntimeError: Invalid binary wheel, found the following shared library/libraries in purelib folder: ... The wheel has to be platlib compliant in order to be repaired by auditwheel.

This is the same patch as is done on TF-Core:
https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tools/ci_build/devtoolset/platlib.patch

setup.py Show resolved Hide resolved
@WindQAQ WindQAQ self-requested a review August 12, 2019 11:00
@WindQAQ WindQAQ merged commit a59dba0 into tensorflow:master Aug 12, 2019
@seanpmorgan seanpmorgan deleted the bld-ubuntu16 branch August 12, 2019 11:30
lgeiger added a commit to larq/compute-engine that referenced this pull request Feb 14, 2020
Since we ship compiled *.so files without the source C++ code this is necessary to appease auditwheel.

This is dark magic copied from tensorflow/addons#389 and https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tools/ci_build/devtoolset/platlib.patch
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Package Addons for python3.7
4 participants