Skip to content

manylinux2010 based build for native artifacts #194

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Sep 17, 2020
Merged

manylinux2010 based build for native artifacts #194

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
53a38ea
Do not force prefixes, no longer required
chris-allan Sep 16, 2020
3ecd343
Add and enable Azure support by default; helps build order
chris-allan Sep 16, 2020
a204acc
Build release native artifacts using manylinux2010
chris-allan Sep 16, 2020
be8dcf3
Revert "Do not force prefixes, no longer required"
chris-allan Sep 16, 2020
6a05a57
Off by default as not currently working on Windows
chris-allan Sep 16, 2020
bdc7e73
Remove unused environment variable
chris-allan Sep 16, 2020
009ce18
Conditionally enable Azure support on Linux
chris-allan Sep 16, 2020
5a5f769
Conditionally enable Azure support on macOS
chris-allan Sep 16, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions build.gradle
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,7 @@ task cmakeTask(type: Exec) {
"TILEDB_GIT_TAG",
"TILEDB_VERBOSE",
"TILEDB_S3",
"TILEDB_AZURE",
"TILEDB_HDFS",
"TILEDB_SERIALIZATION"
].each { v ->
Expand Down
10 changes: 10 additions & 0 deletions ci/Dockerfile2010
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
# Dockerfile for lowest common denominator Linux native artifact build
# --------------------------------------------------------------------
# Cribbed from TileDB-Py/misc/pypi_linux/Dockerfile2010
FROM quay.io/pypa/manylinux2010_x86_64

RUN yum install -y java-1.8.0-openjdk-devel
RUN yum remove -y cmake

ENV PATH /opt/python/cp38-cp38/bin:${PATH}
RUN pip install cmake==3.17.3
6 changes: 6 additions & 0 deletions ci/build.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
#!/bin/sh

set -ex

cd /TileDB-Java
./gradlew -PTILEDB_AZURE=ON build
11 changes: 6 additions & 5 deletions ci/tiledb-java-linux_osx-release.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,14 +12,15 @@ steps:

BUILD_BINARIESDIRECTORY=${BUILD_BINARIESDIRECTORY:-$BUILD_REPOSITORY_LOCALPATH/}

./gradlew assemble

if [[ ( "$AGENT_OS" == "Linux" ) ]]; then
cp ./build/tiledb_jni/*.so ./build/install/lib/*.so $BUILD_BINARIESDIRECTORY
docker build -f ci/Dockerfile2010 . -t lib_builder_2010
docker run -v $(pwd):/TileDB-Java -t lib_builder_2010 /TileDB-Java/ci/build.sh
cp ./build/tiledb_jni/*.so ./build/install/lib/*.so $BUILD_BINARIESDIRECTORY
fi

if [[ ( "$AGENT_OS" == "Darwin" ) ]]; then
cp ./build/tiledb_jni/*.dylib ./build/install/lib/*.dylib $BUILD_BINARIESDIRECTORY
./gradlew -PTILEDB_AZURE=ON assemble
cp ./build/tiledb_jni/*.dylib ./build/install/lib/*.dylib $BUILD_BINARIESDIRECTORY
fi

echo "Native Libs"
Expand Down Expand Up @@ -65,4 +66,4 @@ steps:
inputs:
pathtoPublish: $(Build.ArtifactStagingDirectory)/tiledb-$(Agent.OS)-$(Build.SourceBranchName)-$(commitHash).tar.gz
artifactName: libraries
condition: succeeded()
condition: succeeded()
1 change: 1 addition & 0 deletions cmake/Modules/FindTileDB_EP.cmake
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,7 @@ if (NOT TILEDB_FOUND)
-DCMAKE_PREFIX_PATH=${TILEDB_JNI_EP_INSTALL_PREFIX}
-DTILEDB_VERBOSE=${TILEDB_VERBOSE}
-DTILEDB_S3=${TILEDB_S3}
-DTILEDB_AZURE=${TILEDB_AZURE}
-DTILEDB_HDFS=${TILEDB_HDFS}
-DTILEDB_SERIALIZATION=${TILEDB_SERIALIZATION}
-DTILEDB_FORCE_ALL_DEPS=ON
Expand Down
1 change: 1 addition & 0 deletions gradle.properties
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,6 @@ TILEDB_GIT_REPOSITORY=https://github.com/TileDB-Inc/TileDB
TILEDB_GIT_TAG=2.0.8
TILEDB_VERBOSE=OFF
TILEDB_S3=ON
TILEDB_AZURE=OFF
TILEDB_HDFS=OFF
TILEDB_SERIALIZATION=OFF