Skip to content
This repository has been archived by the owner on Aug 2, 2022. It is now read-only.

c++17 and compiler pinning #7107

Merged
merged 93 commits into from
Apr 25, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
93 commits
Select commit Hold shift + click to select a range
acd22cd
update build scripts
larryk85 Apr 10, 2019
29520ad
Pull over from feature/cpp17 branch and new stuff for pinning the com…
larryk85 Apr 10, 2019
b1739bb
use libcxxabi
larryk85 Apr 10, 2019
637afd9
small changes for clang 8 build
larryk85 Apr 10, 2019
dd226ab
revert missed commented out mongo stuff and revert chainbase change
larryk85 Apr 11, 2019
62109ed
use boost 1.68
larryk85 Apr 11, 2019
4e4179a
revert back to boost 1.67 for now
larryk85 Apr 11, 2019
b9e37aa
Addressed some change requests
larryk85 Apr 11, 2019
4597fed
Add new option for pinning
larryk85 Apr 11, 2019
14dc234
undo mongo comment out
larryk85 Apr 11, 2019
e146709
add cmake variable for compiler pinning
larryk85 Apr 11, 2019
4b3de8a
fix bash issue and add -p to pipeline.yml
larryk85 Apr 12, 2019
da1cd08
update chainbase submodule
larryk85 Apr 12, 2019
0903cb8
Update CMakeLists.txt
larryk85 Apr 12, 2019
407e2f7
reverting libc++ changes
larryk85 Apr 14, 2019
f6ac7f6
hopefully close to finished with pinning
larryk85 Apr 17, 2019
9055d81
update script
larryk85 Apr 17, 2019
e046c0a
merge upstream
larryk85 Apr 17, 2019
ba4e17d
small changes for gcc build
larryk85 Apr 17, 2019
5a11c0b
update all other build scripts
larryk85 Apr 17, 2019
b9f058a
use curl instead of wget
larryk85 Apr 17, 2019
5937ffd
fix rm
larryk85 Apr 17, 2019
eeb8b80
export LD_LIBRARY_PATH
larryk85 Apr 17, 2019
408f5eb
fix up darwin
larryk85 Apr 17, 2019
cbc87cb
export correct lib paths
larryk85 Apr 17, 2019
846de6d
update submodules
larryk85 Apr 17, 2019
dd0a6cd
patch linux-unwind.h
larryk85 Apr 17, 2019
2609c0c
fix patch and bump timeout for build
larryk85 Apr 17, 2019
397e266
fix missing tmp directory centos
larryk85 Apr 17, 2019
988cebf
add back fix for auto_ptr to unique_ptr
larryk85 Apr 17, 2019
e4bfd46
update for Apple
larryk85 Apr 17, 2019
80ed27b
update wabt/no-clobber
larryk85 Apr 17, 2019
f07d14a
resolved requested changes
larryk85 Apr 18, 2019
b0d0553
don't think we need to add the libstdc++ any more, trying it out
larryk85 Apr 19, 2019
dd2b2e7
updating submodules
larryk85 Apr 19, 2019
fcce555
merging forced-replay
larryk85 Apr 19, 2019
06a7f31
fixing other merging issues
larryk85 Apr 19, 2019
0348ca7
update pipeline.yml
larryk85 Apr 19, 2019
0d7f14f
add missing include dir for linux
larryk85 Apr 19, 2019
fc977c2
I was wrong still need the special case for libstdc++
larryk85 Apr 19, 2019
bc532d9
Still not statically linking after merge
larryk85 Apr 20, 2019
4ac7570
hopefully finished
larryk85 Apr 20, 2019
6bb66a6
Update CMakeLists.txt
larryk85 Apr 20, 2019
f630b3d
Update eosio_build_fedora.sh
larryk85 Apr 20, 2019
64020d6
use script directory variable
larryk85 Apr 20, 2019
5013e6e
Merge branch 'feature/cpp17_compiler_pinning' of github.com:eosio/eos…
larryk85 Apr 20, 2019
627d351
gitignore missed toolchain file
larryk85 Apr 20, 2019
128918d
update toolchain file
larryk85 Apr 20, 2019
436651d
switch over to libcxx and no mongo-cxx-driver
larryk85 Apr 22, 2019
7209b24
add cd to tmp dir
larryk85 Apr 22, 2019
5f4fafc
forgot $ for PIN_COMPILER
larryk85 Apr 22, 2019
b793f31
remove depth 1 from cloning; missing commits
larryk85 Apr 22, 2019
2734def
use SRC directory
larryk85 Apr 22, 2019
2016047
merged forced-replay
larryk85 Apr 22, 2019
00d665d
issues with tar
larryk85 Apr 22, 2019
6ebb635
remove j from tar
larryk85 Apr 22, 2019
88077b7
just going to use git for llvm4
larryk85 Apr 22, 2019
cdb47a5
mistake keystrokes
larryk85 Apr 22, 2019
b34a6bd
only build host for clang and fix dumb mistake
larryk85 Apr 23, 2019
1729f49
long day
larryk85 Apr 23, 2019
920d6aa
still a long day
larryk85 Apr 23, 2019
033187c
clean up toolchain file
larryk85 Apr 23, 2019
1a54110
add force build flag and build mongo flag
larryk85 Apr 23, 2019
9e81631
add force flag temporarily
larryk85 Apr 23, 2019
77a68c5
add clang8 bin to path for boost builds
larryk85 Apr 23, 2019
82dac0d
merged forced-replay
larryk85 Apr 23, 2019
5b342dc
modified .pipelinebranch
larryk85 Apr 23, 2019
f123138
addressed changes
larryk85 Apr 23, 2019
caf409e
pipeline changes to use new images
Apr 23, 2019
c520f37
addressed comments
larryk85 Apr 24, 2019
4228e97
forgot fi
larryk85 Apr 24, 2019
ccd0be4
left over /
larryk85 Apr 24, 2019
bd97221
remove force flag from pipeline.yml
larryk85 Apr 24, 2019
745b0bb
adding back -f until base images are built correctly
larryk85 Apr 24, 2019
5a6aa49
merge develop
larryk85 Apr 24, 2019
6909665
disable mongo tests
larryk85 Apr 24, 2019
b8fee49
remove force flag and use new mac builder
larryk85 Apr 24, 2019
3d7cc2a
point tests to new mac builder and remove remnant flags to cmake
larryk85 Apr 24, 2019
d3d7416
testing anka
Apr 25, 2019
fcdd347
testing anka
Apr 25, 2019
04fc1d6
testing anka
Apr 25, 2019
061079f
testing anka
Apr 25, 2019
a0194af
testing anka
Apr 25, 2019
cf15049
testing anka
Apr 25, 2019
9ca743d
testing anka
Apr 25, 2019
dee9f10
Anka finalization
Apr 25, 2019
1f2266d
Anka finalization
Apr 25, 2019
75f69a0
Anka finalization
Apr 25, 2019
d326263
Anka finalization
Apr 25, 2019
0cbead9
Anka finalization
Apr 25, 2019
45e52ea
Anka revert
Apr 25, 2019
22db396
Anka reverted
Apr 25, 2019
abc90ff
Merge branch 'develop' into feature/cpp17_compiler_pinning
larryk85 Apr 25, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
170 changes: 125 additions & 45 deletions .buildkite/pipeline.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,66 @@
# env:
# ANKA_WORKDIR: "/data/job"
# ANKA_MOJAVE_TEMPLATE: "10.14.4_6C_14G_40G"
# ANKA_TEMPLATE_TAG: "clean::cicd::git-ssh::nas::brew"
# CHECKSUMABLE: "scripts/eosio_build*"
# MAC_TAG: "eosio_2-3"

steps:

# - trigger: "mac-anka-fleet"
# label: ":anka: Ensure Mojave Anka Template Tag Exists"
# branches: "*"
# async: false
# build:
# branch: "master"
# env:
# REPO: "${BUILDKITE_REPO}"
# REPO_BRANCH: "${BUILDKITE_BRANCH}"
# CHECKSUMABLE: "${CHECKSUMABLE}"
# TEMPLATE: "${ANKA_MOJAVE_TEMPLATE}"
# TEMPLATE_TAG: "${ANKA_TEMPLATE_TAG}"
# TAG_COMMANDS: "CLONED_REPO_DIR/scripts/eosio_build.sh -y -P -f" # CLONED_REPO_DIR IS REQUIRED and is where the repo is always cloned into
# PROJECT_TAG: "${MAC_TAG}"

# - wait

# - label: ":darwin: [Darwin] Mojave Build"
# command:
# - "./scripts/eosio_build.sh -y -P"
# - "tar -pczf /Network/NAS/MAC_FLEET/BUILDKITE/artifacts/${ANKA_MOJAVE_TEMPLATE}-${BUILDKITE_PIPELINE_SLUG}-${BUILDKITE_BUILD_ID}.tar.gz build"
# plugins:
# chef/anka#v0.4.3:
# vm-name: $ANKA_MOJAVE_TEMPLATE
# vm-registry-tag: "${ANKA_TEMPLATE_TAG}::${MAC_TAG}"
# workdir: $ANKA_WORKDIR
# always-pull: true
# debug: true
# wait-network: true
# agents:
# - "queue=mac-anka-node-fleet"
# timeout: 120


- command: | # macOS Mojave Build
echo "--- Creating symbolic link to job directory :file_folder:"
sleep 5
ln -s "$(pwd)" /data/job
cd /data/job
echo "+++ Building :hammer:"
./scripts/eosio_build.sh -y -P
echo "--- Compressing build directory :compression:"
tar -pczf build.tar.gz build
if [[ ! -f build.tar.gz ]]; then echo 'ERROR: No build.tar.gz artifact found!' && exit 1; fi
label: ":darwin: Mojave Build"
agents:
- "role=builder-v2-2"
- "os=mojave"
artifact_paths: "build.tar.gz"
timeout: 120

- command: | # Amazon Linux 2 Build
echo "+++ :hammer: Building"
./scripts/eosio_build.sh -y
./scripts/eosio_build.sh -y -P
echo "--- :compression: Compressing build directory"
tar -pczf build.tar.gz build
if [[ ! -f build.tar.gz ]]; then echo 'ERROR: No build.tar.gz artifact found!' && exit 1; fi
Expand All @@ -17,14 +76,14 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:amazonlinux2_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:amazonlinux2_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
timeout: 120

- command: | # CentOS 7 Build
echo "+++ :hammer: Building"
./scripts/eosio_build.sh -y
./scripts/eosio_build.sh -y -P
echo "--- :compression: Compressing build directory"
tar -pczf build.tar.gz build
if [[ ! -f build.tar.gz ]]; then echo 'ERROR: No build.tar.gz artifact found!' && exit 1; fi
Expand All @@ -40,14 +99,14 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
timeout: 120

- command: | # Ubuntu 16.04 Build
echo "+++ :hammer: Building"
./scripts/eosio_build.sh -y
./scripts/eosio_build.sh -y -P
echo "--- :compression: Compressing build directory"
tar -pczf build.tar.gz build
if [[ ! -f build.tar.gz ]]; then echo 'ERROR: No build.tar.gz artifact found!' && exit 1; fi
Expand All @@ -63,14 +122,14 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
timeout: 120

- command: | # Ubuntu 18.04 Build
echo "+++ :hammer: Building"
./scripts/eosio_build.sh -y
./scripts/eosio_build.sh -y -P
echo "--- :compression: Compressing build directory"
tar -pczf build.tar.gz build
if [[ ! -f build.tar.gz ]]; then echo 'ERROR: No build.tar.gz artifact found!' && exit 1; fi
Expand All @@ -86,27 +145,10 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60

- command: | # macOS Mojave Build
echo "--- Creating symbolic link to job directory :file_folder:"
sleep 5
ln -s "$(pwd)" /data/job
cd /data/job
echo "+++ Building :hammer:"
./scripts/eosio_build.sh -y
echo "--- Compressing build directory :compression:"
tar -pczf build.tar.gz build
if [[ ! -f build.tar.gz ]]; then echo 'ERROR: No build.tar.gz artifact found!' && exit 1; fi
label: ":darwin: Mojave Build"
agents:
- "role=builder-v2-1"
- "os=mojave"
artifact_paths: "build.tar.gz"
timeout: 60
timeout: 120

- wait

Expand All @@ -127,7 +169,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:amazonlinux2_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:amazonlinux2_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -148,7 +190,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:amazonlinux2_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:amazonlinux2_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -170,7 +212,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -191,7 +233,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -213,7 +255,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -234,7 +276,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -256,7 +298,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60
Expand All @@ -277,11 +319,49 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-3"
propagate-environment: true
workdir: /data/job
timeout: 60

# - label: ":darwin: [Darwin] Mojave Tests"
# command:
# - "./scripts/parallel-test.sh /Network/NAS/MAC_FLEET/BUILDKITE/artifacts/${ANKA_MOJAVE_TEMPLATE}-${BUILDKITE_PIPELINE_SLUG}-${BUILDKITE_BUILD_ID}.tar.gz"
# artifact_paths:
# - "build/mongod.log"
# - "build/genesis.json"
# - "build/config.ini"
# agents:
# - "queue=mac-anka-node-fleet"
# plugins:
# chef/anka#v0.4.3:
# vm-name: $ANKA_MOJAVE_TEMPLATE
# vm-registry-tag: "${ANKA_TEMPLATE_TAG}::${MAC_TAG}"
# workdir: $ANKA_WORKDIR
# always-pull: true
# debug: true
# wait-network: true
# timeout: 120

# - label: ":darwin: [Darwin] Mojave Tests"
# command:
# - "./scripts/serial-test.sh /Network/NAS/MAC_FLEET/BUILDKITE/artifacts/${ANKA_MOJAVE_TEMPLATE}-${BUILDKITE_PIPELINE_SLUG}-${BUILDKITE_BUILD_ID}.tar.gz"
# artifact_paths:
# - "build/mongod.log"
# - "build/genesis.json"
# - "build/config.ini"
# agents:
# - "queue=mac-anka-node-fleet"
# plugins:
# chef/anka#v0.4.3:
# vm-name: $ANKA_MOJAVE_TEMPLATE
# vm-registry-tag: "${ANKA_TEMPLATE_TAG}::${MAC_TAG}"
# workdir: $ANKA_WORKDIR
# always-pull: true
# debug: true
# wait-network: true
# timeout: 120

# Mojave Tests
- command: |
echo "--- :arrow_down: Downloading Build Directory"
Expand All @@ -291,10 +371,9 @@ steps:
./scripts/parallel-test.sh
label: ":darwin: Mojave Tests"
agents:
- "role=tester-v2-1"
- "role=tester-v2-2"
- "os=mojave"
timeout: 60

- command: |
echo "--- :arrow_down: Downloading Build Directory"
buildkite-agent artifact download "build.tar.gz" . --step ":darwin: Mojave Build"
Expand All @@ -303,10 +382,11 @@ steps:
./scripts/serial-test.sh
label: ":darwin: Mojave NP Tests"
agents:
- "role=tester-v2-1"
- "role=tester-v2-2"
- "os=mojave"
timeout: 60


- wait

- command: | # CentOS 7 Package Builder
Expand Down Expand Up @@ -336,7 +416,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:centos7_2-3"
propagate-environment: true
workdir: /data/job
env:
Expand Down Expand Up @@ -364,7 +444,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu16_2-3"
propagate-environment: true
workdir: /data/job
env:
Expand Down Expand Up @@ -392,7 +472,7 @@ steps:
region: "us-west-2"
docker#v2.1.0:
debug: true
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-2"
image: "436617320021.dkr.ecr.us-west-2.amazonaws.com/ci:ubuntu18_2-3"
propagate-environment: true
workdir: /data/job
env:
Expand All @@ -410,7 +490,7 @@ steps:
bash generate_package.sh brew
label: ":darwin: Mojave Package Builder"
agents:
- "role=builder-v2-1"
- "role=builder-v2-2"
- "os=mojave"
artifact_paths:
- "build/packages/*.tar.gz"
Expand All @@ -435,4 +515,4 @@ steps:
label: "Git Submodule Regression Check"
agents:
queue: "automation-large-builder-fleet"
timeout: 5
timeout: 5
2 changes: 1 addition & 1 deletion .pipelinebranch
Original file line number Diff line number Diff line change
@@ -1 +1 @@
use-protocol-features-sync-nodes
protocol-features-sync-nodes
Loading