-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
WIP: Feature: creation of relocatable tarballs from installed packages #1013
Closed
Closed
Changes from 1 commit
Commits
Show all changes
193 commits
Select commit
Hold shift + click to select a range
e67b7eb
add create_tarball command to package build artifacts into tarballs
hegner 84de4be
move to non-CERN specific naming conventions
hegner 9c67751
first test version of binary install procedures
hegner c053647
remove debug printout
hegner d31ba16
add version to tarball name
hegner 2ef4768
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
hegner 90fcba0
Add recursion and force-overwrite to create-tarball.
brettviren 95fe15a
Merge pull request #1 from brettviren/features/binary-packages
hegner 860e5df
Fix dependency recursion.
brettviren 7719192
Merge pull request #2 from brettviren/features/binary-packages
hegner 4498737
Extend binary packaging features
hegner e7773ce
remove accidentally added files
hegner 4c8c82a
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
hegner 8324fcf
remove duplicate creation of install layout
hegner 3210dd2
use mirrors for downloading binary tarballs
hegner 5fb14db
use full version of linux distribution
hegner 8446096
remove duplicated fetch; remnant from last merge which lead to duplic…
hegner 80dbd10
add relocation for shebang and config files
hegner 6bad462
reduce verbosity
hegner bfa5f2c
refine relocation
hegner 5911b0b
fix wrong ident
hegner 779b8dc
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
hegner 1f9a01d
address flake8 checks
hegner a476bd7
quote pathnames in case there are spaces
gartung 132993d
fix compression flag
hegner a506bf9
making this work on OSX
gartung ebd7fe9
clean up mac relocation
hegner 4282850
code cleanup
hegner f9cd9a2
refactoring; documentation; testing
hegner 66a812d
pep8
hegner 0607152
various fixes
hegner a3783c1
use only otool and install_name_tool
gartung 5f85533
fixes
gartung 6e1257e
fixes #967
alalazo 164da8e
Version bump to 0.9.1
tgamblin 987c549
using @rpath was a bust; switched replacing olddir with newdir; add o…
gartung b48047e
revert change to cc script
gartung 4d3a7dc
fix bug that kept LC_LOAD_DYLIB from being changed
gartung a285488
fix incorrect change
gartung 4033646
typo
gartung 1602d70
Merge branch 'llnl-develop' into binary_packages
gartung acaff17
fix typo from merge
gartung a8e2230
fixup merge
gartung f2bd84e
more merge fixups
gartung f42ff74
even more merge fixups
gartung 20953d7
these were removed during merge
gartung b26f811
do not fail if tarball exists
gartung c67e4a7
only create tarball if it does not exist
gartung 8c32777
only create tarball if it does not exist
gartung 6f7bcd2
Merge remote-tracking branch 'origin/develop' into binary_packages
gartung 7446f7c
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung 436d734
Merge branch 'binary_packages' into llnl-develop
gartung e9bc73c
Merge branch 'develop' of https://github.com/LLNL/spack into llnl-dev…
gartung 90bbdca
Loop over all mirrors trying to find binary tarball
gartung 9ce4863
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung 22b0e4b
install-policy -> fetch-binary
gartung 4f8167b
Don't assume spack is in the path when building docs.
tgamblin 1d73ce4
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
gartung 29e4233
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
gartung cb74a9b
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung 5f2243a
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
gartung 1cf9e76
Merge remote-tracking branch 'my/binary_packages' into binary_packages
gartung dc5cf9f
new opsnssl version
gartung 772668e
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung 04dc337
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
gartung cfee296
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung 42a2553
add sqlite 3.12.2
gartung 53b15b5
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung bf3b163
Merge branch 'develop' of https://github.com/LLNL/spack into binary_p…
gartung bf7f1e0
changes needed after merging
gartung 8576e76
missed
gartung fa01377
pass fetch_binary with the new api
gartung 6e99a79
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung 9eb6e1a
this got removed in merge
gartung 7da99bb
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung 6f47aa2
this is the correct path to use
gartung b0206ba
fix errors travis found
gartung 47f5133
sigh
gartung aa378db
use upstream sqlite
gartung e18fddd
now avaliable in upstream
gartung 1d475a7
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung ac68a2d
this is really needed for the test
gartung 6000d15
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung 41722b8
more nit picking
gartung e15a3f0
Merge branch 'binary_packages' of github.com:gartung/spack into binar…
gartung 2245c00
more format fixes
gartung 95e8b91
apple-clang does have cxx14 support
gartung 9d94d24
Merge remote-tracking branch 'my/binary_packages' into binary_packages
gartung a7c0408
more test fixups
gartung d9fedc4
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung 9cd1543
no spaces in docstring???
gartung c881b54
no leading spaces???
gartung 9412ee1
add binary_caches to index.rst???
gartung 52a9e5d
Merge branch 'releases/v0.10.0'
tgamblin b2019a6
Merge tag 'v0.10.0' into binary_packages
gartung 8830cfc
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung 9a4bccf
move fetch_binary actions out of install method
gartung 9552235
Merge branch 'develop' into binary_packages
gartung a1d05c0
move the installation of binary tarballs to its own command
gartung 1222851
autopep8
gartung bb117f6
fixes from testing
gartung 847ba89
add to description
gartung 2093e57
remove error for create_tarball and install_tarball when spack is run…
gartung eaff47b
more fixes from testing
gartung 3b74ac1
Add generic variant to gmp for CXXFLAGS=-mtune=generic. This allows a…
gartung 23265aa
mtune=generic is specific to gcc
gartung 3148849
autopep8
gartung 5a58895
recommended fix for Illegal instruction error @ http://www.linuxfroms…
gartung 01f3887
Merge branch 'develop' into binary_packages
gartung b60f74d
Merge branch 'develop' into gmp-generic
gartung 78e0eb5
WIP: binary_distribution: pseudocode for GPG-signed binaries
mathstuf d8e2d17
Expand on Ben Boeckel's use of python tarfile
gartung 7d64020
update binary_cache doc
gartung 1961e68
Extract the signature files and the tarball in stage directory.
gartung 99ed0cc
remove outdated packaging.py
gartung beb878d
fix the error from spack help -a
gartung 7f6c669
replace use of getstatusoutput() with which(command) followed by comm…
gartung 7a269f8
use filter_file instead of os.system('sed....')
gartung e06576f
don't need symbolic links
gartung 30aa688
spack does not seem to like dashes or underscores in the command names
gartung 52b614c
unknown command error caused by import of relocate.py failing
gartung 589f119
autopep8
gartung 2109078
does spack really hate dashes in command names???
gartung 80ccb59
Make installtarball and createtarball a multi level command
gartung 4ef502d
autopep8
gartung 0a41a51
add context.closing around tarfile.open
gartung 7d38571
only make buildcache for link and run depdencies
gartung e60249b
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung 6190135
flake8
gartung 719a471
Merge branch 'develop' into gmp-generic
gartung cf22340
add rpath derived from compiler used by spack
gartung ec856d8
don't add this for now
gartung 4d3c062
skip adding gcc_prefix if it comes from CLT
gartung 7b87b44
don't try to relocate libgcc_*.dylib on macOS
gartung 3337724
Merge remote-tracking branch 'llnl/develop' into build_caches
gartung 23d878a
keep a copy of spec.yaml out of the .spack tarball so it can be acces…
gartung 12393eb
keep a copy of spec.yaml out of the .spack tarball so it can be acces…
gartung c184489
Add buildcache list subcommand. Install buildcaches based on listed s…
gartung d77e971
Merge branch 'build_caches' of github.com:gartung/spack into build_ca…
gartung 04b0076
construct compiler spec to set gcc_prefix
gartung ff217da
put spec.yaml in build_cache dir
gartung 3670141
find dependcies the correct way
gartung a7fef8e
always relocate in case compiler prefix has changed
gartung dc2b964
Merge remote-tracking branch 'llnl/develop' into build_caches
gartung 38ec75a
perl seems to works more reliably
gartung c3f6efc
Add relative rpaths to elf objects if original rpath is in spack inst…
gartung 3bafaee
Add ability to install by hash
gartung 780cf4c
turn off debug print
gartung 232a1fd
temp fix
gartung 8b57f11
skip buildcache of externals
gartung 478a7cc
format spec when printing
gartung 9cfc344
Reconstruct install directory from spec.yaml
gartung 2b0fa1f
prelocate for Mach-o objects too
gartung 45485c9
This changes the library ID of libgcc_s.1.dylib from an absolute path…
gartung 714c857
autopep8
gartung 72b8d3f
make changing to relative rpaths before tarball creation optional
gartung 90ce619
Merge branch 'develop' of https://github.com/LLNL/spack into gcc-libg…
gartung a69f312
make this a variant
gartung d875e54
Merge branch 'gcc-libgcc-rpath-resub' of github.com:gartung/spack int…
gartung 9dd3b57
Merge branch 'gcc-libgcc-rpath-resub' into build_caches
gartung dd25a40
Document the need for setting extra_rpaths. Use conflicts instead of …
gartung b7f5fd2
Merge branch 'gcc-libgcc-rpath-resub' into build_caches
gartung bc5e7c9
Add two python packages for editing mach-O headers. Much faster than …
gartung bb85cde
Merge branch 'py-mach-o-tools' into build_caches
gartung 4e3620f
autopep8
gartung cede86f
Merge branch 'gcc-libgcc-rpath-resub' into build_caches
gartung 29155a7
autopep8
gartung bae8c04
Merge branch 'gmp-generic' into build_caches
gartung 72f1ab2
remove perl ~ backup file
gartung 968fd77
Merge branch 'build_caches' of github.com:gartung/spack into build_ca…
gartung e5d32d5
remove non-overriding function
gartung 39a351c
Document the need for setting extra_rpaths. Use conflicts instead of …
gartung fe4eefe
Merge branch 'develop' of https://github.com/LLNL/spack into gcc-libg…
gartung 0729d67
Merge branch 'gcc-libgcc-rpath-resub' into build_caches
gartung 74afb10
All previous commits squashed into one.
gartung f3b2c9d
autopep8
gartung a2a66bf
Merge branch 'py-mach-o-tools' into build_caches
gartung 3d77dd0
Merge remote-tracking branch 'origin/binary_packages' into binary_pac…
gartung 431ae5f
don't submit these on this branch
gartung 47485f2
not needed since testing was removed
gartung 5f993d0
pep8 fixes
gartung 674d7b9
add the options to use pgp2 to sign and verify the build caches
gartung b9ab9a3
flake8 fixes
gartung ed301e8
move verify parsing
gartung b6f1f4d
fix order of arguments
gartung 4ac6d50
change order of arguments in correct function call
gartung 4a81550
make buildcache install -f remove install prefix before unpacking tar…
gartung 8a05baa
Set gpg2 signing and verifying to True by default.
gartung 169afab
Don't include gartung.key. The trusted keys should be copied into var…
gartung 685e458
add buildcache keys command to get keys on mirror and option to trust…
gartung fb46610
Ask before trusting keys downloaded from mirror.
gartung a610232
keep the spec file
gartung 4316403
Merge remote-tracking branch 'llnl/develop' into binary_packages
gartung File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think there should be a verification before this. Something like:
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Or
this key was found on mirror <mirror name>
.