Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create a self-hosting bundle during builds #35

Merged
merged 103 commits into from
Mar 5, 2018
Merged

Create a self-hosting bundle during builds #35

merged 103 commits into from
Mar 5, 2018

Conversation

sangaline
Copy link
Member

@sangaline sangaline commented Mar 5, 2018 •
edited
Loading

This creates a bundle of exodus itself during builds. This allows for quickly installing exodus in an environment that lacks python and pip (e.g. a light docker container). Only bash launchers are supported at the moment--unless musl-gcc is available on the host system--but perhaps the launchers can be procompiled and templated in the future.

@sangaline
Create a python 2 virtualenv and install bbfreeze.
22434ed
@sangaline
Deactivate the python 3 virtualenv after creating the python 2 one.
90dae07
@sangaline
Add a first pass of building with bbfreeze.
bee67c5
@sangaline
Add a hack to find the template directory when using bbfreeze.
ff5fdfe
@sangaline
Add missing command key.
b970c59
@sangaline
Fix the bbfreeze template hack.
cf6a7a5
@sangaline
Remove the for loop initial declaration in the c launcher.
8cfe20a
@sangaline
Exclude temporary exodus bundle directories when parsing strace output.
e62e243
@sangaline
Add musl and gcc as dependencies.
96ff234
@sangaline
Create the final bundles using exodus.
d4c000b
@sangaline
Add strace as a dependency.
0566551
@sangaline
Remove the for loop initial declaration in fizz-buzz.
9dfb337
@sangaline
Add a trailing comma.
0363903
@sangaline
Use gcc instead of ls to produce the strace output for bundling.
dd5f6d8
@sangaline
Add an exodus-bundle- prefix to the temporary launcher filename.
12ff86a
@sangaline
Use the exodus-bundle- prefix for the build output too.
024aa1c
@sangaline
Exclude the bbfreeze library.zip file from having a launcher.
816502c
@sangaline
Merge branch 'version-2' into ews-create-a-self-hosting-bundle-during…
47088f5 
…-builds
@sangaline
Fix the bbfreeze library.zip hack.
9f08327
@sangaline
Remove the bbfreeze hacks.
07a4b5c
@sangaline
Remove the bbfreeze stuff from the CircleCI config.
e619dff
@sangaline
Fix: make sure that the directory exists before copying.
85f13b0
@sangaline
Merge branch 'version-2' into ews-try-pure-self-hosting
271218f
@sangaline
Add back the installation of the extra dependencies.
31c41be
@sangaline
Add in all of the extra dependencies to the exodus bundle.
83831ec
@sangaline
Activate the python 3 virtualenv instead of the old python 2 one.
f9040f3
@sangaline
Construct a small C launcher to use as an entrypoint for exodus.
517bc7c
@sangaline
Avoid buffer overflows.
7f28270
@sangaline
Set LD_LIBRARY_PATH before bundling exodus.
cf67340
@sangaline
Add /lib/x86_64-linux-gnu/ to LD_LIBRARY_PATH.
93c41d2
@sangaline
Specify the correct path for gcc.
9926bab
@sangaline
Add some $ escapes.
0b62da8
@sangaline
Add the x86_64-linux-musl directory as an explicit depdency.
d495fdb
@sangaline
Switch from gcc to pwd because gcc is statically linked.
d558c7f
@sangaline
Include forked process system calls when running strace.
5ce31c9
@sangaline
Strip PID prefixes from strace output when using -f.
c6b9904
@sangaline
Make the exodus bundles as root.
f9bfc3a
@sangaline
Temporarily disable extract_stat_path().
b5c51da
@sangaline
Only consider existent paths from strace outputs.
7f287d1
@sangaline
Turn the stat() extraction back on.
ce0b602
@sangaline
Require read access on files parsed from strace outputs.
fdbda4c
@sangaline
Disable the stat() calls.
c1c8162
@sangaline
Re-enable stat() paths again.
dff7717
@sangaline
Exclude directories from parsed strace() output.
97f180c
@sangaline
Switch to using python 2.
45c988f
@sangaline
No longer set PYTHONHOME.
0bb3287
@sangaline
Fix the first exodus invocations.
05513f7
@sangaline
Try bundling without the ld cache.
5cd7f37
@sangaline
Bundle as an unprivileged user.
ca2b90b
@sangaline
Try it with clang instead of gcc.
dc78e34
@sangaline
Add /usr/lib/x86_64-linux-gnu/ to LD_LIBRARY_PATH.
44ad57f
@sangaline
Cut losses and make a bundle without the compilers.
f295f13
@sangaline
Add a --shell-launchers flag for forcing the use of shell launchers.
d122766
@sangaline
Use the --shell-launchers flag during self-bundling.
cfd5499
@sangaline
Fix linting whitespace issue.
f3678da
@sangaline
Raise a CompilerNotFoundError when --shell-launchers is specified.
8ac0c2d
@sangaline
Fix: wasn't passing shell_launchers along as an argument.
b2fc939
@sangaline
Don't display the fallback warning when --shell-launchers is specif…
38a511b 
…ied.
@sangaline sangaline merged commit 5b8efac into version-2 Mar 5, 2018
@sangaline sangaline deleted the ews-try-pure-self-hosting branch March 5, 2018 16:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sangaline