Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

self-hosted spack, or container spackOS #42082

Draft
wants to merge 54 commits into
base: develop
Choose a base branch
from
Draft

self-hosted spack, or container spackOS #42082

wants to merge 54 commits into from

Commits on Jan 30, 2024

  1. in-progress bootstrap setup

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    fd6a43c View commit details
    Browse the repository at this point in the history

  2. add libstdcxx

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    f6760d9 View commit details
    Browse the repository at this point in the history

  3. first successful gcc

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    d2c4622 View commit details
    Browse the repository at this point in the history

  4. allow setting a spackos through env for now

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    0206d4d View commit details
    Browse the repository at this point in the history

  5. better gcc flag handling for the stage1 compiler

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    5f222cf View commit details
    Browse the repository at this point in the history

  6. cc: work around -v split between ld and ccld

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    bacd8a0 View commit details
    Browse the repository at this point in the history

  7. almost complete stage 3 gcc, should be fully independent now

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    11ee3b6 View commit details
    Browse the repository at this point in the history

  8. avoid glibc cycle through gcc-runtime

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    defd831 View commit details
    Browse the repository at this point in the history

  9. gcc: inject -B into configure to build runtime libs

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    1d9935a View commit details
    Browse the repository at this point in the history

  10. hide build deps from glibc, nasty but necessary

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    89ddde9 View commit details
    Browse the repository at this point in the history

  11. ensure stage1 does not try to build with threads

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    13c1f71 View commit details
    Browse the repository at this point in the history

  12. fix python library searching

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    4f88d18 View commit details
    Browse the repository at this point in the history

  13. tweak env, fix linux-pam build

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    fe582b5 View commit details
    Browse the repository at this point in the history

  14. ensure headers are copied into place in glibc

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    3eff942 View commit details
    Browse the repository at this point in the history

  15. patch system paths out of gcc when built for spackos

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    f55d929 View commit details
    Browse the repository at this point in the history

  16. first version of spack stage environment files

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    ee01f52 View commit details
    Browse the repository at this point in the history

  17. switch sysroot variant to stage0 since we do not need the value

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    d55350f View commit details
    Browse the repository at this point in the history

  18. stage0 refactor complete, successful build

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    b4ca46a View commit details
    Browse the repository at this point in the history

  19. linux-headers needs to be NoDep

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    21d4088 View commit details
    Browse the repository at this point in the history

  20. refactor up through stage2

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    7e78e25 View commit details
    Browse the repository at this point in the history

  21. fix up glibc/libxcrypt include handling to use idirafter

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    37fa8f9 View commit details
    Browse the repository at this point in the history

  22. version 2 full bootstrap

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    e03009d View commit details
    Browse the repository at this point in the history

  23. fix broken stage4 path for docker, add dockerfile

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    0620bd9 View commit details
    Browse the repository at this point in the history

  24. mark more things as build-tools

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    515e2cd View commit details
    Browse the repository at this point in the history

  25. tweak glibc deps

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    fcfdbfd View commit details
    Browse the repository at this point in the history

  26. avoid python using system paths

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    0650369 View commit details
    Browse the repository at this point in the history

  27. munge only installs a pkgconfig if /usr/lib/pkgconfig or similar exis… 

    …ts, fix
    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    4edd273 View commit details
    Browse the repository at this point in the history

  28. add some bootstrap automation, use docker to make it reasonably repro… 

    …ducible
    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    594c5fc View commit details
    Browse the repository at this point in the history

  29. refactor bootstrap to work on multiple architectures

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    73ca288 View commit details
    Browse the repository at this point in the history

  30. add padding and fix ARCH replacement

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    a20e337 View commit details
    Browse the repository at this point in the history

  31. make it easier to drop into the docker env

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    a2be05a View commit details
    Browse the repository at this point in the history

  32. break cycle for gnuconfig dep

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    6466325 View commit details
    Browse the repository at this point in the history

  33. gcc needs crypt for libsanitizer

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    9eb2bb9 View commit details
    Browse the repository at this point in the history

  34. fix bootstrap

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    1b846b7 View commit details
    Browse the repository at this point in the history

  35. do not use +bootstrap on gcc, too fragile

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    0494a52 View commit details
    Browse the repository at this point in the history

  36. add iconv and remove vestigial versions list from glibc

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    1bbf7d3 View commit details
    Browse the repository at this point in the history

  37. krb5 needs libedit, only found during a highly parallel build of boot… 

    …strap
    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    2396517 View commit details
    Browse the repository at this point in the history

  38. convert to a depfile/make based bootstrap 

    bootstraps/Makefile defines the full bootstrap in terms of the
environments in the four subdirectories, after converting to
requirements, this is greatly cleaned up and almost entirely declarative
now.  The remaining issues being having to enforce the glibc hash in
stages 3 and 4, and relying on only the spack built gcc being exactly
version 13.2.0 and the host offering at least one lower-version gcc.
    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    73d42e1 View commit details
    Browse the repository at this point in the history

  39. move bootstraps to a more reasonable location

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    62f1bfa View commit details
    Browse the repository at this point in the history

  40. add comment to glibc about linux-headers dep type

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    dccfd3b View commit details
    Browse the repository at this point in the history

  41. update stage numbers, fix up makefile 

    This is getting much closer, full bootstrap works again, stage numbers
line up, depfile all the way through, much cleaner.
    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    c0e64e7 View commit details
    Browse the repository at this point in the history

  42. perl, allow wrappers to work in perl packages built with spack perl

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    d625d4a View commit details
    Browse the repository at this point in the history

  43. first step to getting llvm building and working on spackos, builds a … 

    …working compiler that needs path tweaks to work, fails to build runtimes because of path issues
    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    9dfe50e View commit details
    Browse the repository at this point in the history

  44. actually add top-level makefile, thanks @alalazo

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    7035097 View commit details
    Browse the repository at this point in the history

  45. Update share/spack/spackos-bootstrap/stage4/spack.in.yaml 

    Co-authored-by: Harmen Stoppels <harmenstoppels@gmail.com>
    @trws @haampie
    trws and haampie committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    9b755d9 View commit details
    Browse the repository at this point in the history

  46. Update share/spack/spackos-bootstrap/stage4/spack.in.yaml 

    Co-authored-by: Harmen Stoppels <harmenstoppels@gmail.com>
    @trws @haampie
    trws and haampie committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    4b52293 View commit details
    Browse the repository at this point in the history

  47. fix PATH to point to stage1 view

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    33f073f View commit details
    Browse the repository at this point in the history

  48. fix write permission for owner on cpanm

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    ffbf3ad View commit details
    Browse the repository at this point in the history

  49. update paths in dockerfile

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    40b36aa View commit details
    Browse the repository at this point in the history

  50. add add nodep target for the container

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    1d048b3 View commit details
    Browse the repository at this point in the history

  51. clean up stage packages

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    95c8cf6 View commit details
    Browse the repository at this point in the history

  52. remove gettext and texinfo from the bottom of the stack by default

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    cf03ae1 View commit details
    Browse the repository at this point in the history

  53. fix gcc-runtime behavior by version-naming each compiler

    @trws
    trws committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    03c4119 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Merge remote-tracking branch 'upstream/develop' into bootstrap-test

    @trws
    trws committed May 24, 2024
    Configuration menu
    Copy the full SHA
    d853e0f View commit details
    Browse the repository at this point in the history