Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upcoming high-impact changes (perma-pin) #24223

Closed
tgamblin opened this issue Jun 9, 2021 · 1 comment
Closed

Upcoming high-impact changes (perma-pin) #24223

tgamblin opened this issue Jun 9, 2021 · 1 comment

Comments

@tgamblin
Copy link
Member

tgamblin commented Jun 9, 2021

This issue is meant to track upcoming changes to Spack that are likely to impact users. We'll put links to issues here that will either break existing workflows or cause major disruptions when you pull from develop.

develop is the main development branch of Spack, but many users like to stay at the bleeding edge, and this is intended to provide advance warning for those users. Note that we still recommend using either a release (more here)or a fixed commit from develop for production/large site deployments.

High-impact changes to hit before v0.18:

  • concretizer: make --reuse the default behavior #29111: We will be making --reuse the default concretizer behavior. This will be configurable so you can revert back using Add a top-level concretizer config scope and --fresh option #28468.
  • Switch to full hash everywhere #28504: After --reuse is default, we will be switching to a "full hash" as the default package id in Spack. Spack has long used a coarser package hash that it probably should, in order to prevent redundant rebuilds. Specifically, we omit build dependencies, the hash of package.py, and the hashes of resources (tarballs, etc.) from our build identifiers. This was mainly to prevent every update of cmake or other build tools from triggering a rebuild of the full stack. With --reuse as the default, we don't have this concern any more, and we will prioritize detailed provenance for package builds. The full hash will provide this and will also avoid hash collisions that we currently see in CI.
  • Allow for multiple dependencies/dependents from the same package #28673: This PR allows a given spec to depend on multiple instances of the same package, differentiated by dependency type; recording the dependency type will change the underlying storage representation
  • PythonPackage: install packages with pip #27798: This PR completely changes how we install Python packages to run pip install instead of python setup.py install. It also improves bootstrapping of frontend tools (pip/build/installer) and backend tools (setuptools/flit/poetry).
  • Revert "Deprecate Python 2 installations" #28411: We got some volunteers and will be reverting the change below. Spack will continue to support Python 2.7 and 3.5 for reproducibility.
  • Deprecate Python 2 installations #28003: This PR deprecates versions of Python that have reached EOL (Python 2.7-3.5) and packages that require them. Note that this PR does not affect which versions of Python can be used to run Spack, it only affects which versions of Python Spack can install.

High-impact changes for Spack v0.17:

  • specs: move to new spec.json format with build provenance #22845: This PR changes the spec.yaml format that Spack uses for hashes to spec.json. We're doing this for performance -- YAML is too slow for large operations, like reindexing the Spack database or creating indexes for large build caches. We expect this to speed up Spack in many ways, but it will cause the hashing algorithm to change.
  • Make clingo the default solver #25502: This PR makes clingo the default solver, in preparation for 0.17.0. You may see different concretizations for some packages, and the new concretizer will need to be bootstrapped (see https://spack.io/changes-spack-v017/). You can switch back by setting concretizer: original in config.yaml, but note that the original concretizer will be deprecated in 0.17 and removed in a later version.
  • Remove support for Python 2.6 #27256: Python 2.6 was deprecated in Spack v0.17.0 and support has been removed in develop -- it will not be supported in v0.18.
@tgamblin tgamblin pinned this issue Jun 9, 2021
@spack spack deleted a comment from scheibelp Jun 10, 2021
@frankwillmore frankwillmore unpinned this issue Jun 23, 2021
@tgamblin tgamblin pinned this issue Jun 28, 2021
@tgamblin tgamblin changed the title Upcoming high-impact changes Upcoming high-impact changes (permanent pin) Jun 28, 2021
@tgamblin tgamblin changed the title Upcoming high-impact changes (permanent pin) Upcoming high-impact changes (perma-pin) Jun 28, 2021
@spack spack deleted a comment from frankwillmore Jun 29, 2021
@tldahlgren tldahlgren unpinned this issue Jul 22, 2021
@tgamblin tgamblin pinned this issue Aug 14, 2021
@jpopelar jpopelar unpinned this issue Sep 15, 2021
@tgamblin tgamblin pinned this issue Nov 11, 2021
@bernhardkaindl bernhardkaindl unpinned this issue Dec 22, 2021
@tgamblin tgamblin pinned this issue Jan 17, 2022
@RikkiButler20 RikkiButler20 unpinned this issue Jan 25, 2022
@tgamblin tgamblin pinned this issue Jan 28, 2022
@haampie
Copy link
Member

haampie commented Mar 16, 2022

@tgamblin can you be a bit more precise about "hit develop soon"? Before or after 0.18 branches off?

@johnwparent johnwparent unpinned this issue Mar 17, 2022
@tgamblin tgamblin pinned this issue May 12, 2022
@spack spack locked and limited conversation to collaborators May 12, 2022
@tgamblin tgamblin converted this issue into discussion #30634 May 12, 2022
@tgamblin tgamblin unpinned this issue May 21, 2022

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Projects
None yet
Development

No branches or pull requests

2 participants