Skip to content

Fix few caveats in provider release process#36264

Merged
potiuk merged 1 commit intoapache:mainfrom
potiuk:fix-small-caveats-in-provider-release-process
Dec 17, 2023
Merged

Fix few caveats in provider release process#36264
potiuk merged 1 commit intoapache:mainfrom
potiuk:fix-small-caveats-in-provider-release-process

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Dec 17, 2023

There were few small problems in release process:

  1. When the SVN directories were in symbolically linked directories, svn
    got into locked directory status
  2. Cleaning old relases failed to find the files in current directory,
    because breeze changes working directory before running and the .
    directory was really airflow repository, thus no released artifacts
    could be found.
  3. When the old releases contained _ rather thatn - (as it was
    in the bdist_wheel prepared packages) then we failed to delet the
    files because the file names for them were constructed from the
    normalized file names (with -).

This PR fixes those problems:

  1. VAR=$(pwd -P) is used in order to resolve potentially symbolically
    linked urrent working directory and cd ${VAR} is used to switch dir
    to them
  2. The same $(pwd -P) is used to pass the directory to the
    clean-old-provider-artifacts command to avoid interpreting . as
    "AIRFLOW_ROOT" directory.
  3. Filen name is stored in FileVersion and used to run actual svn rm
    command - this way the right file name will be used, regardless from
    normalization of the package names.

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

There were few small problems in release process:

1) When the SVN directories were in symbolically linked directories, svn
   got into locked directory status
2) Cleaning old relases failed to find the files in current directory,
   because breeze changes working directory before running and the `.`
   directory was really `airflow` repository, thus no released artifacts
   could be found.
3) When the old releases contained `_` rather thatn `-` (as it was
   in the bdist_wheel prepared packages) then we failed to delet the
   files because the file names for them were constructed from the
   normalized file names (with `-`).

This PR fixes those problems:

1) `VAR=$(pwd -P)` is used in order to resolve potentially symbolically
   linked urrent working directory and `cd ${VAR}` is used to switch dir
   to them
2) The same `$(pwd -P)` is used to pass the directory to the
   clean-old-provider-artifacts command to avoid interpreting `.` as
   "AIRFLOW_ROOT" directory.
3) Filen name is stored in FileVersion and used to run actual `svn rm`
   command - this way the right file name will be used, regardless from
   normalization of the package names.
@potiuk potiuk requested review from amoghrajesh and removed request for ashb, jedcunningham, kaxil and pierrejeambrun December 17, 2023 17:01
@potiuk potiuk requested a review from eladkal December 17, 2023 17:01
@potiuk potiuk changed the title Fix few caveats in provider rlease process Fix few caveats in provider release process Dec 17, 2023
@potiuk potiuk merged commit ca7299e into apache:main Dec 17, 2023
@potiuk potiuk deleted the fix-small-caveats-in-provider-release-process branch December 17, 2023 18:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants