Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hatchling reads .gitignore files outside the project tree, possibly generating broken wheels #1069

Closed
mgorny opened this issue Nov 30, 2023 · 8 comments · Fixed by #1317
Closed

Comments

@mgorny
Copy link
Contributor

mgorny commented Nov 30, 2023

Originally reported as https://bugs.gentoo.org/918677

Hatchling aggressively scans parent directories for .gitignore files, going as far as to read files that are outside the project tree (i.e. above pyproject.toml), even if they are not inside any git repository (which is against the principle of least surprise). If one of these files include the project directory, then hatchling creates an empty wheel.

To reproduce:

mkdir -p test/sub/sub
echo sub > test/.gitignore
cat > test/sub/pyproject.toml <<-EOF
    [build-system]
    requires = ["hatchling"]
    build-backend = "hatchling.build"

    [project]
    name = "sub"
    version = "0"
    description = "test"
EOF
echo > test/sub/sub/__init__.py
cd test/sub
python -m build -w

The result is:

$ unzip -l dist/sub-0-py2.py3-none-any.whl 
Archive:  dist/sub-0-py2.py3-none-any.whl
  Length      Date    Time    Name
---------  ---------- -----   ----
       57  02-02-2020 00:00   sub-0.dist-info/METADATA
      105  02-02-2020 00:00   sub-0.dist-info/WHEEL
      181  02-02-2020 00:00   sub-0.dist-info/RECORD
---------                     -------
      343                     3 files

I think there are two issues here:

  1. .gitignore are being used even if they're not inside a git repository. In this case, the user assumed that renaming .git should be sufficient not to have packages affected by .git* files.
  2. .gitignore are being used even when they explicitly ignore the whole project tree. This naturally implies (at least to git) that the project tree is not a part of the git repository, so hatchling shouldn't be using any rules from that repository.
@mgorny
Copy link
Contributor Author

mgorny commented Nov 30, 2023

Oh, I think it also reads .gitignore from parent directories outside the current repository. It really shouldn't do that.

@ofek
Copy link
Collaborator

ofek commented Nov 30, 2023

Hello again! Yes I plan to improve this situation next year.

@mgorny
Copy link
Contributor Author

mgorny commented Nov 30, 2023

Thanks! Would it make sense, in the meantime, to throw an error if all package files end up being ignored? This could at least make it easier to figure out what's wrong.

@ofek
Copy link
Collaborator

ofek commented Nov 30, 2023

Do you mean if there was no file that matched for inclusion in the artifact like a wheel?

@mgorny
Copy link
Contributor Author

mgorny commented Nov 30, 2023

Yes.

@philippgl
Copy link

philippgl commented Feb 14, 2024

I ran into this problem with hatch shell and hatch run (and with rye as well).

It actually is a hatchling problem and affects the pip install -e part during the env creation.

The workaround is to just put a .gitignore besides the pyproject.toml in the same directory.

I also have my home directory set up as git repo and have a .gitignore with * inside, so this basically affects all my newly created venvs until I place a .gitignore there.

(Stopping at the pyproject.toml might break mono repos, but on the other hand looking outside the project is extremely surprising. Maybe have some non-default switch in a hatchling section of the pyproject.toml, that stops at the .git directory instead.)

@CroMarmot
Copy link

#903 reported the same issue in 2023-jul-04 , and is about 5 months ahead of this issue and https://bugs.gentoo.org/918677

@jameshilliard
Copy link
Contributor

2. .gitignore are being used even when they explicitly ignore the whole project tree. This naturally implies (at least to git) that the project tree is not a part of the git repository, so hatchling shouldn't be using any rules from that repository.

I think #1643 should fix this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants