Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Airbyte-ci: Ensure we set the working directory earlier #34136

Merged
merged 2 commits into from
Jan 11, 2024

Conversation

bnchrch
Copy link
Contributor

@bnchrch bnchrch commented Jan 11, 2024

Problem

Globs we use for exclude were being evaluated before the working directory was set.

Leading to files that should be excluded appearing in dagger containers if the airbyte-ci commmand was not run from root

Quick Solution

Hoist the function call higher

closes #34070

@bnchrch bnchrch requested a review from a team January 11, 2024 00:54
Copy link

vercel bot commented Jan 11, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Jan 11, 2024 8:44pm

@evantahler
Copy link
Contributor

Oh! This makes more sense than hidden dir magic, or is that still something to watch out for?

@bnchrch
Copy link
Contributor Author

bnchrch commented Jan 11, 2024

@evantahler Still technically an issue
python/cpython#81759
https://stackoverflow.com/questions/49047402/python-glob-include-hidden-files-and-folders

But only if we need to keep a hidden folder and ignore a path inside of it.

@bnchrch
Copy link
Contributor Author

bnchrch commented Jan 11, 2024

/approve-and-merge reason="format and test pass locally, but fail in due to a known issue with dagger"

@octavia-approvington
Copy link
Contributor

Lets do it!
giddddy-up

@octavia-approvington octavia-approvington merged commit 9a36660 into master Jan 11, 2024
19 of 21 checks passed
@octavia-approvington octavia-approvington deleted the bnchrch/ci/fix-exclude branch January 11, 2024 21:08
@@ -0,0 +1,57 @@
import logging
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing license header 😄

jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 26, 2024
jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 26, 2024
jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Dagger excludes does not work for hidden files/folders
4 participants