Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

airbyte-lib: Fix validation #34599

Merged
merged 2 commits into from
Jan 30, 2024
Merged

airbyte-lib: Fix validation #34599

merged 2 commits into from
Jan 30, 2024

Conversation

flash1293
Copy link
Contributor

The airbyte-lib-validate-source script is installing the connector under test to a venv to validate it works. However, it used to install using the -e flag which is linking back to the original source.

This is a bit faster than "regular" installs, but comes at the cost of not catching certain error conditions like non-python files not being included in the distribution bundle.

According to https://pip.pypa.io/en/stable/topics/local-project-installs/#regular-installs , doing a pip install <folder name> is a sufficient test for this kind of situation:

This will install the project into the Python that pip is associated with, in a manner similar to how it would actually be installed.

This is what should be used in CI system and for deployments, since it most closely mirrors how a package would get installed if you build a distribution and installed from it (because that’s exactly what it does).

Copy link

vercel bot commented Jan 29, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
airbyte-docs ⬜️ Ignored (Inspect) Visit Preview Jan 29, 2024 11:07am

Copy link
Collaborator

@aaronsteers aaronsteers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Noyce 🚀

@flash1293 flash1293 merged commit 42fb2b5 into master Jan 30, 2024
20 checks passed
@flash1293 flash1293 deleted the flash1293/fix-validation branch January 30, 2024 09:35
clnoll pushed a commit that referenced this pull request Jan 30, 2024
jbfbell pushed a commit that referenced this pull request Feb 1, 2024
jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 21, 2024
jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 26, 2024
jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 26, 2024
jatinyadav-cc pushed a commit to ollionorg/datapipes-airbyte that referenced this pull request Feb 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants