-
-
Notifications
You must be signed in to change notification settings - Fork 98
Introduce an experimental python
pipeline operator
#3592
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
b3378b4
to
dc154d7
Compare
f78508d
to
9490bff
Compare
f804188
to
be1532e
Compare
c5e7086
to
ad13139
Compare
31c29f9
to
5d6ec3e
Compare
f2502c6
to
f44d7be
Compare
26bae63
to
0266c41
Compare
We introduce `tenzir.cache-directory` to provide a location where tenzir can put cache files that help speedup repeated tasks.
* Fix the subnet extension type * Add utilites to infer tenzir types from python data
This change finally adds the `python` operator, along with docs, tests, and CI integration. Co-authored-by: Jannis Christopher Köhl <mail@koehl.dev> Co-authored-by: Benno Evers <benno.evers@tenzir.com>
0266c41
to
8c6fb1b
Compare
723e374
to
aeca5f8
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We decided to merge this despite the tests still failing in the macOS plugins build, because the error in question
is caused by the rolling upgrade of Github's macOS runners, causing the plugin builds to randomly run in a different environment than the tenzir build. Since this PR doesn't touch the other plugins' code at all and it feels silly to keep restarting the build until we get lucky, we decided to merge the PR anyways. |
This experimental operator is intended for situations where development velocity is more important than performance; it allows the user to run arbitrary code against the (converted-to-python) contents of a table slice.
Example:
Remaining Work
extra
s feature to avoid installing false dependencies for the operator venvs.