Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Openlineage support - Add Extractor for TransformOperator #902

Closed
8 tasks
kaxil opened this issue Sep 23, 2022 · 0 comments · Fixed by #1056
Closed
8 tasks

Openlineage support - Add Extractor for TransformOperator #902

kaxil opened this issue Sep 23, 2022 · 0 comments · Fixed by #1056
Assignees
Labels
feature New feature or request priority/high High priority product/python-sdk Label describing products
Milestone

Comments

@kaxil
Copy link
Collaborator

kaxil commented Sep 23, 2022

Please describe the feature you'd like to see
We should be able to extract open lineage info from the TransformOperator.

Describe the solution you'd like

Acceptance Criteria

  • Post the screenshot of how it looks in the Openlineage/Marquez UI
  • All checks and tests in the CI should pass
  • Unit tests (90% code coverage or more, once available)
  • Integration tests (if the feature relates to a new database or external service)
  • Docstrings in reStructuredText for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
  • Exception handling in case of errors
  • Logging (are we exposing useful information to the user? e.g. source and destination)
  • Improve the documentation (README, Sphinx, and any other relevant)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request priority/high High priority product/python-sdk Label describing products
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants