Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix the conn_id missing in output table #1181

Merged
merged 16 commits into from
Nov 4, 2022
Merged

Fix the conn_id missing in output table #1181

merged 16 commits into from
Nov 4, 2022

Conversation

sunank200
Copy link
Contributor

@sunank200 sunank200 commented Nov 2, 2022

Description

What is the current behavior?

conn_id is missing in output table for transform operator. It should be checked for that

closes: #1152

What is the new behavior?

  • Check if conn_id is empty
  • Push row count of output table to xcom
  • Fixed some flaky test

Does this introduce a breaking change?

No

Checklist

  • Created tests which fail without the change (if possible)
  • Extended the README / documentation, if necessary

@codecov
Copy link

codecov bot commented Nov 2, 2022

Codecov Report

Base: 94.43% // Head: 94.20% // Decreases project coverage by -0.22% ⚠️

Coverage data is based on head (4288f0a) compared to base (530a874).
Patch coverage: 100.00% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1181      +/-   ##
==========================================
- Coverage   94.43%   94.20%   -0.23%     
==========================================
  Files          16       68      +52     
  Lines         521     3140    +2619     
  Branches       51      358     +307     
==========================================
+ Hits          492     2958    +2466     
- Misses         20      120     +100     
- Partials        9       62      +53     
Impacted Files Coverage Δ
python-sdk/src/astro/exceptions.py 100.00% <ø> (ø)
python-sdk/src/astro/utils/typing_compat.py 100.00% <ø> (ø)
...thon-sdk/src/astro/sql/operators/base_decorator.py 94.91% <100.00%> (ø)
python-sdk/src/astro/sql/operators/transform.py 86.66% <100.00%> (ø)
python-sdk/src/astro/sql/operators/merge.py 96.00% <0.00%> (ø)
python-sdk/src/astro/databases/aws/redshift.py 93.89% <0.00%> (ø)
...k/src/astro/custom_backend/astro_custom_backend.py 88.88% <0.00%> (ø)
python-sdk/src/astro/databases/base.py 95.04% <0.00%> (ø)
python-sdk/src/astro/files/types/json.py 100.00% <0.00%> (ø)
... and 46 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

Copy link
Contributor

@pankajastro pankajastro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@pankajastro pankajastro merged commit 2b4ff04 into main Nov 4, 2022
@pankajastro pankajastro deleted the fix-transform-ol branch November 4, 2022 14:52
utkarsharma2 pushed a commit that referenced this pull request Nov 4, 2022
# Description
## What is the current behavior?
<!-- Please describe the current behavior that you are modifying. -->
`conn_id` is missing in output table for transform operator. It should
be checked for that

<!--
Issues are required for both bug fixes and features.
Reference it using one of the following:

closes: #ISSUE
related: #ISSUE
-->
closes: #1152


## What is the new behavior?
<!-- Please describe the behavior or changes that are being added by
this PR. -->

- Check if `conn_id` is empty
- Push row count of output table to xcom
- Fixed some flaky test

## Does this introduce a breaking change?
No

### Checklist
- [x] Created tests which fail without the change (if possible)
- [x] Extended the README / documentation, if necessary

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: rajaths010494 <rajath.srinivasaiah@astronomer.io>
Co-authored-by: Pankaj Singh <98807258+pankajastro@users.noreply.github.com>
Co-authored-by: Pankaj <pankaj.singh@astronomer.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Conn ID not found on Extraction with the @aql.transform() Decorator
4 participants