Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unpin SQLAlchemy & sqlalchemy-bigquery #367

Merged
merged 4 commits into from
May 19, 2022
Merged

Unpin SQLAlchemy & sqlalchemy-bigquery #367

merged 4 commits into from
May 19, 2022

Conversation

kaxil
Copy link
Collaborator

@kaxil kaxil commented May 18, 2022

This commit unpins SQLAlchemy and sqlalchemy-bigquery dependency so we can use it with Airflow 2.3.

This PR also fixes the Sqlite issues that we were hacking around with quotes. I have also created a companion PR in Airflow: apache/airflow#23790 . Once this PR is merged and release, we can bump the Sqlite Provider and remove the logic of get_uri from this repo.

closes #351

@kaxil kaxil force-pushed the unpin-sqlalchemy-libs branch 6 times, most recently from 1ace8d9 to 91269f1 Compare May 19, 2022 01:07
@kaxil kaxil marked this pull request as ready for review May 19, 2022 01:22
@codecov
Copy link

codecov bot commented May 19, 2022

Codecov Report

Merging #367 (b40a28f) into main (fc91c8a) will increase coverage by 0.02%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main     #367      +/-   ##
==========================================
+ Coverage   93.01%   93.04%   +0.02%     
==========================================
  Files          56       57       +1     
  Lines        1962     1969       +7     
  Branches      303      302       -1     
==========================================
+ Hits         1825     1832       +7     
  Misses        100      100              
  Partials       37       37              
Impacted Files Coverage Δ
src/astro/databases/sqlite.py 100.00% <100.00%> (ø)
src/astro/sql/operators/agnostic_boolean_check.py 94.93% <100.00%> (+0.06%) ⬆️
src/astro/sql/operators/agnostic_save_file.py 92.15% <100.00%> (+0.66%) ⬆️
src/astro/sql/operators/sql_dataframe.py 96.34% <100.00%> (+0.04%) ⬆️
src/astro/sqlite_utils.py 100.00% <100.00%> (ø)
src/astro/utils/database.py 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 153b886...b40a28f. Read the comment docs.

kaxil added 4 commits May 19, 2022 11:03
This commit unpins `SQLAlchemy` and `sqlalchemy-bigquery` dependency so we can use it with Airflow 2.3
@kaxil kaxil merged commit ba4e6bd into main May 19, 2022
@kaxil kaxil deleted the unpin-sqlalchemy-libs branch May 19, 2022 10:57
kaxil added a commit that referenced this pull request May 19, 2022
This commit unpins `SQLAlchemy` and `sqlalchemy-bigquery` dependency so we can use it with Airflow 2.3.

This PR also fixes the Sqlite issues that we were hacking around with quotes. I have also created a companion PR in Airflow: apache/airflow#23790 . Once this PR is merged and release, we can bump the Sqlite Provider and remove the logic of `get_uri` from this repo.

closes #351

(cherry picked from commit ba4e6bd)
kaxil added a commit that referenced this pull request May 20, 2022
Uses https://docs.pytest.org/en/latest/how-to/usage.html#profiling-test-execution-duration to get a list of slowest 30 tests for which the durations is over 1.0s long.

This is a small change but will help identify if a test takes too long. Found a need to do that while working on #367 and #370
kaxil added a commit that referenced this pull request May 22, 2022
This commit unpins `SQLAlchemy` and `sqlalchemy-bigquery` dependency so we can use it with Airflow 2.3.

This PR also fixes the Sqlite issues that we were hacking around with quotes. I have also created a companion PR in Airflow: apache/airflow#23790 . Once this PR is merged and release, we can bump the Sqlite Provider and remove the logic of `get_uri` from this repo.

closes #351
kaxil added a commit that referenced this pull request May 22, 2022
Uses https://docs.pytest.org/en/latest/how-to/usage.html#profiling-test-execution-duration to get a list of slowest 30 tests for which the durations is over 1.0s long.

This is a small change but will help identify if a test takes too long. Found a need to do that while working on #367 and #370
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Unable to use the Python Astro SDK with Airflow 2.3.0
2 participants