This repository has been archived by the owner on Apr 11, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Add github workflow with tests for CI (#2)
* Add github workflow with test-connections * Change relative path * Add evn var * Fix CI * Update snowflake role * Fix snowflake conn --------- Co-authored-by: utkarsh sharma <utkarsharma2@gmail.com>
- Loading branch information
1 parent
251ed96
commit 6ddeda9
Showing
17 changed files
with
1,011 additions
and
51 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
version = 1 | ||
|
||
test_patterns = [ | ||
"universal_transfer_operator/tests/**", | ||
"universal_transfer_operator/tests_integration/**" | ||
] | ||
|
||
[[analyzers]] | ||
name = "python" | ||
enabled = true | ||
|
||
[analyzers.meta] | ||
runtime_version = "3.x.x" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,14 @@ | ||
.coverage | ||
.env | ||
.git | ||
.idea | ||
.mypy_cache | ||
.nox | ||
.pytest_cache | ||
__pycache__ | ||
dev | ||
docs | ||
example_dags | ||
mk | ||
tests | ||
dev/logs |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,32 @@ | ||
--- | ||
name: Bug report | ||
about: Create a report to help us improve | ||
title: '' | ||
labels: '' | ||
assignees: '' | ||
|
||
--- | ||
|
||
**Describe the bug** | ||
A clear and concise description of what the bug is. | ||
|
||
**Version** | ||
* Astro: [e.g. 0.6.0] | ||
* OS: [eg. Debian] | ||
|
||
**To Reproduce** | ||
Steps to reproduce the behavior: | ||
1. Write the DAG '...' | ||
2. Create connection '....' | ||
3. Run using '....' | ||
4. See error | ||
|
||
**Expected behavior** | ||
A clear and concise description of what you expected to happen. | ||
|
||
**Screenshots** | ||
If applicable, add screenshots to help explain your problem. | ||
|
||
|
||
**Additional context** | ||
Add any other context about the problem here. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
--- | ||
contact_links: | ||
- name: Ask a question or get support (Forum) | ||
url: https://github.com/astronomer/apache-airflow-provider-transfers | ||
about: Ask a question or request support for using this package |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,33 @@ | ||
--- | ||
name: Feature request | ||
about: Suggest an idea for this project | ||
title: '' | ||
labels: feature | ||
assignees: '' | ||
|
||
--- | ||
|
||
**Please describe the feature you'd like to see** | ||
A clear and concise description of what problem feature solves or what use-case it would enable. | ||
e.g. "I really wish I could ...", "I'm sad that I can't..." | ||
|
||
**Describe the solution you'd like** | ||
A clear and concise description of what you want to happen, if possible with code examples. | ||
|
||
**Are there any alternatives to this feature?** | ||
Is there another way we could solve this problem or enable this use-case? | ||
|
||
**Additional context** | ||
Add any other context about the feature request here. | ||
|
||
**Acceptance Criteria** | ||
|
||
- [ ] All checks and tests in the CI should pass | ||
- [ ] Unit tests (90% code coverage or more) | ||
- [ ] Integration tests (if the feature relates to a new database or external service) | ||
- [ ] Example DAG | ||
- [ ] Docstrings in [reStructuredText](https://peps.python.org/pep-0287/) for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used) | ||
- [ ] Exception handling in case of errors | ||
- [ ] Logging (are we exposing useful information to the user? e.g. source and destination) | ||
- [ ] Improve the documentation (README, Sphinx, and any other relevant) | ||
- [ ] How to use Guide for the feature ([example](https://airflow.apache.org/docs/apache-airflow-providers-postgres/stable/operators/postgres_operator_howto_guide.html)) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
# Description | ||
## What is the current behavior? | ||
<!-- Please describe the current behavior that you are modifying. --> | ||
|
||
|
||
<!-- | ||
Issues are required for both bug fixes and features. | ||
Reference it using one of the following: | ||
closes: #ISSUE | ||
related: #ISSUE | ||
--> | ||
|
||
|
||
## What is the new behavior? | ||
<!-- Please describe the behavior or changes that are being added by this PR. --> | ||
|
||
- | ||
- | ||
- | ||
|
||
## Does this introduce a breaking change? | ||
|
||
|
||
### Checklist | ||
- [ ] Created tests which fail without the change (if possible) | ||
- [ ] Extended the README / documentation, if necessary |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,77 @@ | ||
connections: | ||
- conn_id: postgres_conn | ||
conn_type: postgres | ||
host: localhost | ||
schema: | ||
login: postgres | ||
password: postgres | ||
port: 5432 | ||
extra: | ||
- conn_id: postgres_conn_pagila | ||
conn_type: postgres | ||
host: localhost | ||
schema: pagila | ||
login: postgres | ||
password: postgres | ||
port: 5432 | ||
extra: | ||
- conn_id: snowflake_conn | ||
conn_type: snowflake | ||
host: https://gp21411.us-east-1.snowflakecomputing.com | ||
port: 443 | ||
login: $SNOWFLAKE_ACCOUNT_NAME | ||
password: $SNOWFLAKE_PASSWORD | ||
schema: ASTROFLOW_CI | ||
extra: | ||
account: "gp21411" | ||
region: "us-east-1" | ||
role: "AIRFLOW_TEST_USER" | ||
warehouse: ROBOTS | ||
database: SANDBOX | ||
- conn_id: snowflake_conn_1 | ||
conn_type: snowflake | ||
host: https://gp21411.us-east-1.snowflakecomputing.com | ||
port: 443 | ||
login: $SNOWFLAKE_ACCOUNT_NAME | ||
password: $SNOWFLAKE_PASSWORD | ||
extra: | ||
account: "gp21411" | ||
region: "us-east-1" | ||
role: "AIRFLOW_TEST_USER" | ||
warehouse: ROBOTS | ||
- conn_id: bigquery | ||
conn_type: bigquery | ||
description: null | ||
extra: | ||
project: "astronomer-dag-authoring" | ||
host: null | ||
login: null | ||
password: null | ||
port: null | ||
schema: null | ||
- conn_id: sqlite_conn | ||
conn_type: sqlite | ||
host: /tmp/sqlite.db | ||
schema: | ||
login: | ||
password: | ||
- conn_id: gcp_conn | ||
conn_type: google_cloud_platform | ||
description: null | ||
extra: null | ||
- conn_id: aws_conn | ||
conn_type: aws | ||
description: null | ||
extra: null | ||
- conn_id: gcp_conn_project | ||
conn_type: google_cloud_platform | ||
description: null | ||
extra: | ||
project: "astronomer-dag-authoring" | ||
project_id: "astronomer-dag-authoring" | ||
- conn_id: sftp_conn | ||
conn_type: sftp | ||
host: $SFTP_HOSTNAME | ||
login: $SFTP_USERNAME | ||
password: $SFTP_PASSWORD | ||
port: 2222 |
Oops, something went wrong.