Skip to content
This repository has been archived by the owner on Apr 11, 2024. It is now read-only.

Commit

Permalink
Add github workflow with tests for CI (#2)
Browse files Browse the repository at this point in the history
* Add github workflow with test-connections

* Change relative path

* Add evn var

* Fix CI

* Update snowflake role

* Fix snowflake conn

---------

Co-authored-by: utkarsh sharma <utkarsharma2@gmail.com>
  • Loading branch information
sunank200 and utkarsharma2 committed Mar 27, 2023
1 parent 251ed96 commit 6ddeda9
Show file tree
Hide file tree
Showing 17 changed files with 1,011 additions and 51 deletions.
13 changes: 13 additions & 0 deletions .deepsource.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
version = 1

test_patterns = [
"universal_transfer_operator/tests/**",
"universal_transfer_operator/tests_integration/**"
]

[[analyzers]]
name = "python"
enabled = true

[analyzers.meta]
runtime_version = "3.x.x"
14 changes: 14 additions & 0 deletions .dockerignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
.coverage
.env
.git
.idea
.mypy_cache
.nox
.pytest_cache
__pycache__
dev
docs
example_dags
mk
tests
dev/logs
32 changes: 32 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
---
name: Bug report
about: Create a report to help us improve
title: ''
labels: ''
assignees: ''

---

**Describe the bug**
A clear and concise description of what the bug is.

**Version**
* Astro: [e.g. 0.6.0]
* OS: [eg. Debian]

**To Reproduce**
Steps to reproduce the behavior:
1. Write the DAG '...'
2. Create connection '....'
3. Run using '....'
4. See error

**Expected behavior**
A clear and concise description of what you expected to happen.

**Screenshots**
If applicable, add screenshots to help explain your problem.


**Additional context**
Add any other context about the problem here.
5 changes: 5 additions & 0 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
---
contact_links:
- name: Ask a question or get support (Forum)
url: https://github.com/astronomer/apache-airflow-provider-transfers
about: Ask a question or request support for using this package
33 changes: 33 additions & 0 deletions .github/ISSUE_TEMPLATE/feature_request.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
---
name: Feature request
about: Suggest an idea for this project
title: ''
labels: feature
assignees: ''

---

**Please describe the feature you'd like to see**
A clear and concise description of what problem feature solves or what use-case it would enable.
e.g. "I really wish I could ...", "I'm sad that I can't..."

**Describe the solution you'd like**
A clear and concise description of what you want to happen, if possible with code examples.

**Are there any alternatives to this feature?**
Is there another way we could solve this problem or enable this use-case?

**Additional context**
Add any other context about the feature request here.

**Acceptance Criteria**

- [ ] All checks and tests in the CI should pass
- [ ] Unit tests (90% code coverage or more)
- [ ] Integration tests (if the feature relates to a new database or external service)
- [ ] Example DAG
- [ ] Docstrings in [reStructuredText](https://peps.python.org/pep-0287/) for each of methods, classes, functions and module-level attributes (including Example DAG on how it should be used)
- [ ] Exception handling in case of errors
- [ ] Logging (are we exposing useful information to the user? e.g. source and destination)
- [ ] Improve the documentation (README, Sphinx, and any other relevant)
- [ ] How to use Guide for the feature ([example](https://airflow.apache.org/docs/apache-airflow-providers-postgres/stable/operators/postgres_operator_howto_guide.html))
27 changes: 27 additions & 0 deletions .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Description
## What is the current behavior?
<!-- Please describe the current behavior that you are modifying. -->


<!--
Issues are required for both bug fixes and features.
Reference it using one of the following:
closes: #ISSUE
related: #ISSUE
-->


## What is the new behavior?
<!-- Please describe the behavior or changes that are being added by this PR. -->

-
-
-

## Does this introduce a breaking change?


### Checklist
- [ ] Created tests which fail without the change (if possible)
- [ ] Extended the README / documentation, if necessary
77 changes: 77 additions & 0 deletions .github/ci-test-connections.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,77 @@
connections:
- conn_id: postgres_conn
conn_type: postgres
host: localhost
schema:
login: postgres
password: postgres
port: 5432
extra:
- conn_id: postgres_conn_pagila
conn_type: postgres
host: localhost
schema: pagila
login: postgres
password: postgres
port: 5432
extra:
- conn_id: snowflake_conn
conn_type: snowflake
host: https://gp21411.us-east-1.snowflakecomputing.com
port: 443
login: $SNOWFLAKE_ACCOUNT_NAME
password: $SNOWFLAKE_PASSWORD
schema: ASTROFLOW_CI
extra:
account: "gp21411"
region: "us-east-1"
role: "AIRFLOW_TEST_USER"
warehouse: ROBOTS
database: SANDBOX
- conn_id: snowflake_conn_1
conn_type: snowflake
host: https://gp21411.us-east-1.snowflakecomputing.com
port: 443
login: $SNOWFLAKE_ACCOUNT_NAME
password: $SNOWFLAKE_PASSWORD
extra:
account: "gp21411"
region: "us-east-1"
role: "AIRFLOW_TEST_USER"
warehouse: ROBOTS
- conn_id: bigquery
conn_type: bigquery
description: null
extra:
project: "astronomer-dag-authoring"
host: null
login: null
password: null
port: null
schema: null
- conn_id: sqlite_conn
conn_type: sqlite
host: /tmp/sqlite.db
schema:
login:
password:
- conn_id: gcp_conn
conn_type: google_cloud_platform
description: null
extra: null
- conn_id: aws_conn
conn_type: aws
description: null
extra: null
- conn_id: gcp_conn_project
conn_type: google_cloud_platform
description: null
extra:
project: "astronomer-dag-authoring"
project_id: "astronomer-dag-authoring"
- conn_id: sftp_conn
conn_type: sftp
host: $SFTP_HOSTNAME
login: $SFTP_USERNAME
password: $SFTP_PASSWORD
port: 2222

0 comments on commit 6ddeda9

Please sign in to comment.