Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🎉Source Stripe: New Stream - Early Fraud Warnings #22859

Merged
merged 24 commits into from May 24, 2023

Conversation

btkcodedev
Copy link
Collaborator

@btkcodedev btkcodedev commented Feb 11, 2023

What

Closes #16962

Enhancement

New streams:

  • Early fraud warnings

Recommended reading order

  1. source_stripe/source.py
  2. source_stripe/streams.py
  3. source_stripe/schemas/early_fraud_warnings.json

🚨 User Impact 🚨

No breaking changes

Pre-merge Checklist

Updating a connector

Community member or Airbyter [Yes]

  • Grant edit access to maintainers (instructions)
  • Secrets in the connector's spec are annotated with airbyte_secret
  • Unit & integration tests added and passing. Community members, please provide proof of success locally e.g: screenshot or copy-paste unit, integration, and acceptance test output. To run acceptance tests for a Python connector, follow instructions in the README. For java connectors run ./gradlew :airbyte-integrations:connectors:<name>:integrationTest.
  • Issue acceptance criteria met
  • PR name follows PR naming conventions
  • Documentation which references the generator is updated as needed

For the reviewer:

Enhancement passing in local python integration tests. Needs only to test deployment to cloud build and publish it :)

@YowanR
Copy link
Contributor

YowanR commented Feb 24, 2023

@sh4sh @natalyjazzviolin can you please take a look? 🙏

@natalyjazzviolin

This comment was marked as outdated.

@natalyjazzviolin

This comment was marked as outdated.

@natalyjazzviolin
Copy link
Contributor

natalyjazzviolin commented Feb 24, 2023

/test connector=connectors/source-stripe

🕑 connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/4266300588
✅ connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/4266300588
Python tests coverage:

Name                                     Stmts   Miss  Cover
------------------------------------------------------------
source_stripe/source.py                     22      0   100%
source_stripe/__init__.py                    2      0   100%
source_stripe/streams.py                   323     29    91%
source_stripe/availability_strategy.py      19      2    89%
------------------------------------------------------------
TOTAL                                      366     31    92%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
============ 55 passed, 1 skipped, 37 warnings in 319.02s (0:05:19) ============

@btkcodedev
Copy link
Collaborator Author

Thanks for the build @natalyjazzviolin.
Its succeeded I think, Is there any changes need to be done?

@evantahler
Copy link
Contributor

@natalyjazzviolin those github checks are failing because I think we need a branch that's really in our repo (not a fork)

Create a non-forked branch based on this PR and test the below items on it

@btkcodedev
Copy link
Collaborator Author

@natalyjazzviolin Could I help for anything?

@btkcodedev
Copy link
Collaborator Author

@natalyjazzviolin @evantahler Little Bump Here :)

@natalyjazzviolin
Copy link
Contributor

@evantahler sorry for the confusion - my understanding was that a review is required by the connector Ops team because this is a GA connector. I've created a non-forked branch to run the build, it's still running as I type this so don't know if it's passed.

@evantahler
Copy link
Contributor

Testing and deploying from #24062

@btkcodedev
Copy link
Collaborator Author

Secrets are available from lastpass

@btkcodedev
Copy link
Collaborator Author

I can't seed the stream as it doesn't support POST operation, however added it as empty stream.

Copy link
Contributor

@erohmensing erohmensing left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems simple enough! Made a suggestion around correct version bumping. Good from the connector ops side once the version is updated. Please also fill out the checklist from the checklist action :)

@@ -2041,7 +2041,7 @@
- name: Stripe
sourceDefinitionId: e094cb9a-26de-4645-8761-65c0c425d1de
dockerRepository: airbyte/source-stripe
dockerImageTag: 3.4.2
dockerImageTag: 3.5.2
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
dockerImageTag: 3.5.2
dockerImageTag: 3.5.0

When bumping minor versions, please bump back to .0 :)

| 3.4.1 | 2023-04-24 | [23389](https://github.com/airbytehq/airbyte/pull/23389) | Add `customer_tax_ids` to `Invoices` |
| 3.4.0 | 2023-03-20 | [23963](https://github.com/airbytehq/airbyte/pull/23963) | Add `SetupIntents` stream |
| 3.3.0 | 2023-04-12 | [25136](https://github.com/airbytehq/airbyte/pull/25136) | Add stream `Accounts` |
| 3.5.2 | 2023-05-10 | [22859](https://github.com/airbytehq/airbyte/pull/22859) | Added stream `Early Fraud Warnings` |
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| 3.5.2 | 2023-05-10 | [22859](https://github.com/airbytehq/airbyte/pull/22859) | Added stream `Early Fraud Warnings` |
| 3.5.0 | 2023-05-10 | [22859](https://github.com/airbytehq/airbyte/pull/22859) | Added stream `Early Fraud Warnings` |

@sajarin
Copy link
Contributor

sajarin commented May 18, 2023

@btkcodedev can you rebase on master and address the comments above?

@btkcodedev
Copy link
Collaborator Author

@sajarin All comments resolved, Conflicts resolved & Version bumped.
Thanks :)

@marcosmarxm
Copy link
Member

marcosmarxm commented May 22, 2023

/test connector=connectors/source-stripe

🕑 connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5048672927
❌ connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5048672927
🐛 https://gradle.com/s/udkcx4xc5tr5k

Build Failed

Test summary info:

=========================== short test summary info ============================
FAILED test_core.py::TestBasicRead::test_read[inputs0] - Failed: Stream custo...
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
============= 1 failed, 38 passed, 1 skipped in 288.06s (0:04:48) ==============

@marcosmarxm
Copy link
Member

Waiting #26360 to fix the CI for Stripe.

@marcosmarxm
Copy link
Member

marcosmarxm commented May 23, 2023

/test connector=connectors/source-stripe

🕑 connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5061527103
✅ connectors/source-stripe https://github.com/airbytehq/airbyte/actions/runs/5061527103
Python tests coverage:

Name                                     Stmts   Miss  Cover
------------------------------------------------------------
source_stripe/source.py                     22      0   100%
source_stripe/__init__.py                    2      0   100%
source_stripe/availability_strategy.py      19      2    89%
source_stripe/streams.py                   339     37    89%
------------------------------------------------------------
TOTAL                                      382     39    90%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:100: The previous and actual specifications are identical.
================== 39 passed, 1 skipped in 313.03s (0:05:13) ===================

@marcosmarxm marcosmarxm merged commit ec4cf8d into airbytehq:master May 24, 2023
37 of 46 checks passed
nguyenaiden pushed a commit that referenced this pull request May 25, 2023
* feat: New Strea: Early Fraud Warnings

* Fixes formatting errors.

* Updates the number of streams to assert in unit test.

* Fixes error in TestBasicRead::test_read[inputs2] due to early_fraud_warnings stream being empty.'

* rebase to master, fix schema

* fix schema, tests

* add as empty stream, fix sample file

* fix tests, update docs, update version

* add additional_properties

* Update airbyte-integrations/connectors/source-stripe/Dockerfile

Co-authored-by: Augustin <augustin@airbyte.io>

* Resolve conflicts

* Bump version, Resolve comments

* remove incr for stream early_fraud

* fix configured catalogs

* fix unit test

---------

Co-authored-by: Nataly Merezhuk <65251165+natalyjazzviolin@users.noreply.github.com>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
marcosmarxm added a commit to natalia-miinto/airbyte that referenced this pull request Jun 8, 2023
* feat: New Strea: Early Fraud Warnings

* Fixes formatting errors.

* Updates the number of streams to assert in unit test.

* Fixes error in TestBasicRead::test_read[inputs2] due to early_fraud_warnings stream being empty.'

* rebase to master, fix schema

* fix schema, tests

* add as empty stream, fix sample file

* fix tests, update docs, update version

* add additional_properties

* Update airbyte-integrations/connectors/source-stripe/Dockerfile

Co-authored-by: Augustin <augustin@airbyte.io>

* Resolve conflicts

* Bump version, Resolve comments

* remove incr for stream early_fraud

* fix configured catalogs

* fix unit test

---------

Co-authored-by: Nataly Merezhuk <65251165+natalyjazzviolin@users.noreply.github.com>
Co-authored-by: nataly <nataly@airbyte.io>
Co-authored-by: Augustin <augustin@airbyte.io>
Co-authored-by: Marcos Marx <marcosmarxm@users.noreply.github.com>
Co-authored-by: marcosmarxm <marcosmarxm@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation checklist-action-run community connectors/source/stripe contributor-program PRs submitted through the contributor program. from/connector-ops
Projects
Status: In Progress
Development

Successfully merging this pull request may close these issues.

Source Stripe: new stream Early Fraud Warning
10 participants