Skip to content

Commit

Permalink
Publish PR 6937: new source amazon sqs (#7389)
Browse files Browse the repository at this point in the history
* Initial commit, working source with static Creds

* Typo in example queue url

* Adds auto delete of messages after read

* Adds visibility timeout

* remove insecure comments from AWS IAM Key spec

* explicitly set supported sync modes

* explicit sync mode should be lower case

* Adds unit tests for check, discover, read

* remove incremental acceptance test block

* remove incremental from conf catalog sample

* remove test requirement moto from main req

* align int catalog sample with sample_files

* fixing catalog configs

* acceptance testing config

* adds expected records txt

* automated formatting changes

* remove expected records block from acpt test

* Adds Docs page

* Ammends formatting on readme

* Adds doc link to summary

* Improve error handling & debug logging

* Adds bootstrap.md

* Add a todo suggestion for batch output

* Adds SQS to integrations readme list

* lower case properties

* removed unused line

* uses enum for aws region

* updates sample configs to use lowercase

* required props to lower case

* add missed property to lowercase

* gradle formatting

* Fixing issues from acceptance tests

* annotate secrets in spec.json with airbyte_secret

* Adds explicit warnings about data less when using Delete Message option

* create config files

* remove eof line

* correct catalog with airbyte creds

* format

Co-authored-by: Alasdair Brown <me@alasdairb.com>
  • Loading branch information
marcosmarxm and sdairs committed Oct 26, 2021
1 parent 002b62d commit 9157b3d
Show file tree
Hide file tree
Showing 4 changed files with 15 additions and 2 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
{
"sourceDefinitionId": "983fd355-6bf3-4709-91b5-37afa391eeb6",
"name": "Amazon SQS",
"dockerRepository": "airbyte/source-amazon-sqs",
"dockerImageTag": "0.1.0",
"documentationUrl": "https://docs.airbyte.io/integrations/sources/amazon-sqs"
}
Original file line number Diff line number Diff line change
Expand Up @@ -578,3 +578,9 @@
dockerImageTag: 0.1.3
documentationUrl: https://docs.airbyte.io/integrations/sources/zuora
sourceType: api
- sourceDefinitionId: 983fd355-6bf3-4709-91b5-37afa391eeb6
name: Amazon SQS
dockerRepository: airbyte/source-amazon-sqs
dockerImageTag: 0.1.0
documentationUrl: https://docs.airbyte.io/integrations/sources/amazon-sqs
sourceType: api
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
{
"streams": [
{
"name": "ab-airbyte-testing",
"name": "Airbyte",
"supported_sync_modes": ["full_refresh"],
"source_defined_cursor": false,
"json_schema": {
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"sync_mode": "full_refresh",
"destination_sync_mode": "append",
"stream": {
"name": "ab-airbyte-testing",
"name": "Airbyte",
"supported_sync_modes": ["full_refresh"],
"source_defined_cursor": false,
"json_schema": {
Expand Down

0 comments on commit 9157b3d

Please sign in to comment.