Skip to content

Commit

Permalink
Source RKI-Covid - add history data, incidence rate, cases, death, ho…
Browse files Browse the repository at this point in the history
…spitalization streams (#17607)

* added streams states and states/history/cases

* fix: remove changes to formatting for other connectors (again)

* auto-bump connector version

Co-authored-by: sajarin <sajarindider@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
  • Loading branch information
3 people committed Dec 5, 2022
1 parent 201df24 commit 92f71ac
Show file tree
Hide file tree
Showing 26 changed files with 1,848 additions and 17 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -1385,7 +1385,7 @@
- name: RKI Covid
sourceDefinitionId: d78e5de0-aa44-4744-aa4f-74c818ccfe19
dockerRepository: airbyte/source-rki-covid
dockerImageTag: 0.1.1
dockerImageTag: 0.1.2
documentationUrl: https://docs.airbyte.com/integrations/sources/rki-covid
sourceType: api
releaseStage: alpha
Expand Down
4 changes: 2 additions & 2 deletions airbyte-config/init/src/main/resources/seed/source_specs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12456,7 +12456,7 @@
- - "client_secret"
oauthFlowOutputParameters:
- - "refresh_token"
- dockerImage: "airbyte/source-rki-covid:0.1.1"
- dockerImage: "airbyte/source-rki-covid:0.1.2"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/rki-covid"
connectionSpecification:
Expand All @@ -12465,7 +12465,7 @@
type: "object"
required:
- "start_date"
additionalProperties: false
additionalProperties: true
properties:
start_date:
type: "string"
Expand Down
8 changes: 8 additions & 0 deletions airbyte-integrations/connectors/source-rki-covid/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,14 @@ Germany:
6. /germany/history/recovered/:days
7. /germany/history/frozen-incidence/:days
8. /germany/history/hospitalization/:days
9. /germany/states
10. /germany/states/age-groups
11. /germany/states/history/cases/:days
12. /germany/states/history/incidence/:days
13. /germany/states/history/frozen-incidence/:days
14. /germany/states/history/deaths/:days
15. /germany/states/history/recovered/:days
16. /germany/states/history/hospitalization/:days
```

### Prerequisites
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ tests:
basic_read:
- config_path: "secrets/config.json"
configured_catalog_path: "integration_tests/configured_catalog.json"
empty_streams: [ "germany", "germany_age_groups", "german_history_frozen_incidence"]
empty_streams: [ "germany", "germany_age_groups", "german_history_frozen_incidence", "germany_states_age_groups"]
# TODO uncomment this block to specify that the tests should assert the connector outputs the records provided in the input file a file
# expect_records:
# path: "integration_tests/expected_records.txt"
Expand Down
12 changes: 12 additions & 0 deletions airbyte-integrations/connectors/source-rki-covid/bootstrap.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,19 @@ For production, every developer application can view multiple streams.
* [Provides frozen incidence in Germany over days.](https://api.corona-zahlen.org/germany/germany/history/frozen-incidence/:days) \(Incremental\)
* [Provides hospitalization rate in Germany over days.](https://api.corona-zahlen.org/germany/germany/history/hospitalization/:days) \(Incremental\)

## Cases In States Of Germany Covid api stream
The basic entry stream is 'GermanyStates'. All other streams are extended version of base stream and passing parameters also result in sliced data.
For production, every developer application can view multiple streams.

## Endpoints
* [Provides covid cases and other information in Germany.](https://api.corona-zahlen.org/state) \(Non-Incremental\ Entry-Stream)
* [Provides covid cases and other information in Germany, group by age.](https://api.corona-zahlen.org/states/age-groupss) \(Non-Incremental\)
* [Provides cases in Germany based on days.](https://api.corona-zahlen.org/germany/states/history/cases/:days) \(Non-Incremental\)
* [Provides incidence rate of covid in Germany based on days.](https://api.corona-zahlen.org/germany/states/history/incidence/:days) \(Non-Incremental\)
* [Provides death rate in Germany over days](https://api.corona-zahlen.org/germany/states/history/deaths/:days) \(Non-Incremental\)
* [Provides recovery rate in Germany over days.](https://api.corona-zahlen.org/germany/states/history/recovered/:days) \(Non-Incremental\)
* [Provides frozen incidence in Germany over days.](https://api.corona-zahlen.org/germany/states/history/frozen-incidence/:days) \(Non-Incremental\)
* [Provides hospitalization rate in Germany over days.](https://api.corona-zahlen.org/germany/states/history/hospitalization/:days) \(Non-Incremental\)

Incremental streams have required parameter start-date. Without passing start-date as parameter full-refresh occurs.
As cursor field this connector uses "date".
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,29 @@
},
"german_history_frozen_incidence": {
"date": "2024-01-01T00:00:00.000Z"
},
"germany_states": {
"date": "2024-01-01T00:00:00.000Z"
},
"germany_states_age_groups": {
"date": "2024-01-01T00:00:00.000Z"
},
"states_history_cases": {
"date": "2024-01-01T00:00:00.000Z"
},
"states_history_incidence": {
"date": "2024-01-01T00:00:00.000Z"
},
"states_history_frozen_incidence": {
"date": "2024-01-01T00:00:00.000Z"
},
"states_history_deaths": {
"date": "2024-01-01T00:00:00.000Z"
},
"states_history_recovered": {
"date": "2024-01-01T00:00:00.000Z"
},
"states_history_hospitalization": {
"date": "2024-01-01T00:00:00.000Z"
}
}
Loading

0 comments on commit 92f71ac

Please sign in to comment.