Skip to content

Commit

Permalink
Merge branch 'main' into edgarrmondragon/feat/add-tap-fedidb
Browse files Browse the repository at this point in the history
  • Loading branch information
edgarrmondragon authored Sep 5, 2024
2 parents 7a3bc49 + a86f6ad commit 0fe24ec
Show file tree
Hide file tree
Showing 24 changed files with 403 additions and 70 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/check-yaml-format.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:

- name: Get changed files in the docs folder
id: changed-files
uses: tj-actions/changed-files@v44.5.5
uses: tj-actions/changed-files@v45.0.1
with:
files: |
_data/**/*.yml
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test_dispatcher.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ jobs:

- name: Get changed files
id: changed_files
uses: tj-actions/changed-files@v44.5.5
uses: tj-actions/changed-files@v45.0.1
with:
sha: ${{ github.event.pull_request.head.sha }}
json: "true"
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test_meltano_add_install.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ jobs:

- name: Get changed plugins
id: changed_plugins
uses: tj-actions/changed-files@v44.5.5
uses: tj-actions/changed-files@v45.0.1
with:
files: _data/meltano/*/*/*.yml
matrix: true
Expand Down
3 changes: 3 additions & 0 deletions _data/default_variants.yml
Original file line number Diff line number Diff line change
Expand Up @@ -239,6 +239,7 @@ extractors:
tap-hotjar: epoch8
tap-hubplanner: airbyte
tap-hubspot: singer-io
tap-iceberg: shaped-ai
tap-idealo-click-report: horze-international
tap-ilevel: singer-io
tap-immuta: immuta
Expand Down Expand Up @@ -491,6 +492,7 @@ extractors:
tap-ssb-klass: storebrand
tap-stackexchange: meltanolabs
tap-stackoverflow-sampledata: buzzcutnorman
tap-staffwise: chartica
tap-stamped: hotgluexyz
tap-starshipit: zookal
tap-statuspage: airbyte
Expand Down Expand Up @@ -616,6 +618,7 @@ loaders:
target-clickhouse: shaped-ai
target-csv: meltanolabs
target-datadotworld: datadotworld
target-db2: infostrux
target-duckdb: jwills
target-elasticsearch: dtmirizzi
target-gcs: datateer
Expand Down
8 changes: 8 additions & 0 deletions _data/maintainers.yml
Original file line number Diff line number Diff line change
Expand Up @@ -166,6 +166,10 @@ cguimont:
label: cguimont
name: cguimont
url: https://github.com/cguimont
chartica:
label: chartica
name: chartica
url: https://github.com/chartica
checkr:
label: Checkr
name: checkr
Expand Down Expand Up @@ -553,6 +557,10 @@ immuta:
label: Immuta, Inc.
name: immuta
url: http://www.immuta.com/
infostrux:
label: Infostrux Solutions
name: infostrux
url: https://www.infostrux.com/
integress-inc:
label: Integress Inc
name: integress-inc
Expand Down
112 changes: 112 additions & 0 deletions _data/meltano/extractors/tap-iceberg/shaped-ai.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,112 @@
capabilities:
- about
- batch
- catalog
- discover
- schema-flattening
- state
- stream-maps
description: Meltano Tap for ingesting Apache Iceberg data
domain_url: https://iceberg.apache.org
executable: tap-iceberg
keywords:
- meltano_sdk
label: Iceberg
logo_url: /assets/logos/extractors/iceberg.png
maintenance_status: active
name: tap-iceberg
namespace: tap_iceberg
next_steps: ''
pip_url: git+https://github.com/shaped-ai/tap-iceberg.git
quality: unknown
repo: https://github.com/shaped-ai/tap-iceberg
settings:
- description: Compression format to use for batch files.
kind: options
label: Batch Config Encoding Compression
name: batch_config.encoding.compression
options:
- label: Gzip
value: gzip
- label: None
value: none
- description: Format to use for batch files.
kind: options
label: Batch Config Encoding Format
name: batch_config.encoding.format
options:
- label: Jsonl
value: jsonl
- label: Parquet
value: parquet
- description: Prefix to use when writing batch files.
kind: string
label: Batch Config Storage Prefix
name: batch_config.storage.prefix
- description: Root path to use when writing batch files.
kind: string
label: Batch Config Storage Root
name: batch_config.storage.root
- description: The name of the catalog to connect to.
label: Catalog Name
name: catalog_name
- description: The type of catalog to connect to.
label: Catalog Type
name: catalog_type
- description: The URI of the catalog to connect to.
label: Catalog URI
name: catalog_uri
- description: Additional properties to pass to the catalog connection.
kind: object
label: Catalog Properties
name: catalog_properties
- description: The access key of the AWS Glue Data Catalog.
label: Access Key
name: client_access_key_id
sensitive: true
- description: The secret access key of the AWS Glue Data Catalog.
label: Secret Access Key
name: client_secret_access_key
sensitive: true
- description: The session token of the AWS Glue Data Catalog.
label: Session Token
name: client_session_token
sensitive: true
- description: The region of the AWS Glue Data Catalog.
label: Region
name: client_region
- description: The IAM role ARN to assume when connecting to the AWS Glue Data Catalog.
label: Role ARN
name: client_iam_role_arn
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
label: Flattening Enabled
name: flattening_enabled
- description: The max depth to flatten schemas.
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation:
- - catalog_type
- catalog_uri
settings_preamble: ''
usage: ''
variant: shaped-ai
9 changes: 8 additions & 1 deletion _data/meltano/extractors/tap-plausible/airbyte.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,9 +25,15 @@ settings:
- description: Plausible API Key. See the <a href="https://plausible.io/docs/stats-api">docs</a>
for information on how to generate this key.
kind: password
label: Airbyte Config Api Key
label: Airbyte Config API Key
name: airbyte_config.api_key
sensitive: true
- description: Plausible API URL. The API URL of your plausible instance.
Change this if you self-host plausible. The default is https://plausible.io/api/v1/stats
kind: string
label: Airbyte Config API URL
name: airbyte_config.api_url
value: https://plausible.io/api/v1/stats
- description: The domain of the site you want to retrieve data for. Enter the name
of your site as configured on Plausible, i.e., excluding "https://" and "www".
Can be retrieved from the 'domain' field in your Plausible site settings.
Expand Down Expand Up @@ -75,6 +81,7 @@ settings:
name: stream_maps
settings_group_validation:
- - airbyte_config.api_key
- - airbyte_config.api_url
- airbyte_config.site_id
- airbyte_spec
- airbyte_spec.image
Expand Down
1 change: 0 additions & 1 deletion _data/meltano/extractors/tap-sftp/singer-io.yml
Original file line number Diff line number Diff line change
Expand Up @@ -56,5 +56,4 @@ settings_group_validation:
- start_date
- tables
- username
- username
variant: singer-io
106 changes: 106 additions & 0 deletions _data/meltano/extractors/tap-staffwise/chartica.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,106 @@
capabilities:
- about
- batch
- catalog
- discover
- schema-flattening
- state
- stream-maps
description: Healthcare Productivity Tools
domain_url: https://staffwi.se/user-guide/api/reporting
executable: tap-staffwise
keywords:
- health
- payroll
- meltano_sdk
label: Staffwise
logo_url: /assets/logos/extractors/staffwise.svg
maintenance_status: active
name: tap-staffwise
namespace: tap_staffwise
next_steps: ''
pip_url: git+https://github.com/chartica/tap-staffwise.git
quality: silver
repo: https://github.com/chartica/tap-staffwise
settings:
- description: API Key to authenticate requests and access the API
kind: password
label: API Key
name: api_key
sensitive: true
- description: Subdomain you would like to pull data from
kind: string
label: Subdomain
name: subdomain
- description: Reporting ID of each report
kind: password
label: Reporting ID
name: reporting_id
sensitive: true
- description: The start date for filtering results in the API call
kind: string
label: Start Date (Optional)
name: start_date
- description: The end date for filtering results in the API call
kind: string
label: Stop Date (Optional)
name: stop_date
- description: Compression format to use for batch files.
kind: options
label: Batch Config Encoding Compression
name: batch_config.encoding.compression
options:
- label: Gzip
value: gzip
- label: None
value: none
- description: Format to use for batch files.
kind: options
label: Batch Config Encoding Format
name: batch_config.encoding.format
options:
- label: Jsonl
value: jsonl
- label: Parquet
value: parquet
- description: Prefix to use when writing batch files.
kind: string
label: Batch Config Storage Prefix
name: batch_config.storage.prefix
- description: Root path to use when writing batch files.
kind: string
label: Batch Config Storage Root
name: batch_config.storage.root
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
name: faker_config.locale
- description: 'Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator'
kind: string
label: Faker Config Seed
name: faker_config.seed
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
label: Flattening Enabled
name: flattening_enabled
- description: The max depth to flatten schemas.
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation:
- - api_key
- reporting_id
- subdomain
settings_preamble: ''
usage: ''
variant: chartica
Loading

0 comments on commit 0fe24ec

Please sign in to comment.