Skip to content

Commit

Permalink
Merge branch 'main' into tap_cloudwatch_setting_update
Browse files Browse the repository at this point in the history
  • Loading branch information
pnadolny13 committed Mar 9, 2023
2 parents 7e03a47 + 4c737c7 commit 2a64b62
Show file tree
Hide file tree
Showing 9 changed files with 82 additions and 9 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/check-yaml-format.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:

- name: Get changed files in the docs folder
id: changed-files
uses: tj-actions/changed-files@v35.6.0
uses: tj-actions/changed-files@v35.6.1
with:
files: |
_data/**/*.yml
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test_dispatcher.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ jobs:

- name: Get changed files
id: changed_files
uses: tj-actions/changed-files@v35.6.0
uses: tj-actions/changed-files@v35.6.1
with:
sha: ${{ github.event.pull_request.head.sha }}
json: "true"
Expand Down
1 change: 1 addition & 0 deletions _data/default_variants.yml
Original file line number Diff line number Diff line change
Expand Up @@ -600,6 +600,7 @@ utilities:
evidence: meltanolabs
gdrive: matatika
great_expectations: great-expectations
matatika: matatika
metabase: metabase
notebook: matatika
postgres: postgres
Expand Down
2 changes: 1 addition & 1 deletion _data/meltano/extractors/tap-csv/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ pip_url: git+https://github.com/MeltanoLabs/tap-csv.git
repo: https://github.com/MeltanoLabs/tap-csv
settings:
- description: |
Array of objects with `entity`, `path`, `keys`, and `encoding` [Optioanl] keys:
Array of objects with `entity`, `path`, `keys`, and `encoding` [Optional] keys:
* `entity`: The entity name, used as the table name for the data loaded from that CSV.
* `path`: Local path (relative to the project's root) to the file to be ingested. Note that this may be a directory, in which case all files in that directory and any of its subdirectories will be recursively processed
Expand Down
1 change: 1 addition & 0 deletions _data/meltano/extractors/tap-hubspot/spacecowboy.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ description: Inbound Marketing software
domain_url: https://legacydocs.hubspot.com/docs/overview
keywords:
- api
- meltano_sdk
label: Hubspot
logo_url: /assets/logos/extractors/hubspot.png
maintenance_status: unknown
Expand Down
23 changes: 18 additions & 5 deletions _data/meltano/loaders/target-postgres/meltanolabs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,13 @@ capabilities:
description: PostgreSQL database loader
dialect: postgres
domain_url: https://www.postgresql.org/
executable: target-postgres
keywords:
- meltano_sdk
- database
label: Postgres
logo_url: /assets/logos/loaders/postgres.png
maintenance_status: development
maintenance_status: beta
name: target-postgres
namespace: target_postgres
next_steps: ''
Expand All @@ -27,8 +28,8 @@ settings:
kind: integer
label: Port
name: port
- description: |
User name used to authenticate. Note if sqlalchemy_url is set this will be ignored.
- description: User name used to authenticate. Note if sqlalchemy_url is set this
will be ignored.
kind: string
label: User
name: user
Expand All @@ -42,8 +43,8 @@ settings:
label: Database
name: database
- description: SQLAlchemy connection string. This will override using host, user,
password, port,dialect. Note that you must esacpe password specialcharacters properly
seehttps://docs.sqlalchemy.org/en/20/core/engines.html#escaping-special-characters-such-as-signs-in-passwords
password, port, dialect. Note that you must esacpe password special characters
properly see https://docs.sqlalchemy.org/en/20/core/engines.html#escaping-special-characters-such-as-signs-in-passwords
kind: string
label: Sqlalchemy Url
name: sqlalchemy_url
Expand All @@ -57,6 +58,18 @@ settings:
label: Default Target Schema
name: default_target_schema
value: $MELTANO_EXTRACT__LOAD_SCHEMA
- description: When activate version is sent from a tap this specefies if we should
delete the records that don't match, or mark them with a date in the `_sdc_deleted_at`
column.
kind: boolean
label: Hard Delete
name: hard_delete
- description: Note that this must be enabled for activate_version to work!This adds
_sdc_extracted_at, _sdc_batched_at, and more to every table. See https://sdk.meltano.com/en/latest/implementation/record_metadata.html
for more information.
kind: boolean
label: Add Record Metadata
name: add_record_metadata
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
Expand Down
56 changes: 56 additions & 0 deletions _data/meltano/utilities/matatika/matatika.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
commands:
describe:
args: describe
description: Describe the Matatika extension.
executable: matatika_extension
lab:
args: lab --no-browser
description: Start the Matatika Lab.
executable: matatika_extension
definition: |
is a Meltano utility extension providing a simplified community version of [Matatika](https://www.matatika.com/) - a modern data platform for analytics users.
This tool is designed to provide a complete and simple UI to run your Meltano project with, locally or self-hosted.
> **WARNING:** This extension is currently in beta - if you run into any problems, [join the Matatika Slack community](https://join.slack.com/t/matatika/shared_invite/zt-19n1bfokx-F31DNitTpSxWCFO2aFlgxg) and ask for help in the `#troubleshooting` channel.
description: A simple UI and scheduler for Meltano projects
docs: https://matatika.com/docs/
domain_url: https://matatika.com/
executable: matatika_extension
ext_repo: https://github.com/Matatika/matatika-ext
keywords:
- analyze
- chart
- bi
- lab
- insights
- import
- matatika
- meltano_edk
- pipelines
- visualization
- ui
label: Matatika
logo_url: /assets/logos/utilities/matatika.png
maintenance_status: beta
name: matatika
namespace: matatika
next_steps: |
To start the Matatika Lab with your Meltano project, run:
```
meltano invoke matatika lab
```
If this is first time this command has been run, container images will be pulled from Docker Hub - be aware that this may take a couple of minutes, depending on the speed of your internet connection.
Once the images exist on the host machine, start-up should take no longer than 30s.
By default, a tab in your default browser will be opened to the Lab automatically at https://localhost:3443.
---
If you're running into problems with this extension, or just want to chat about all things data, [join the Matatika Slack community](https://join.slack.com/t/matatika/shared_invite/zt-19n1bfokx-F31DNitTpSxWCFO2aFlgxg).
<br/><br/>
pip_url: git+https://github.com/Matatika/matatika-ext.git@v0.1.0
repo: https://github.com/Matatika/matatika-ce
usage: For help, try `meltano invoke matatika --help` (or `--help` on any subcommand).
variant: matatika
4 changes: 3 additions & 1 deletion src/templates/Plugins.vue
Original file line number Diff line number Diff line change
Expand Up @@ -275,7 +275,9 @@
<div v-else></div>

<!-- Help section -->
<p>If you run into any issues, learn how to get help.</p>
<p>
If you run into any issues, <a href="#looking-for-help">learn how to get help</a>.
</p>
</div>
<div>
<PluginCapabilitiesSection
Expand Down
Binary file added static/assets/logos/utilities/matatika.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 2a64b62

Please sign in to comment.