New source: Kafka

This release introduces a new Kafka source to ingestr!

Using ingestr, you can ingest data from any Kafka topic into your DWH, see docs here.

Gorgias as a new source

This release adds Gorgias as a new source to ingestr!

The current release supports 4 resources at the moment:

• customers
• tickets
• ticket messages
• satisfaction surveys

Adding new resources would be pretty easy, feel free to contribute either directly to the code or creating an issue with your needs.

v0.6.0: Shopify as a new source

This release adds support for Shopify as a new source! 🚀

Give the docs a look, anda share your feedback.

What's Changed

• updated snowflake account identifier usage by @trakmaker in #17
• add shopify as a source by @karakanb in #20

New Contributors

• @trakmaker made their first contribution in #17
• @karakanb made their first contribution in #20

Full Changelog: v0.5.1...v0.6.0

SAP Hana as a source ✨

This release adds support for SAP Hana as a source. You can use the Hana databases as a source using the following URI structure:

hana://username:password@host:port/dbname

Enjoy!

Notion support 🚀

Along with some minor upgrades and maintenance work, this release introduces the support for a new source: Notion!

This is the first release where we step outside the db-only territory and integrate with external platforms, please feel free to suggest any other platform that might be helpful to you!

MongoDB Source

This release adds support for MongoDB as a source for ingestr!

ingestr ingest \
  --source-uri 'mongodb://localhost:27017' \
  --source-table 'mydb.mycollection' \
  --dest-uri $POSTGRES_URI \
  --dest-table 'testschema.mongofake'

Fixes #7

Oracle & CSV Support

This release is a quick addition with an experimental Oracle source support, and a new (quite hackily implemented) CSV destination support, which means that you can copy any table from any database into a CSV file locally!

v0.1.0 🚀

Hi all, this is the first public release of ingestr!

ingestr is an open-source command-line application that allows ingesting & copying data between two databases without any code: https://github.com/bruin-data/ingestr

It does a few things that make it the easiest alternative out there:

• ✨ copy data from your Postgres / MySQL / SQL Server or any other source into any destination, such as BigQuery or Snowflake, just using URIs
• ➕ incremental loading: create+replace, delete+insert, append
• 🐍 single-command installation: pip install ingestr

We built ingestr because we believe for 80% of the cases out there people shouldn’t be writing code or hosting tools like Airbyte just to copy a table to their DWH on a regular basis.