A simple, reusable, templates based ETL (Extract, Transform and Load) library and framework written in Python
-
Updated
Oct 19, 2024 - Python
A simple, reusable, templates based ETL (Extract, Transform and Load) library and framework written in Python
This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.
GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.
An open-source Python library is designed to simplify the process of migrating data to HubSpot, a powerful customer relationship management (CRM) platform. Whether you're moving contacts, companies, deals, or any other data to HubSpot, this library provides an easy-to-use interface for managing your migration tasks.
The AWS DMS Task Restart and Status Checker is a Python script designed to restart various AWS Database Migration Service (DMS) tasks and check their status. This script leverages AWS SDK (Boto3) and Mage.ai for DMS task integration and management, ensuring efficient and reliable task handling.
Developed a Streamlit application for analyzing transactions and user data from the Pulse dataset. Explored data insights on states, years, quarters, districts, transaction types, and brands through EDA. Visualized trends and patterns using plots and charts to optimize decision-making in the Fintech industry.
A Python script to replicate drive or a folder within a drive onto another drive
A web scraping program built to extract attribute data on music events from a popular event ticketing website. The program collects event data based on the specified country and city, which is then exported to a CSV file for marketing emails and stored efficiently in a local PostgreSQL database.
A simple GUI application for user data migration from MUBI.com to letterboxd.com
This project entails migrating and transforming data, with a key focus on extracting data, storing it in AWS, and then pushing it to a database table.
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
This project is a Streamlit application which is focussing on ETL concept. It is particularly designed to provide users with seamless access and analysis of data from multiple YouTube channels.
This Git repository hosts an Odoo project, a powerful and highly customizable open-source ERP (Enterprise Resource Planning) and CRM (Customer Relationship Management) system. Our project focuses on customizing, configuring, and extending Odoo to meet the unique business needs of our organization or clients.
Oplog-based data sync tool that synchronizes data from a replica set to another deployment, e.g.: standalone, replica set, and sharded cluster.
This project aims to migrate data from MongoDB to Google Cloud Storage (GCS) and BigQuery automatically. It enables businesses to easily transfer and analyze the data in the cloud, improving data and cost management.
utility scripts to copy databases, teams and storage buckets & files between appwrite instances
🐱👤 Simplify password migration from text file to password manager with a unique identifier
Convert an Enpass csv export so it can be imported to a KeePass database using KeePassXC
This solution is designed to help you unlock legacy mainframe data by migrating data files from mainframe systems to AWS. By migrating the data, you can make use of the powerful analytics, machine learning, and other services available in AWS to gain insights and make better decisions based on the data.
This script helps with disabling and enabling automation (Triggers, Validation Rules, Duplicate Rules and Flows) in a Salesforce org. Useful for data migrations and data transfer.
Add a description, image, and links to the data-migration topic page so that developers can more easily learn about it.
To associate your repository with the data-migration topic, visit your repo's landing page and select "manage topics."