Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.

A serverless architecture for orchestrating ETL jobs in arbitrarily-complex workflows using AWS Step Functions and AWS Lambda.

The athena adapter plugin for dbt (https://getdbt.com)

Glue scripts for converting AWS Service Logs for use in Athena

Workshop to build voice enabled integration with data analytics

A SQLite driver for S3 and Amazon Athena 😳

PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).

Data Quality Gate based on AWS

Test your Security Skills, and Clean Code Development as a Pythonist, Hacker & Warrior 🥷🏻

Build, Test and Deploy ETL solutions using AWS Glue and AWS CDK based CI/CD pipelines

A Fast, Declarative, and Extensible ETL Framework for Graph Databases.

I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that utilizes Kafka to scrape, process, and load data onto S3 in JSON format. With a producer-consumer architecture, I ensure that the data is in the right format for loading onto S3 by performing minor transformations

A system to support (semi-)automated assessment of textual exercises

Easily interact with cloud (AWS) in your Data Science workflow.

Automatically loads new partitions in AWS Athena

defendA Data Lake. A firehose pipeline to athena providing enrichment and normalization for security events

This web analytics demo shows how to collect web logs with API Gateway and store them into S3 through Amazon Kinesis. Then this project shows how to analyze web logs with Amazon Athena.