Snowflake Snowpark Python API

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee

A data management platform for the web, developed by Kitware

This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.

Matrix Profile application in building energy field.

ANJANA is a Python library for anonymizing sensitive data

Using time series machine learning models to predict crop growth as part of an AgAID internship

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python

A web application made for the gamers of Bangladesh to get the best graphics card for their budget. Made using Streamlit.

A lightweight (zero external dependencies), thread-safe database for Python.

A suite of data mining, analytics, and visualization solutions for analyzing museum data

A toolbox for processing and analysing air traffic data

Python code for "Qi Feng, J. George Shanthikumar, Mengying Sue, Consumer choice models and estimation: A review and extension, Production and Operations Management, 2022, 31(2): 847-867."

O objetivo deste projeto é contribuir com a formação de iniciantes que almejam entrar na área de dados, fornecendo uma visão baseada em dados sobre as habilidades e conhecimentos mais demandados pelo mercado. Através da coleta e análise de vagas de emprego/estágio, o projeto visa responder à pergunta: “Como se tornar um profissional de dados?"

Supercharge BigQuery with BigFunctions

Complete solution for extracting currency pair quotes data with comprehensive testing, parameter validation, flexible configuration management, Hexagonal Architecture, CI/CD pipelines, code quality tools, and detailed documentation.

Python library that simplifies obtaining data from API endpoints by converting them directly into Pandas DataFrames. This library offers robust features, including retry strategies for failed requests.

ETL Process for Currency Quotes Data" project is a complete solution dedicated to extracting, transforming and loading (ETL) currency quote data. This project uses several advanced techniques and architectures to ensure the efficiency and robustness of the ETL process.