Siby Abin - Senior Data Engineer
-
Updated
Aug 19, 2023 - HTML
Siby Abin - Senior Data Engineer
End-to-end ML pipeline model and drift monitoring for Loan Eligibility classification.
Apply Data Engineering to Personal Finance
A maquina preditiva, analisa a possibilidade de um colaborador vier deixar a empresa, e quais são os fatores principais de sua saida
A data pipeline to extract News articles from BBC News, storing it to MongoDB, performing NLP analysis (Topic modeling, sentiment analysis), and orchestrating with airflow.
Photovoltaic System Modeling and Predictions
White and Red Wine classification using logistic regression
Análise de dados de funcionários para criar um modelo de Machine Learning que consiga prever se o funcionário irá deixar ou não a empresa.
This ETL (Extract, Transform, Load) project employs several Python libraries, including Airflow, Soda, Polars, YData Profiling, DuckDB, Requests, Loguru, and Google Cloud to streamline the extraction, transformation, and loading of CSV datasets from the U.S. government's data repository at https://catalog.data.gov.
Ask Ubuntu Logs analysis with PySpark on GCP | Pipeline with Airflow (Cloud Composer)
Supplementary material For Naukri Learning's video on ETL report generation using Python and Airflow
Alumni Profile Matching is a project aimed at facilitating networking between graduate students and alumni with similar backgrounds and career goals. By leveraging machine learning techniques and data processing pipelines, the project aims to provide graduate students with personalized recommendations of alumni profiles to connect with.
Airflow orchestrated ETL pipeline for extracting board game data from BoardGameGeek.com
As a Data Engineer for a fictional E-commerce startup, this project addresses the task of analyzing the web server logs to find the number of product pages visited and the number of items in the cart.
Add a description, image, and links to the airflow topic page so that developers can more easily learn about it.
To associate your repository with the airflow topic, visit your repo's landing page and select "manage topics."