Skip to content
View aruadecarvalho's full-sized avatar
🎯
Focusing
🎯
Focusing
19 followers · 15 following

Achievements

Achievement: Pull Sharkx3Achievement: Pair Extraordinairex2Achievement: YOLOAchievement: Quickdraw

Achievements

Achievement: Pull Sharkx3Achievement: Pair Extraordinairex2Achievement: YOLOAchievement: Quickdraw

Block or report aruadecarvalho

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
aruadecarvalho/README.md

Data engineer with experience in optimizing databases like PostgreSQL, building ETL pipelines in AWS and GCP, and managing infrastructure with Terraform. I work with ETL orchestration tools like Apache Airflow and implement data models for scalable analytics and reporting. My experience includes building real-time data processing solutions, cache systems, and search architectures for high-volume applications. Always focused on delivering high-performance solutions and enhancing data-driven decision-making.

Connect with me:

Pinned Loading

  1. impact-insight Public

    GCP data pipeline predicting power outages in São Paulo based on weather data. Ingests CSV data into BigQuery, pulls real-time weather via Cloud Functions and Pub/Sub, and uses ARIMA and LightGBM m…

    HCL

  2. deftunes-pipeline-aws Public

    An end-to-end data pipeline for De Ftunes’ music purchase analytics, designed to ingest, transform, and model data for efficient analysis of song purchases, user behavior, and service trends. Utili…

    Python

  3. user-activity-recommendation-pipeline-aws Public

    End-to-end batch and streaming data pipeline on AWS to process user ratings and activity data. Leverages Amazon RDS, Glue, S3, Kinesis, and PostgreSQL with pgvector for real-time recommendation gen…

    HCL

  4. classic-car-retail-data-pipeline-aws Public

    Data pipeline on AWS using RDS, Glue, S3, and Athena, demonstrating the data lifecycle from ETL to visualization with Terraform as IaC.

    Jupyter Notebook

  5. dfs Public

    Distributed File System (DFS) written in Golang

    Go

  6. video-encoder Public

    A video encoding tool for .mp4

    Go