Skip to content
View lincolnmacedo's full-sized avatar
:electron:
:electron:
  • Uberlândia, Minas Gerais

Block or report lincolnmacedo

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
lincolnmacedo/README.md

Lincoln Macêdo

Data Engineer · Analytics Engineer · 5+ years

Engineering Data. Enabling Decisions.

LinkedIn GitHub


About me

Data Engineer with 5+ years designing and building end-to-end data platforms — from raw ingestion to production-ready dashboards. I work across the full data stack: scalable ETL/ELT pipelines, cloud data warehousing, data modeling, and BI delivery.

I focus on automation over manual work, scalable architectures, and production-ready code. Every system I build is designed to run reliably at scale, with proper governance, environment separation (dev/prod), and observability built in from day one.


Tech stack

Languages

Python SQL

Data platforms & warehouses

BigQuery Snowflake Databricks dbt Apache Spark Apache Airflow Apache Kafka

Cloud

GCP AWS Terraform

BI & analytics

Power BI Looker Tableau GA4

Dev tools

Git Docker Kubernetes GitHub Actions VS Code


What I build

[Sources]  →  ingestion  →  transform  →  serving  →  Consumers
              (Python /      (dbt /        (FastAPI /   (BI / APIs)
               Snowpark /     PySpark /     Cloud Run /
               Lambda)        SparkSQL)     Kubernetes)
                  ↕               ↕              ↕
            GCS / S3        BQ / Snowflake  REST APIs
            Raw layer       Staging → Mart  Dashboards

[Events]   →  streaming  →  Delta / BigQuery
              (Kafka +
               PySpark)

[Infra]    →  Terraform  →  GCP · AWS · Snowflake · Databricks
  • Data pipelines — production ETL/ELT with retry logic, error handling, structured logging
  • Data modeling — dbt projects with staging → intermediate → mart layer pattern
  • Medallion architecture — bronze → silver → gold on Databricks with Delta Lake
  • Cloud infra — GCP and AWS environments managed with Terraform, dev/prod separation
  • Real-time streaming — Kafka + PySpark Structured Streaming with watermarking
  • Data serving — FastAPI over BigQuery mart tables, deployed on Cloud Run and Kubernetes
  • Orchestration — Airflow DAGs coordinating cross-platform pipelines

Featured projects

Repositories follow {layer}-{platform}-{domain} naming with dev/prod separation, CI/CD via GitHub Actions, and semantic versioning on every release.

Repository Description Stack
infra-gcp GCP data platform: BigQuery, GCS, Cloud Run, IAM — dev/prod via Terraform GCP · Terraform
ingestion-bigquery-ecommerce Python ETL: Olist CSV + API → BigQuery raw tables, retry logic, structured logging Python · BigQuery
transform-bigquery-ecommerce dbt on BigQuery: staging → intermediate → mart, tests, docs, slim CI dbt · SQL · BigQuery
transform-databricks-logistics Medallion architecture on Databricks: bronze → silver → gold with Delta Lake PySpark · Databricks
infra-snowflake Snowflake infrastructure: databases, warehouses, RBAC roles — Terraform managed Snowflake · Terraform
orchestration-airflow Airflow DAGs orchestrating all platform pipelines across GCP, AWS, Databricks Airflow · Python

GitHub stats

GitHub Streak


"Build systems, not tasks."

LinkedIn

Pinned Loading

  1. lincolnmacedo lincolnmacedo Public

    Config files for my GitHub profile.