Skip to content

Release v0.1.1

Choose a tag to compare

View all tags
@Olyxz16 Olyxz16 released this 28 Oct 14:45
· 316 commits to main since this release
v0.1.1
96da834 
Release v0.1.1: ETL Pipeline with Go Scrapers and dbt Transformations

- Complete ETL pipeline for open source project data collection
- Go scrapers for GitHub and GitLab APIs (1000 repos each)
- PostgreSQL database with staging and marts schemas
- dbt transformations for data cleaning and modeling
- Dagster orchestration with web UI monitoring
- Docker Compose setup for local development
- Fixed PostgreSQL port configuration and table naming consistency
- Clean git history and proper documentation
Assets 2
Loading