Initial Public Release
This is the first public release of the Enterprise Data Platform – SQL Server project.
The project demonstrates practical Database Engineering and Data Engineering concepts using SQL Server, Python and Docker.
Highlights
- SQL Server 2022 database platform
- Docker-based local development environment
- Python ETL utilities
- Staging-first ETL architecture
- Normalized relational database design
- Audit and logging framework
- Monitoring and health check scripts
- Backup and recovery examples
- Automated testing with pytest
- Comprehensive technical documentation
- Architecture, database and ETL diagrams
- SQL Server Management Studio deployment example
Documentation
The repository includes detailed documentation covering:
- Architecture
- Database Design
- ETL Process
- Monitoring
- Deployment Guide
- Architecture Decisions
Technology Stack
- SQL Server 2022
- T-SQL
- Python 3
- Docker Compose
- Git & GitHub
- pytest
Future Work
Future releases will focus on:
- incremental ETL loading
- workflow orchestration
- performance optimization
- cloud deployment options
Thank you for exploring the project.
Feedback, suggestions and contributions are always welcome.