Senior Data Engineer | Cloud Data Pipelines | Scalable AWS & ETL Automations
Senior Data Engineer with 8+ years of experience designing and delivering scalable cloud data platforms and ETL pipelines. Based in Toronto, ON, I specialize in building robust data infrastructure that enables data-driven decision making.
What I do:
- ποΈ Design and build scalable cloud data platforms (AWS, GCP, Azure)
- π Develop production-ready ETL/ELT pipelines with Airflow, dbt, and Matillion
- π Model data warehouses using dimensional modeling (Star/Snowflake schemas)
- π€ Explore GenAI tools, LLMs, and AI technologies for intelligent data processing
- π οΈ Automate infrastructure provisioning with Terraform and CI/CD pipelines
- π Enable A/B testing, user engagement analysis, and real-time analytics
Services: S3, Lambda, Redshift, Glue, RDS, DynamoDB, ECS Fargate, BigQuery, Cloud Storage, Cloud Dataflow
Tools: Informatica PowerCenter, SSIS, Autosys, Databricks, PySpark, Apache Spark
Libraries: pandas, numpy, requests | Languages: Python, Advanced SQL, PL/SQL, Shell Scripting
Databases: Redshift, SQL Server, Oracle, Teradata, DB2 | Modeling: Dimensional Modeling (Star/Snowflake)
Tools: Terraform, Jenkins, Git, CI/CD Pipelines, Containerized Services
Technologies: LLMs (OpenAI, Anthropic), RAG, Vector Databases, Model Context Protocol (MCP)
Tools: CloudWatch, Grafana, Data Quality Frameworks, Metadata Management
Tools: Looker (LookML), SSRS, Report Builder
- π§ Email: deepapanicker11@gmail.com
- πΌ LinkedIn: linkedin.com/in/deepagovindapanicker
- π Portfolio: deepapanicker.com
- π» GitHub: github.com/deepapanicker
- π― Passionate about building scalable data solutions that enable data-driven decision making
- π Always exploring new technologies to enhance data processing capabilities
- π Love sharing knowledge and mentoring others in data engineering
- β Coffee enthusiast and problem solver
Thanks for visiting my profile! Feel free to connect or reach out for collaboration opportunities. π