Skip to content
View deepanshu03091995's full-sized avatar

Block or report deepanshu03091995

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
deepanshu03091995/README.md

πŸ‘‹ Hi, I'm DEEPANSHU RAJUT

🌟 Data Engineer | Cloud Enthusiast | Python Developer

I specialize in designing and building efficient, scalable, and reliable data systems to power data-driven decision-making. With a strong foundation in cloud technologies, big data, and automation, I am passionate about transforming raw data into actionable insights.


πŸ”§ Technologies & Tools

Programming & Scripting

  • Languages: Python, SQL, Java (beginner to intermediate), Scala,
  • Automation: Bash, Python scripts

Big Data & Data Engineering

  • ETL/ELT Tools: PySpark, Kafka, AWS Glue
  • Data Warehousing: BigQuery, AWS Redshift,Snowflake ,Azure Synapse Analytics,Hive
  • Databases: MySQL, PostgreSQL, MSSQL server
  • Data Storage: AWS S3,Azure Data Lake ,Google Cloud Storage

Cloud Platforms

  • AWS: S3, Redshift, EC2, Lambda, Glue, ECR
  • GCP: BigQuery, Cloud Functions, Looker,
  • Azure: Azure DataBricks,Azure Data Factory, Azure Function, Azure Fabric

DevOps & Containerization

  • Tools: Docker, Kubernetes, Terraform ,AWS cloudFormation, Azure ARM Templates
  • CI/CD: Jenkins, GitHub Actions, GitLab CI/CD

Monitoring & Logging

  • Prometheus, Grafana, ELK Stack

**AI/ML Generative AI **

  • TensorFlow, PyTorch, Langchain, llamaIndex ,OpenAi, Gemini,Llama, Mistral

πŸ’Ό Projects

πŸš€ Automated Data Warehousing on GCP

  • Automated ETL workflows with Python scripts and Cloud Functions.
  • Leveraged BigQuery for large-scale data processing and analytics.
  • Designed Looker dashboards, enhancing business insights delivery by 30%.

πŸ” Automatic Number Plate Detection

  • Developed a deep learning-based object detection system using TensorFlow and PyTorch.
  • Deployed models on AWS infrastructure using Docker and FastAPI.

πŸ“Š Real-Time Data Pipeline with Kafka

  • Designed a real-time data pipeline using Kafka, MySQL, PySpark, and AWS services.
  • Enabled seamless data flow into AWS Redshift for analytics.

πŸ“˜ Currently Learning

  • Advanced concepts in Heap and Priority Queues for coding interviews.

πŸ“« Get in Touch


⭐ Fun Fact: I enjoy blending data engineering with DevOps principles to build robust and automated workflows!

Pinned Loading

  1. sensor-fault-detection Public

    Air Pressure System

    Jupyter Notebook

  2. SQL-Database-migration-using-Sqoop-with-airflow Public

    PLpgSQL

  3. US_visa_approval_prediction_using_ML Public

    Jupyter Notebook

  4. mysql-kafka-s3-redshift_data-pipeline Public

    Python

  5. News_API_Data_Pipeline Public

    Python

  6. spark_streaming_realtime_data_pipelinewith-airflow-kakfa-spark Public

    Python