Skip to content
View avnyadav's full-sized avatar

Block or report avnyadav

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
avnyadav/README.md

Data Engineer

I design and implement data solutions using Microsoft Azure services, such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics. With expertise in data modeling, ETL pipelines, and database administration, I ensure data quality and reliability while adhering to industry best practices. I am a collaborative problem-solver who can work with stakeholders to deliver scalable and secure data solutions on the Azure cloud platform.

  • Programing Language: (Python, C#, C++, PySpark) | Databases (SQL Server, MongoDB and MySQL)
  • Distributed Framework (Spark, Hadoop, Hive, Kafka) | Workflow Management(Airflow and IBM Tivoli)
  • Azure Services: Azure Data Factory, Azure Data bricks, Azure Data Lake, Azure blob Storage, Azure SQL DB, Delta Lake
  • AWS Services (S3 bucket, MWAA, Code Pipeline, AWS Lambda, ECS, ECR, Redshift and EC2)
  • Build Tools & Containers (Docker and Kubernetes)
  • Code Management and Documentation (Git, Azure Develops, Circle CI, and GitHub Action)
  • Azure Services (Azure Storage, App Service and Azure Machine Learning Studio)
  • Machine Learning (Regression, Classification, Clustering, Artificial Neural Network, Convolutional Neural
  • Network, Recurrent Neural Network, Encoder and Decoder, Word Embedding)
  • Machine Learning Framework and Libraries (Pandas, Numpy, Sklearn, PySpark, Pytorch, TensorFlow, Matplotlib, Seaborn, TFX.)

Currently learning: Azure HD Insight, Azure Synapse Analytics

Planning to be certified as Azure Data Engineer as soon as possible.

Popular repositories Loading

  1. machine_learning_project machine_learning_project Public

    This is first machine learning project.

    Jupyter Notebook 60 185

  2. sensor-fault-detection sensor-fault-detection Public

    The Air Pressure System (APS) is a critical component of a heavy-duty vehicle that uses compressed air to force a piston to provide pressure to the brake pads, slowing the vehicle down. The benefit…

    Jupyter Notebook 52 241

  3. wafer_circleci wafer_circleci Public

    Python 19 23

  4. spark_project spark_project Public

    Python 9 21

  5. kafka-tutorial kafka-tutorial Public

    6 13

  6. aiops_projects aiops_projects Public

    Jupyter Notebook 5 4