Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Computer vision dev with online training branch complete #22

Merged
merged 18 commits into from
Jun 3, 2022

Conversation

setuc
Copy link
Collaborator

@setuc setuc commented Jun 3, 2022

Finished the development of the Computer Vision Pipeline:

  • Download the dataset and upload it to blob.
  • Create a environment using the dockerfile and requirements.txt.
  • Training Pipeline that fine tune the cnn models from the pytorch.
  • Registering the model using MLFlow (Includes two differenet methods).
  • Deploying the model to an online endpoint and perform a single test on it.

setuc added 18 commits May 27, 2022 11:16
Review the folder/file structure.
1. Added Dataset YAML to run as a job
2. Added environment build YAML
3. Added CV training YAML.
missed the file in the commit.
* Working MLFlow model
* Registration is done using log_model and register_model
* label mapping to output from the API is stored in the label-mapping.txt. This file can be used together with the output from the API to map the list of floats to the dogs' class.

Formatting fixes

Adding the  DevOps Pipeline

Update deploy-model-training-pipeline.yml

Updating the template path (Temporary - Fix)

Update deploy-model-training-pipeline.yml for Azure Pipelines

Update deploy-model-training-pipeline.yml for Azure Pipelines

Update deploy-model-training-pipeline.yml for Azure Pipelines

Update deploy-model-training-pipeline.yml for Azure Pipelines

Update deploy-model-training-pipeline.yml

fixes to the path

Hardcoding the variables

Temporary fixing the resource names to test the e2e pipeline

Update the online deployment pipeline

[skip ci]

Update deploy-online-endpoint-pipeline.yml for Azure Pipelines

Create a sample request for the online api

Update deploy-online-endpoint-pipeline.yml

Update deploy-online-endpoint-pipeline.yml

Update deploy-online-endpoint-pipeline.yml for Azure Pipelines

Updated the VM with large memory

Standard_F2s_v2 run out of memory when setting up the CV container.

Update online-deployment.yml

Update train model to use float instead of double

Fixing the double/float issue

Update train.py

Update train.py
* Removed used imports
* Scheduler was not used in the train step. Added it back in.
* Fixed the parameter for data_type in register_dataset step
Since the return type is contitional, LGTM is not able to determine that its an iterator
@setuc setuc added the 💎 enhancement New feature or request label Jun 3, 2022
@setuc setuc requested review from cindyweng and chrey-gh June 3, 2022 07:49
@setuc setuc self-assigned this Jun 3, 2022
@setuc setuc merged commit 82f00fd into main Jun 3, 2022
@lgtm-com
Copy link

lgtm-com bot commented Jun 3, 2022

This pull request introduces 1 alert when merging 28db38b into 93b1862 - view on LGTM.com

new alerts:

  • 1 for Iterator does not return self from `__iter__` method

@setuc setuc deleted the computer-vision-dev branch June 3, 2022 08:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💎 enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants